May 21 18:20:19.088480 ip-10-0-138-250 systemd[1]: Starting Kubernetes Kubelet...
May 21 18:20:19.527622 ip-10-0-138-250 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:19.527622 ip-10-0-138-250 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 18:20:19.527622 ip-10-0-138-250 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:19.527622 ip-10-0-138-250 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 18:20:19.527622 ip-10-0-138-250 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:19.529408 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.529310    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 18:20:19.534154 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534132    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:19.534154 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534154    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:19.534154 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534157    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534160    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534176    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534180    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534182    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534186    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534188    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534191    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534199    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534203    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534205    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534208    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534212    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534214    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534217    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534222    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534226    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534229    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534232    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534235    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:19.534274 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534238    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534241    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534244    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534247    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534250    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534253    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534256    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534258    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534261    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534264    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534267    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534269    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534271    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534274    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534278    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534281    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534283    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534286    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534290    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534294    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:19.534746 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534297    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534299    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534302    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534305    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534307    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534310    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534312    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534315    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534318    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534320    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534323    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534325    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534328    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534330    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534333    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534336    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534338    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534341    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534343    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534346    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:19.535264 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534348    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534351    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534355    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534358    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534360    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534363    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534367    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534369    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534372    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534375    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534378    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534380    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534383    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534388    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534392    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534395    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534398    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534401    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534404    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534406    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:19.535791 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534409    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534411    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534414    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534416    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534840    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534845    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534848    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534851    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534854    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534858    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534862    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534866    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534869    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534872    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534875    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534878    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534880    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534884    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534886    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:19.536302 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534889    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534892    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534895    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534898    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534900    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534904    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534906    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534909    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534911    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534913    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534916    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534919    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534921    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534924    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534926    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534928    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534931    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534933    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534936    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534938    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:19.536783 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534941    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534943    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534946    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534949    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534952    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534954    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534957    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534960    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534963    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534966    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534969    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534971    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534975    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534978    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534981    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534984    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534987    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534991    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534994    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534997    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:19.537319 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.534999    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535002    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535004    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535006    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535009    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535012    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535014    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535017    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535019    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535022    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535024    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535027    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535030    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535032    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535035    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535038    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535041    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535043    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535046    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535049    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:19.537827 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535052    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535055    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535057    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535060    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535062    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535065    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535068    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535070    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535073    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535075    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.535078    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536105    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536116    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536125    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536130    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536135    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536139    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536143    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536148    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536151    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536154    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 18:20:19.538424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536158    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536161    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536178    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536181    2557 flags.go:64] FLAG: --cgroup-root=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536184    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536187    2557 flags.go:64] FLAG: --client-ca-file=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536191    2557 flags.go:64] FLAG: --cloud-config=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536194    2557 flags.go:64] FLAG: --cloud-provider="external"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536197    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536206    2557 flags.go:64] FLAG: --cluster-domain=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536209    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536213    2557 flags.go:64] FLAG: --config-dir=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536216    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536220    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536224    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536227    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536230    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536234    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536237    2557 flags.go:64] FLAG: --contention-profiling="false"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536240    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536243    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536247    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536250    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536254    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536258    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 18:20:19.538932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536261    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536264    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536267    2557 flags.go:64] FLAG: --enable-server="true"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536270    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536274    2557 flags.go:64] FLAG: --event-burst="100"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536277    2557 flags.go:64] FLAG: --event-qps="50"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536281    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536284    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536287    2557 flags.go:64] FLAG: --eviction-hard=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536291    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536293    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536297    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536300    2557 flags.go:64] FLAG: --eviction-soft=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536303    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536306    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536309    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536313    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536316    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536320    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536323    2557 flags.go:64] FLAG: --feature-gates=""
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536327    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536330    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536333    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536337    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536340    2557 flags.go:64] FLAG: --healthz-port="10248"
May 21 18:20:19.539548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536343    2557 flags.go:64] FLAG: --help="false"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536346    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536349    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536353    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536356    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536359    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536363    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536366    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536369    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536372    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536375    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536378    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536381    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536384    2557 flags.go:64] FLAG: --kube-reserved=""
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536387    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536390    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536393    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536396    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536399    2557 flags.go:64] FLAG: --lock-file=""
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536402    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536405    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536408    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536414    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 18:20:19.540144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536417    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536420    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536423    2557 flags.go:64] FLAG: --logging-format="text"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536425    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536429    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536432    2557 flags.go:64] FLAG: --manifest-url=""
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536435    2557 flags.go:64] FLAG: --manifest-url-header=""
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536439    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536442    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536446    2557 flags.go:64] FLAG: --max-pods="110"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536449    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536453    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536456    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536459    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536462    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536465    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536469    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536478    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536481    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536484    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536488    2557 flags.go:64] FLAG: --pod-cidr=""
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536491    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536497    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536500    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 18:20:19.540728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536503    2557 flags.go:64] FLAG: --pods-per-core="0"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536506    2557 flags.go:64] FLAG: --port="10250"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536509    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536512    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0761f358c8e38637c"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536516    2557 flags.go:64] FLAG: --qos-reserved=""
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536519    2557 flags.go:64] FLAG: --read-only-port="10255"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536522    2557 flags.go:64] FLAG: --register-node="true"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536525    2557 flags.go:64] FLAG: --register-schedulable="true"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536528    2557 flags.go:64] FLAG: --register-with-taints=""
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536532    2557 flags.go:64] FLAG: --registry-burst="10"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536535    2557 flags.go:64] FLAG: --registry-qps="5"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536538    2557 flags.go:64] FLAG: --reserved-cpus=""
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536540    2557 flags.go:64] FLAG: --reserved-memory=""
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536544    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536547    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536550    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536553    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536556    2557 flags.go:64] FLAG: --runonce="false"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536558    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536561    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536565    2557 flags.go:64] FLAG: --seccomp-default="false"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536567    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536570    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536573    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536577    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536580    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 21 18:20:19.541319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536583    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536586    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536589    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536592    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536595    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536598    2557 flags.go:64] FLAG: --system-cgroups=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536601    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536607    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536609    2557 flags.go:64] FLAG: --tls-cert-file=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536612    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536617    2557 flags.go:64] FLAG: --tls-min-version=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536623    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536625    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536629    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536632    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536635    2557 flags.go:64] FLAG: --v="2"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536639    2557 flags.go:64] FLAG: --version="false"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536644    2557 flags.go:64] FLAG: --vmodule=""
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536648    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.536651    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536754    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536758    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536761    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536764    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:19.541942 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536767    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536770    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536772    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536775    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536778    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536781    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536783    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536786    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536789    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536792    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536795    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536798    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536800    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536803    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536805    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536808    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536810    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536813    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536815    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536819    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:19.542537 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536822    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536825    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536827    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536830    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536832    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536835    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536838    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536840    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536842    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536845    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536848    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536850    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536853    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536855    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536858    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536861    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536864    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536866    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536869    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536871    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:19.543066 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536875    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536879    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536883    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536886    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536889    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536892    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536894    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536897    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536900    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536902    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536905    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536909    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536911    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536914    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536916    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536920    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536924    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536927    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536930    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:19.543574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536933    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536935    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536938    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536940    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536943    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536945    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536948    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536951    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536953    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536956    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536958    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536961    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536964    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536966    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536969    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536973    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536975    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536978    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536981    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536986    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:19.544030 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536989    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536992    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.536995    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.537596    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.543967    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.543985    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544034    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544039    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544042    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544046    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544049    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544052    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544055    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544057    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544060    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544063    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:19.544577 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544066    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544069    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544071    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544074    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544076    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544079    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544082    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544084    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544087    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544090    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544092    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544095    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544097    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544100    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544103    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544105    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544108    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544110    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544113    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544116    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:19.544977 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544119    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544124    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544127    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544129    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544132    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544134    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544137    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544140    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544143    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544146    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544148    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544151    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544154    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544156    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544159    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544161    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544176    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544178    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544181    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:19.545480 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544184    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544186    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544189    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544192    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544194    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544197    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544200    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544202    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544205    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544208    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544211    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544213    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544216    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544219    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544222    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544225    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544228    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544231    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544234    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544236    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:19.545953 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544239    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544242    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544244    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544247    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544249    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544252    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544254    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544257    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544259    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544262    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544265    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544267    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544272    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544276    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544279    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544283    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:19.546485 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544287    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.544292    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544410    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544416    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544420    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544423    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544426    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544428    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544431    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544434    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544437    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544441    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544444    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544447    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544449    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544452    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:19.546876 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544455    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544457    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544460    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544463    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544465    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544468    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544471    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544473    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544476    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544478    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544481    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544484    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544487    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544489    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544492    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544494    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544497    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544499    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544502    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544504    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:19.547276 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544507    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544509    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544512    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544515    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544517    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544520    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544523    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544526    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544529    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544532    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544535    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544537    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544541    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544545    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544548    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544550    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544553    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544555    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544558    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544560    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:19.547798 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544563    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544565    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544568    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544570    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544573    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544575    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544578    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544580    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544583    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544586    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544588    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544591    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544594    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544597    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544599    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544602    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544604    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544607    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544611    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:19.548363 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544614    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544617    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544620    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544623    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544626    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544629    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544632    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544634    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544637    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544639    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544642    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544644    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:19.544647    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.544651    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.545344    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 18:20:19.548865 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.547253    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 18:20:19.549437 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.548181    2557 server.go:1019] "Starting client certificate rotation"
May 21 18:20:19.549437 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.548293    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:20:19.549437 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.548344    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:20:19.573433 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.573406    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:20:19.577003 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.576978    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:20:19.589447 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.589425    2557 log.go:25] "Validated CRI v1 runtime API"
May 21 18:20:19.594019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.594000    2557 log.go:25] "Validated CRI v1 image API"
May 21 18:20:19.597952 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.597922    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 18:20:19.601290 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.601271    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:20:19.601979 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.601948    2557 fs.go:135] Filesystem UUIDs: map[51417d3b-c3bc-44cc-b298-e4fe2049f45b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ed825f85-2252-4a59-9591-cd0efcfde6b9:/dev/nvme0n1p3]
May 21 18:20:19.602059 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.601977    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 18:20:19.606469 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.606343    2557 manager.go:217] Machine: {Timestamp:2026-05-21 18:20:19.605803477 +0000 UTC m=+0.398651727 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101346 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f3efa4a5e9ce2a27e8245c952541 SystemUUID:ec21f3ef-a4a5-e9ce-2a27-e8245c952541 BootID:9c7663c9-49b8-4ec9-b544-801499e9b497 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:42:79:b6:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:42:79:b6:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:d0:a9:a5:0a:f8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 18:20:19.607200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.607186    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 18:20:19.607363 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.607345    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 18:20:19.609289 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609260    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 18:20:19.609440 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609291    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 18:20:19.609484 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609450    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 21 18:20:19.609484 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609459    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 21 18:20:19.609484 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609467    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:20:19.609484 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.609481    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:20:19.611513 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.611502    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:20:19.611627 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.611618    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 18:20:19.613808 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.613798    2557 kubelet.go:491] "Attempting to sync node with API server"
May 21 18:20:19.613851 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.613819    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 18:20:19.613851 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.613832    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 18:20:19.613851 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.613841    2557 kubelet.go:397] "Adding apiserver pod source"
May 21 18:20:19.613851 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.613850    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 18:20:19.614948 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.614931    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:20:19.614948 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.614950    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:20:19.617820 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.617800    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 18:20:19.619466 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.619452    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 18:20:19.620448 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620434    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 18:20:19.620515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620456    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 18:20:19.620515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620465    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 18:20:19.620515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620473    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 18:20:19.620515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620485    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 18:20:19.620515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620516    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 18:20:19.620645 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620523    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 18:20:19.620645 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620529    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 18:20:19.620645 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620536    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 18:20:19.620645 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620542    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 18:20:19.620645 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620552    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 18:20:19.620841 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.620683    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 18:20:19.622533 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.622521    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 18:20:19.622533 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.622532    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 18:20:19.623780 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.623747    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpc7h"
May 21 18:20:19.626742 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.626722    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 18:20:19.626927 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.626914    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 18:20:19.626970 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.626962    2557 server.go:1295] "Started kubelet"
May 21 18:20:19.627054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.627019    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 18:20:19.627432 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.627401    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 18:20:19.627432 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.627401    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 18:20:19.627589 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.627417    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 18:20:19.627589 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.627495    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 18:20:19.627898 ip-10-0-138-250 systemd[1]: Started Kubernetes Kubelet.
May 21 18:20:19.628621 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.628564    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 18:20:19.629116 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.628979    2557 server.go:317] "Adding debug handlers to kubelet server"
May 21 18:20:19.633210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633192    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 18:20:19.633386 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633368    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpc7h"
May 21 18:20:19.633649 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633628    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 18:20:19.633740 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633692    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 18:20:19.633740 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633707    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 18:20:19.633880 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633868    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 18:20:19.633941 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633935    2557 reconstruct.go:97] "Volume reconstruction finished"
May 21 18:20:19.633981 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.633944    2557 reconciler.go:26] "Reconciler: start to sync state"
May 21 18:20:19.634629 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.634609    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:19.635242 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.634799    2557 factory.go:55] Registering systemd factory
May 21 18:20:19.635242 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.634852    2557 factory.go:223] Registration of the systemd container factory successfully
May 21 18:20:19.635748 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.635734    2557 factory.go:153] Registering CRI-O factory
May 21 18:20:19.635838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.635751    2557 factory.go:223] Registration of the crio container factory successfully
May 21 18:20:19.635891 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.635851    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 18:20:19.635891 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.635869    2557 factory.go:103] Registering Raw factory
May 21 18:20:19.635891 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.635885    2557 manager.go:1196] Started watching for new ooms in manager
May 21 18:20:19.636327 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.636312    2557 manager.go:319] Starting recovery of all containers
May 21 18:20:19.636891 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.634800    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-250.ec2.internal.18b1a79cc99748fe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-250.ec2.internal,UID:ip-10-0-138-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-250.ec2.internal,},FirstTimestamp:2026-05-21 18:20:19.626928382 +0000 UTC m=+0.419776631,LastTimestamp:2026-05-21 18:20:19.626928382 +0000 UTC m=+0.419776631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-250.ec2.internal,}"
May 21 18:20:19.639181 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.639121    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 18:20:19.641670 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.641648    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:19.646372 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.646345    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.648545 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.648526    2557 manager.go:324] Recovery completed
May 21 18:20:19.653358 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.653345    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.655205 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655151    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.655205 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655199    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.655347 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655212    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.655727 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655713    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 18:20:19.655787 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655729    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 18:20:19.655787 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.655747    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:20:19.658779 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.658761    2557 policy_none.go:49] "None policy: Start"
May 21 18:20:19.658779 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.658782    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 18:20:19.658887 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.658792    2557 state_mem.go:35] "Initializing new in-memory state store"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.708869    2557 manager.go:341] "Starting Device Plugin manager"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.708983    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.708999    2557 server.go:85] "Starting device plugin registration server"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.709283    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.709295    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.709405    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.709485    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.709491    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.710106    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 18:20:19.713376 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.710141    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:19.758771 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.758720    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 18:20:19.759874 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.759859    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 18:20:19.759954 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.759887    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 18:20:19.759954 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.759910    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 18:20:19.759954 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.759919    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 18:20:19.760047 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.759962    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 18:20:19.762546 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.762521    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:19.809823 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.809746    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.810788 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.810770    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.810900 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.810799    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.810900 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.810812    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.810900 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.810834    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.822061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.822037    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.822118 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.822066    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-250.ec2.internal\": node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:19.846401 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.846374    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:19.860750 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.860723    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"]
May 21 18:20:19.860850 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.860797    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.861730 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.861713    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.861834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.861749    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.861834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.861764    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.863898 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.863882    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.864021 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864007    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:19.864065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864034    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.864698 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864681    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.864698 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864695    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.864843 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864713    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.864843 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864716    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.864843 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864727    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.864843 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.864734    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.866758 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.866743    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:19.866810 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.866777    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:19.867641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.867623    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:19.867755 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.867654    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:19.867755 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:19.867668    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:19.891035 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.891011    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.895616 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.895600    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal"
May 21 18:20:19.946494 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:19.946460    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.035338 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.035300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89645f16c3c592f4f40ac03de31cc6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"2f89645f16c3c592f4f40ac03de31cc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.035499 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.035334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.035499 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.035372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.047389 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.047357    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.136023 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.135980    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89645f16c3c592f4f40ac03de31cc6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"2f89645f16c3c592f4f40ac03de31cc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.136023 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.136030    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.136197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.136078    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.136197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.136095    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.136197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.136077    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f89645f16c3c592f4f40ac03de31cc6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"2f89645f16c3c592f4f40ac03de31cc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.136197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.136127    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff452d1c57a087cbd80b5b952418d6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"7ff452d1c57a087cbd80b5b952418d6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.148122 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.148092    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.193320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.193296    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.198109 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.198086    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.248953 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.248916    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.349431 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.349398    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.449977 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.449895    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.548557 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.548527    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 18:20:20.549152 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.548697    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:20:20.549152 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.548727    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:20:20.550683 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:20.550662    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found"
May 21 18:20:20.591654 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.591624    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:20.622906 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.622879    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:20.633325 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.633297    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 18:20:20.634455 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.634435    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.635452 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.635410    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:15:19 +0000 UTC" deadline="2027-10-24 09:17:06.239115639 +0000 UTC"
May 21 18:20:20.635452 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.635449    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12494h56m45.60366945s"
May 21 18:20:20.641786 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.641769    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:20:20.642865 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.642845    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"
May 21 18:20:20.644336 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.644316    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:20:20.651755 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.651732    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:20:20.661904 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.661877    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bf228"
May 21 18:20:20.669588 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.669568    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bf228"
May 21 18:20:20.726873 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:20.726523    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff452d1c57a087cbd80b5b952418d6e.slice/crio-705a17b25963d68425229a3c212ad2826759f0594c4927de903040eb557c2d95 WatchSource:0}: Error finding container 705a17b25963d68425229a3c212ad2826759f0594c4927de903040eb557c2d95: Status 404 returned error can't find the container with id 705a17b25963d68425229a3c212ad2826759f0594c4927de903040eb557c2d95
May 21 18:20:20.727355 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:20.727333    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f89645f16c3c592f4f40ac03de31cc6.slice/crio-c1ca31b39cccb9858906e72d70c8cfbabb0e4c2e5610c59251eb80560eb7e28d WatchSource:0}: Error finding container c1ca31b39cccb9858906e72d70c8cfbabb0e4c2e5610c59251eb80560eb7e28d: Status 404 returned error can't find the container with id c1ca31b39cccb9858906e72d70c8cfbabb0e4c2e5610c59251eb80560eb7e28d
May 21 18:20:20.730791 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.730606    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:20:20.762418 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.762367    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" event={"ID":"2f89645f16c3c592f4f40ac03de31cc6","Type":"ContainerStarted","Data":"c1ca31b39cccb9858906e72d70c8cfbabb0e4c2e5610c59251eb80560eb7e28d"}
May 21 18:20:20.763247 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:20.763225    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"7ff452d1c57a087cbd80b5b952418d6e","Type":"ContainerStarted","Data":"705a17b25963d68425229a3c212ad2826759f0594c4927de903040eb557c2d95"}
May 21 18:20:21.595360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.595275    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:21.615057 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.615016    2557 apiserver.go:52] "Watching apiserver"
May 21 18:20:21.621529 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.621489    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 18:20:21.621933 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.621907    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-kn4wt","openshift-multus/multus-pftmb","openshift-network-diagnostics/network-check-target-xj98l","kube-system/konnectivity-agent-qbglv","kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal","openshift-multus/multus-additional-cni-plugins-8vwfw","openshift-multus/network-metrics-daemon-2crcx","openshift-network-operator/iptables-alerter-wp222","openshift-ovn-kubernetes/ovnkube-node-pfjxx","openshift-cluster-node-tuning-operator/tuned-8jdnk","openshift-dns/node-resolver-r5r6h"]
May 21 18:20:21.624425 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.624397    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.626505 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.626482    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 18:20:21.626628 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.626493    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pftmb"
May 21 18:20:21.626784 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.626759    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 18:20:21.626893 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.626878    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8v9cq\""
May 21 18:20:21.626959 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.626925    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 18:20:21.628447 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.628427    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 18:20:21.628554 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.628452    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 18:20:21.628622 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.628474    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 18:20:21.628976 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.628949    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s4nk7\""
May 21 18:20:21.629072 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.628996    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 18:20:21.631912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.631893    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:21.632028 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.631985    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.632188 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.631983    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:21.633829 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.633811    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 18:20:21.633829 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.633823    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sx62s\""
May 21 18:20:21.633988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.633814    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 18:20:21.634508 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.634485    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.636315 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.636295    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 18:20:21.636417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.636374    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbl6l\""
May 21 18:20:21.636417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.636405    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 18:20:21.636517 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.636380    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 18:20:21.636822 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.636774    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.639609 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.639578    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.639749 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.639691    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:21.640111 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.640053    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 18:20:21.640399 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.640382    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 18:20:21.640566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.640550    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7d54\""
May 21 18:20:21.643892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.643861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/debc01e9-5712-4adb-8eb0-e876bf912c52-iptables-alerter-script\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.644019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.643912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvb7\" (UniqueName: \"kubernetes.io/projected/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-kube-api-access-ttvb7\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.643946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dd942c0-9985-4308-a628-4a8e6581bda2-agent-certs\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.644019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.643974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bm7\" (UniqueName: \"kubernetes.io/projected/debc01e9-5712-4adb-8eb0-e876bf912c52-kube-api-access-p5bm7\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.644019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.643998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-bin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-etc-kubernetes\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-socket-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-device-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-system-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-socket-dir-parent\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-registration-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-netns\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-multus-certs\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dd942c0-9985-4308-a628-4a8e6581bda2-konnectivity-ca\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-hostroot\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cnibin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-os-release\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-conf-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-sys-fs\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwcp\" (UniqueName: \"kubernetes.io/projected/1f166a44-1f96-42a0-91db-2f9654fdc144-kube-api-access-5bwcp\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/debc01e9-5712-4adb-8eb0-e876bf912c52-host-slash\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-k8s-cni-cncf-io\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-daemon-config\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cni-binary-copy\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-multus\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.644816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-kubelet\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.645258 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.644939    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.645258 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.645091    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.647156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.646963    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 18:20:21.647156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.646971    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 18:20:21.647156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.646991    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 18:20:21.647156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647075    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 18:20:21.647479 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647456    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 18:20:21.647558 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647503    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.647675 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647661    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmsx9\""
May 21 18:20:21.647847 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647832    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 18:20:21.647893 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647845    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9wzpb\""
May 21 18:20:21.647947 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647911    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 18:20:21.647947 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647929    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 18:20:21.648033 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.647969    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 18:20:21.649682 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.649664    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 18:20:21.649817 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.649800    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j58fw\""
May 21 18:20:21.649884 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.649815    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.649938 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.649928    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 18:20:21.651609 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.651587    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 18:20:21.651704 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.651624    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n8qtt\""
May 21 18:20:21.651704 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.651668    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 18:20:21.670276 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.670241    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:20 +0000 UTC" deadline="2027-11-13 20:59:49.898761055 +0000 UTC"
May 21 18:20:21.670276 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.670272    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12986h39m28.22849134s"
May 21 18:20:21.735589 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.735559    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 18:20:21.744930 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.744893    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvb7\" (UniqueName: \"kubernetes.io/projected/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-kube-api-access-ttvb7\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.744930 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.744936    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dd942c0-9985-4308-a628-4a8e6581bda2-agent-certs\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.744959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-systemd-units\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745006    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-bin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745031    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-socket-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-netns\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-env-overrides\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-script-lib\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745094    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-bin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-sys\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745192    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-system-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-system-cni-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745274    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-socket-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp2lh\" (UniqueName: \"kubernetes.io/projected/713b4e2f-d823-47c5-9569-590331d77c51-kube-api-access-kp2lh\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745324    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-system-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-kubernetes\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-tmp\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745427    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-netns\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745457    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-multus-certs\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745457    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745478    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-netns\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.745568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745553    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-multus-certs\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysconfig\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745701    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-run\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-host\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745752    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cnibin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745773    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-os-release\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745796    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-sys-fs\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-systemd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-etc-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745869    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-os-release\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745820    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cnibin\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-log-socket\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745905    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-sys-fs\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-systemd\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745955    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/debc01e9-5712-4adb-8eb0-e876bf912c52-host-slash\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.746144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.745982    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-k8s-cni-cncf-io\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746007    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746015    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/debc01e9-5712-4adb-8eb0-e876bf912c52-host-slash\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qd4\" (UniqueName: \"kubernetes.io/projected/54241619-c527-4fd1-9fa8-bd713aad1d9e-kube-api-access-95qd4\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746057    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-run-k8s-cni-cncf-io\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746092    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-ovn\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746150    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cni-binary-copy\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746193    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-kubelet\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-modprobe-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746248    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/debc01e9-5712-4adb-8eb0-e876bf912c52-iptables-alerter-script\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746273    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-cnibin\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746275    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-kubelet\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/713b4e2f-d823-47c5-9569-590331d77c51-host\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-var-lib-kubelet\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40b2e50c-f0bb-4771-806f-46de4e22fda0-hosts-file\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.746861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746369    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bm7\" (UniqueName: \"kubernetes.io/projected/debc01e9-5712-4adb-8eb0-e876bf912c52-kube-api-access-p5bm7\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-etc-kubernetes\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746421    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-device-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746437    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746452    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/713b4e2f-d823-47c5-9569-590331d77c51-serviceca\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-config\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-conf\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746513    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-socket-dir-parent\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746542    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-registration-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-node-log\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-bin\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746616    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-lib-modules\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-tuned\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746645    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746662    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dd942c0-9985-4308-a628-4a8e6581bda2-konnectivity-ca\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-slash\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.747435 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746687    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-cni-binary-copy\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746695    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw82x\" (UniqueName: \"kubernetes.io/projected/abc12d08-504c-463b-9194-653d0407336b-kube-api-access-mw82x\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b2e50c-f0bb-4771-806f-46de4e22fda0-tmp-dir\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746730    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-hostroot\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-os-release\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-var-lib-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-netd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746812    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/debc01e9-5712-4adb-8eb0-e876bf912c52-iptables-alerter-script\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpw8w\" (UniqueName: \"kubernetes.io/projected/40b2e50c-f0bb-4771-806f-46de4e22fda0-kube-api-access-qpw8w\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746876    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-registration-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746821    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-socket-dir-parent\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746929    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-etc-kubernetes\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746963    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-conf-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.746993    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwcp\" (UniqueName: \"kubernetes.io/projected/1f166a44-1f96-42a0-91db-2f9654fdc144-kube-api-access-5bwcp\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9106c2d4-ddd2-454c-9324-e21483abe021-ovn-node-metrics-cert\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.748193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747065    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-cni-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjpf\" (UniqueName: \"kubernetes.io/projected/9106c2d4-ddd2-454c-9324-e21483abe021-kube-api-access-fvjpf\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747092    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-hostroot\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgl8g\" (UniqueName: \"kubernetes.io/projected/8686925f-8c79-4d6b-aa74-b565482c2f2c-kube-api-access-tgl8g\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747130    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-device-dir\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747138    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-daemon-config\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747161    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f166a44-1f96-42a0-91db-2f9654fdc144-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747215    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-conf-dir\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747241    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dd942c0-9985-4308-a628-4a8e6581bda2-konnectivity-ca\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747276    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747338    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-multus\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747370    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-host-var-lib-cni-multus\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-kubelet\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.748978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.747665    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-multus-daemon-config\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.749672 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.749218    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dd942c0-9985-4308-a628-4a8e6581bda2-agent-certs\") pod \"konnectivity-agent-qbglv\" (UID: \"2dd942c0-9985-4308-a628-4a8e6581bda2\") " pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.754279 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.754256    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:21.754429 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.754284    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:21.754429 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.754299    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:21.754429 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.754380    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:22.254345449 +0000 UTC m=+3.047193703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:21.757132 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.757102    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvb7\" (UniqueName: \"kubernetes.io/projected/d0f31e31-63a9-4cb8-b640-9761d6c3ade9-kube-api-access-ttvb7\") pod \"multus-pftmb\" (UID: \"d0f31e31-63a9-4cb8-b640-9761d6c3ade9\") " pod="openshift-multus/multus-pftmb"
May 21 18:20:21.758120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.758096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwcp\" (UniqueName: \"kubernetes.io/projected/1f166a44-1f96-42a0-91db-2f9654fdc144-kube-api-access-5bwcp\") pod \"aws-ebs-csi-driver-node-rs5d7\" (UID: \"1f166a44-1f96-42a0-91db-2f9654fdc144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.758390 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.758370    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bm7\" (UniqueName: \"kubernetes.io/projected/debc01e9-5712-4adb-8eb0-e876bf912c52-kube-api-access-p5bm7\") pod \"iptables-alerter-wp222\" (UID: \"debc01e9-5712-4adb-8eb0-e876bf912c52\") " pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.848198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848092    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.848198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848130    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-node-log\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848153    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-bin\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848192    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-lib-modules\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848228    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-node-log\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848228    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-tuned\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848264    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-slash\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848289    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw82x\" (UniqueName: \"kubernetes.io/projected/abc12d08-504c-463b-9194-653d0407336b-kube-api-access-mw82x\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848310    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b2e50c-f0bb-4771-806f-46de4e22fda0-tmp-dir\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848333    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-os-release\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848360    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-var-lib-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848375    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-lib-modules\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848412    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-bin\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848387    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-netd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848446    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848468    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpw8w\" (UniqueName: \"kubernetes.io/projected/40b2e50c-f0bb-4771-806f-46de4e22fda0-kube-api-access-qpw8w\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848498    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.848526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848525    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9106c2d4-ddd2-454c-9324-e21483abe021-ovn-node-metrics-cert\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848548    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjpf\" (UniqueName: \"kubernetes.io/projected/9106c2d4-ddd2-454c-9324-e21483abe021-kube-api-access-fvjpf\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848572    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgl8g\" (UniqueName: \"kubernetes.io/projected/8686925f-8c79-4d6b-aa74-b565482c2f2c-kube-api-access-tgl8g\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848596    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848628    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848654    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848677    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-kubelet\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848705    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-systemd-units\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848733    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-netns\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848779    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-env-overrides\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848778    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848803    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-script-lib\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848837    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-sys\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848786    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-slash\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848886    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-cni-netd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848897    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-sys\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848907    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-netns\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.848961    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-kubelet\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.849126 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.848972    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849008    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-systemd-units\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849018    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:21.849042    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:22.349022123 +0000 UTC m=+3.141870380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849064    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-os-release\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849065    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-system-cni-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849089    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b2e50c-f0bb-4771-806f-46de4e22fda0-tmp-dir\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849095    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kp2lh\" (UniqueName: \"kubernetes.io/projected/713b4e2f-d823-47c5-9569-590331d77c51-kube-api-access-kp2lh\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849120    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-kubernetes\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849120    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-system-cni-dir\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849138    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-tmp\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849191    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849206    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-kubernetes\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849222    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849258    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysconfig\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849298    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-run\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849323    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-host\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849331    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-env-overrides\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849350    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-systemd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849378    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-etc-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849407    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-log-socket\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849432    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849462    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-systemd\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysconfig\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849512    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95qd4\" (UniqueName: \"kubernetes.io/projected/54241619-c527-4fd1-9fa8-bd713aad1d9e-kube-api-access-95qd4\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849554    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-ovn\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849562    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849593    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-modprobe-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849606    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-ovn\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849697    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-run\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849750    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-host\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849792    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-run-systemd\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849834    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-script-lib\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849911    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-modprobe-d\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.850828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849965    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-cnibin\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-systemd\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.849628    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54241619-c527-4fd1-9fa8-bd713aad1d9e-cnibin\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850086    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-etc-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850085    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/713b4e2f-d823-47c5-9569-590331d77c51-host\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850151    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/713b4e2f-d823-47c5-9569-590331d77c51-host\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850153    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-var-lib-kubelet\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850216    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40b2e50c-f0bb-4771-806f-46de4e22fda0-hosts-file\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-var-lib-kubelet\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850244    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850276    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-log-socket\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850299    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/713b4e2f-d823-47c5-9569-590331d77c51-serviceca\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850304    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54241619-c527-4fd1-9fa8-bd713aad1d9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850328    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-config\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850353    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850373    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-var-lib-openvswitch\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.851515 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850402    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-conf\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.852203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850567    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9106c2d4-ddd2-454c-9324-e21483abe021-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.852203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850577    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-sysctl-conf\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.852203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40b2e50c-f0bb-4771-806f-46de4e22fda0-hosts-file\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.852203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850748    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/713b4e2f-d823-47c5-9569-590331d77c51-serviceca\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.852203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.850915    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9106c2d4-ddd2-454c-9324-e21483abe021-ovnkube-config\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.852404 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.852226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-tmp\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.852404 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.852249    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9106c2d4-ddd2-454c-9324-e21483abe021-ovn-node-metrics-cert\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.852649 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.852630    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8686925f-8c79-4d6b-aa74-b565482c2f2c-etc-tuned\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.858083 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.858019    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgl8g\" (UniqueName: \"kubernetes.io/projected/8686925f-8c79-4d6b-aa74-b565482c2f2c-kube-api-access-tgl8g\") pod \"tuned-8jdnk\" (UID: \"8686925f-8c79-4d6b-aa74-b565482c2f2c\") " pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.858233 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.858155    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw82x\" (UniqueName: \"kubernetes.io/projected/abc12d08-504c-463b-9194-653d0407336b-kube-api-access-mw82x\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:21.858314 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.858236    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjpf\" (UniqueName: \"kubernetes.io/projected/9106c2d4-ddd2-454c-9324-e21483abe021-kube-api-access-fvjpf\") pod \"ovnkube-node-pfjxx\" (UID: \"9106c2d4-ddd2-454c-9324-e21483abe021\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.858526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.858467    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp2lh\" (UniqueName: \"kubernetes.io/projected/713b4e2f-d823-47c5-9569-590331d77c51-kube-api-access-kp2lh\") pod \"node-ca-kn4wt\" (UID: \"713b4e2f-d823-47c5-9569-590331d77c51\") " pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.858879 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.858850    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qd4\" (UniqueName: \"kubernetes.io/projected/54241619-c527-4fd1-9fa8-bd713aad1d9e-kube-api-access-95qd4\") pod \"multus-additional-cni-plugins-8vwfw\" (UID: \"54241619-c527-4fd1-9fa8-bd713aad1d9e\") " pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.859273 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.859254    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpw8w\" (UniqueName: \"kubernetes.io/projected/40b2e50c-f0bb-4771-806f-46de4e22fda0-kube-api-access-qpw8w\") pod \"node-resolver-r5r6h\" (UID: \"40b2e50c-f0bb-4771-806f-46de4e22fda0\") " pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:21.938345 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.938309    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wp222"
May 21 18:20:21.950286 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.950252    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pftmb"
May 21 18:20:21.958047 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.958017    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:21.963348 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.962681    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7"
May 21 18:20:21.969622 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.969595    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vwfw"
May 21 18:20:21.976962 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.976937    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kn4wt"
May 21 18:20:21.984708 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.984685    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:21.991347 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.991329    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jdnk"
May 21 18:20:21.997870 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:21.997851    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5r6h"
May 21 18:20:22.125857 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.125826    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:22.326829 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.326612    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f166a44_1f96_42a0_91db_2f9654fdc144.slice/crio-4aeceab335ea8a2d6b8c505caa37bc958a41b598074f456a26f6a9f474f8127e WatchSource:0}: Error finding container 4aeceab335ea8a2d6b8c505caa37bc958a41b598074f456a26f6a9f474f8127e: Status 404 returned error can't find the container with id 4aeceab335ea8a2d6b8c505caa37bc958a41b598074f456a26f6a9f474f8127e
May 21 18:20:22.328554 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.328529    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8686925f_8c79_4d6b_aa74_b565482c2f2c.slice/crio-62db0674b38227d961916750dbd989b658b4bcd4d4cfdfd56694d05c0dc33ee2 WatchSource:0}: Error finding container 62db0674b38227d961916750dbd989b658b4bcd4d4cfdfd56694d05c0dc33ee2: Status 404 returned error can't find the container with id 62db0674b38227d961916750dbd989b658b4bcd4d4cfdfd56694d05c0dc33ee2
May 21 18:20:22.329230 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.329114    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b2e50c_f0bb_4771_806f_46de4e22fda0.slice/crio-2db2d642d777b0698ac2cee1b8d86a0581c2637e3d42c6847273eba6eeb3c749 WatchSource:0}: Error finding container 2db2d642d777b0698ac2cee1b8d86a0581c2637e3d42c6847273eba6eeb3c749: Status 404 returned error can't find the container with id 2db2d642d777b0698ac2cee1b8d86a0581c2637e3d42c6847273eba6eeb3c749
May 21 18:20:22.331790 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.331766    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9106c2d4_ddd2_454c_9324_e21483abe021.slice/crio-c636ae8b7bb20064c1b9503aee9a67047a4ed461ac8169ff0e08394826c53919 WatchSource:0}: Error finding container c636ae8b7bb20064c1b9503aee9a67047a4ed461ac8169ff0e08394826c53919: Status 404 returned error can't find the container with id c636ae8b7bb20064c1b9503aee9a67047a4ed461ac8169ff0e08394826c53919
May 21 18:20:22.332984 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.332957    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f31e31_63a9_4cb8_b640_9761d6c3ade9.slice/crio-c36fa6c7564c29e9cc941c4475dcdfdf466df11f5e417feafc2f0f2abbff709b WatchSource:0}: Error finding container c36fa6c7564c29e9cc941c4475dcdfdf466df11f5e417feafc2f0f2abbff709b: Status 404 returned error can't find the container with id c36fa6c7564c29e9cc941c4475dcdfdf466df11f5e417feafc2f0f2abbff709b
May 21 18:20:22.334112 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.334092    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebc01e9_5712_4adb_8eb0_e876bf912c52.slice/crio-8a02b49ab22deb26d4d4bbd69c60463ed25491aa0944fec5a75d9f993e0c1761 WatchSource:0}: Error finding container 8a02b49ab22deb26d4d4bbd69c60463ed25491aa0944fec5a75d9f993e0c1761: Status 404 returned error can't find the container with id 8a02b49ab22deb26d4d4bbd69c60463ed25491aa0944fec5a75d9f993e0c1761
May 21 18:20:22.335372 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.335266    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54241619_c527_4fd1_9fa8_bd713aad1d9e.slice/crio-df39c846b155eb37ad59ef2bf8874d05fd9a47a71ed3ff3edd7f3023a1eca3bc WatchSource:0}: Error finding container df39c846b155eb37ad59ef2bf8874d05fd9a47a71ed3ff3edd7f3023a1eca3bc: Status 404 returned error can't find the container with id df39c846b155eb37ad59ef2bf8874d05fd9a47a71ed3ff3edd7f3023a1eca3bc
May 21 18:20:22.337531 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:20:22.337132    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713b4e2f_d823_47c5_9569_590331d77c51.slice/crio-d1c57fd1578bf29c1219479b1885703be0e7798fa0aa6d02643fcd412821c286 WatchSource:0}: Error finding container d1c57fd1578bf29c1219479b1885703be0e7798fa0aa6d02643fcd412821c286: Status 404 returned error can't find the container with id d1c57fd1578bf29c1219479b1885703be0e7798fa0aa6d02643fcd412821c286
May 21 18:20:22.353541 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.353517    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:22.353655 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.353573    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:22.353725 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353685    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:22.353725 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353694    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:22.353725 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353711    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:22.353725 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353722    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:22.353860 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353752    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:23.353734327 +0000 UTC m=+4.146582575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:22.353860 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:22.353767    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:23.353761 +0000 UTC m=+4.146609235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:22.670527 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.670437    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:20 +0000 UTC" deadline="2027-12-06 23:29:25.986747206 +0000 UTC"
May 21 18:20:22.670527 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.670480    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13541h9m3.316270337s"
May 21 18:20:22.768912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.768833    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kn4wt" event={"ID":"713b4e2f-d823-47c5-9569-590331d77c51","Type":"ContainerStarted","Data":"d1c57fd1578bf29c1219479b1885703be0e7798fa0aa6d02643fcd412821c286"}
May 21 18:20:22.774761 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.774672    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jdnk" event={"ID":"8686925f-8c79-4d6b-aa74-b565482c2f2c","Type":"ContainerStarted","Data":"62db0674b38227d961916750dbd989b658b4bcd4d4cfdfd56694d05c0dc33ee2"}
May 21 18:20:22.783370 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.783298    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7" event={"ID":"1f166a44-1f96-42a0-91db-2f9654fdc144","Type":"ContainerStarted","Data":"4aeceab335ea8a2d6b8c505caa37bc958a41b598074f456a26f6a9f474f8127e"}
May 21 18:20:22.798159 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.797404    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" event={"ID":"2f89645f16c3c592f4f40ac03de31cc6","Type":"ContainerStarted","Data":"14aeb535f8b99686f946a2fb54c0cbd2550d7aad3ae3109de2ba4719cbd7c9cb"}
May 21 18:20:22.812244 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.812157    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" podStartSLOduration=2.812139246 podStartE2EDuration="2.812139246s" podCreationTimestamp="2026-05-21 18:20:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:22.811957681 +0000 UTC m=+3.604805940" watchObservedRunningTime="2026-05-21 18:20:22.812139246 +0000 UTC m=+3.604987508"
May 21 18:20:22.818988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.818953    2557 generic.go:358] "Generic (PLEG): container finished" podID="7ff452d1c57a087cbd80b5b952418d6e" containerID="0fe5840575acde9324def8897421097da4e2f2e1fde1513cbb24687c31d39be8" exitCode=0
May 21 18:20:22.819611 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.819579    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"7ff452d1c57a087cbd80b5b952418d6e","Type":"ContainerDied","Data":"0fe5840575acde9324def8897421097da4e2f2e1fde1513cbb24687c31d39be8"}
May 21 18:20:22.825554 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.825521    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbglv" event={"ID":"2dd942c0-9985-4308-a628-4a8e6581bda2","Type":"ContainerStarted","Data":"368a419372d75bbbfbeda1df825c334ecf4eb4f05f772f4b5d4cb764057c8127"}
May 21 18:20:22.827258 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.827236    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerStarted","Data":"df39c846b155eb37ad59ef2bf8874d05fd9a47a71ed3ff3edd7f3023a1eca3bc"}
May 21 18:20:22.830909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.830847    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wp222" event={"ID":"debc01e9-5712-4adb-8eb0-e876bf912c52","Type":"ContainerStarted","Data":"8a02b49ab22deb26d4d4bbd69c60463ed25491aa0944fec5a75d9f993e0c1761"}
May 21 18:20:22.846095 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.846050    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pftmb" event={"ID":"d0f31e31-63a9-4cb8-b640-9761d6c3ade9","Type":"ContainerStarted","Data":"c36fa6c7564c29e9cc941c4475dcdfdf466df11f5e417feafc2f0f2abbff709b"}
May 21 18:20:22.854222 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.854190    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"c636ae8b7bb20064c1b9503aee9a67047a4ed461ac8169ff0e08394826c53919"}
May 21 18:20:22.856876 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:22.856827    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5r6h" event={"ID":"40b2e50c-f0bb-4771-806f-46de4e22fda0","Type":"ContainerStarted","Data":"2db2d642d777b0698ac2cee1b8d86a0581c2637e3d42c6847273eba6eeb3c749"}
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.361105    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.361214    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361368    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361391    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361418    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361432    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361437    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:25.361418041 +0000 UTC m=+6.154266280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:23.361852 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.361491    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:25.361475066 +0000 UTC m=+6.154323315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:23.761507 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.760959    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:23.761507 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.761088    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:23.761507 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.761147    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:23.761507 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.761279    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:23.899323 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.899291    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tvz85"]
May 21 18:20:23.902678 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.902281    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"7ff452d1c57a087cbd80b5b952418d6e","Type":"ContainerStarted","Data":"86f0abb042dd9bdec1424cf7a744e8c55a168ebe9c4631e1c6b9a290d90deb11"}
May 21 18:20:23.902678 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.902407    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:23.902678 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:23.902480    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:23.934619 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.934545    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" podStartSLOduration=3.93452499 podStartE2EDuration="3.93452499s" podCreationTimestamp="2026-05-21 18:20:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:23.920634779 +0000 UTC m=+4.713483038" watchObservedRunningTime="2026-05-21 18:20:23.93452499 +0000 UTC m=+4.727373250"
May 21 18:20:23.966294 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.966033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:23.966294 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.966107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-dbus\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:23.966294 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:23.966144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-kubelet-config\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.066675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.066741    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-dbus\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.066782    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-kubelet-config\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.066900    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-kubelet-config\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:24.067034    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:24.067098    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:24.567078744 +0000 UTC m=+5.359926997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:24.067599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.067464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-dbus\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.571622 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:24.570957    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:24.571622 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:24.571136    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:24.571622 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:24.571214    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:25.57119489 +0000 UTC m=+6.364043136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:25.380624 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.380583    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.380665    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380771    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380793    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380804    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380802    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380861    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:29.380844145 +0000 UTC m=+10.173692390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:25.381096 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.380877    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:29.380870014 +0000 UTC m=+10.173718250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:25.583359 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.582647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:25.583359 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.582855    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:25.583359 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.582919    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.582898864 +0000 UTC m=+8.375747106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:25.762574 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.762483    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:25.762749 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.762621    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:25.762749 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.762656    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:25.762749 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:25.762671    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:25.762890 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.762764    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:25.762890 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:25.762845    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:27.599697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:27.599656    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:27.600158 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:27.599810    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:27.600158 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:27.599881    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:31.599861459 +0000 UTC m=+12.392709738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:27.764476 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:27.764440    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:27.764476 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:27.764467    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:27.764685 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:27.764440    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:27.764685 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:27.764560    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:27.764685 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:27.764642    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:27.764857 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:27.764740    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:29.415433    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:29.415510    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.415680    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.415700    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.415716    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.415778    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:37.415759194 +0000 UTC m=+18.208607435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.416207    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:29.416308 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.416268    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:37.416250501 +0000 UTC m=+18.209098739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:29.764690 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:29.764599    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:29.764845 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.764723    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:29.765180 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:29.765151    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:29.765321 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.765266    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:29.765375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:29.765347    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:29.765447 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:29.765430    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:31.633000 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:31.632952    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:31.633507 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:31.633101    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:31.633507 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:31.633195    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:39.633159018 +0000 UTC m=+20.426007258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:31.764245 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:31.764209    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:31.764428 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:31.764341    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:31.764428 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:31.764209    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:31.764428 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:31.764209    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:31.764584 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:31.764453    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:31.764584 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:31.764531    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:33.764222 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:33.764189    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:33.764664 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:33.764191    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:33.764664 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:33.764186    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:33.764664 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:33.764319    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:33.764664 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:33.764417    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:33.764664 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:33.764552    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:35.761081 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:35.761038    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:35.761580 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:35.761038    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:35.761580 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:35.761215    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:35.761580 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:35.761240    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:35.761580 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:35.761043    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:35.761580 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:35.761313    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:37.480548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:37.480503    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:37.480639    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480729    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480755    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480768    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480789    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480836    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:53.480814102 +0000 UTC m=+34.273662341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:37.481036 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.480861    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:20:53.480850454 +0000 UTC m=+34.273698692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:37.760644 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:37.760556    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:37.760816 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.760678    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:37.760816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:37.760687    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:37.760816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:37.760713    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:37.760816 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.760780    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:37.760981 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:37.760854    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:39.696620 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:39.696580    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:39.697053 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:39.696771    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:39.697053 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:39.696857    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:55.6968362 +0000 UTC m=+36.489684449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:39.762147 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:39.762107    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:39.762359 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:39.762240    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:39.762686 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:39.762660    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:39.762834 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:39.762746    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:39.762896 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:39.762844    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:39.762947 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:39.762924    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:40.933797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.933564    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jdnk" event={"ID":"8686925f-8c79-4d6b-aa74-b565482c2f2c","Type":"ContainerStarted","Data":"20a035a200e6e135a75260c3f8b0fa6d9bab36c4f6c7612e0072bd64c3c0a29b"}
May 21 18:20:40.935031 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.935006    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7" event={"ID":"1f166a44-1f96-42a0-91db-2f9654fdc144","Type":"ContainerStarted","Data":"8d3506c1333e08bfd2c0b63342aced0c1e550d6d91d57a27183f36beed092a3d"}
May 21 18:20:40.936327 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.936297    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbglv" event={"ID":"2dd942c0-9985-4308-a628-4a8e6581bda2","Type":"ContainerStarted","Data":"18a50ccf57451982abb5d912a55fb9c223fce27bac8b9464f6fd82fd9f889d34"}
May 21 18:20:40.937655 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.937630    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="730e5d73c7d7f847fc12e79ce3b78029b9c0bc8e80324a533e8973d91a0e9bf1" exitCode=0
May 21 18:20:40.937752 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.937697    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"730e5d73c7d7f847fc12e79ce3b78029b9c0bc8e80324a533e8973d91a0e9bf1"}
May 21 18:20:40.939107 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.939006    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pftmb" event={"ID":"d0f31e31-63a9-4cb8-b640-9761d6c3ade9","Type":"ContainerStarted","Data":"225f3acf7d05ae87ee182483a3276250e7a51fb9f399991e700052e1f04a5a1c"}
May 21 18:20:40.940632 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.940615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:20:40.940998 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.940967    2557 generic.go:358] "Generic (PLEG): container finished" podID="9106c2d4-ddd2-454c-9324-e21483abe021" containerID="cb34df78c259a61361f97490f971e3457b19b27e854cebf304c04d8175b7eb94" exitCode=1
May 21 18:20:40.941067 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.941029    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerDied","Data":"cb34df78c259a61361f97490f971e3457b19b27e854cebf304c04d8175b7eb94"}
May 21 18:20:40.941114 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.941071    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"42e2f366864d4472b55b1ffc64927389054a96966640c732104e40174c26e95b"}
May 21 18:20:40.942834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.942606    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5r6h" event={"ID":"40b2e50c-f0bb-4771-806f-46de4e22fda0","Type":"ContainerStarted","Data":"0fe36cf72b8568fb97bcbe2de4d3433d8a9b2a65b1a5cccc5ff373e39f57b933"}
May 21 18:20:40.943991 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.943968    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kn4wt" event={"ID":"713b4e2f-d823-47c5-9569-590331d77c51","Type":"ContainerStarted","Data":"b7df6a318b27e79dfecfb04a4cc864f71d748e23274a0e8f24bdac867bb4c83b"}
May 21 18:20:40.953641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.952297    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8jdnk" podStartSLOduration=3.774972788 podStartE2EDuration="21.952276579s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.330570161 +0000 UTC m=+3.123418403" lastFinishedPulling="2026-05-21 18:20:40.507873928 +0000 UTC m=+21.300722194" observedRunningTime="2026-05-21 18:20:40.950944786 +0000 UTC m=+21.743793045" watchObservedRunningTime="2026-05-21 18:20:40.952276579 +0000 UTC m=+21.745124838"
May 21 18:20:40.970904 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.970853    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pftmb" podStartSLOduration=3.753838056 podStartE2EDuration="21.970837698s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.335471401 +0000 UTC m=+3.128319638" lastFinishedPulling="2026-05-21 18:20:40.552471037 +0000 UTC m=+21.345319280" observedRunningTime="2026-05-21 18:20:40.970712178 +0000 UTC m=+21.763560460" watchObservedRunningTime="2026-05-21 18:20:40.970837698 +0000 UTC m=+21.763685955"
May 21 18:20:40.984506 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:40.984448    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qbglv" podStartSLOduration=3.8371054239999998 podStartE2EDuration="21.984431378s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.343860125 +0000 UTC m=+3.136708363" lastFinishedPulling="2026-05-21 18:20:40.491186063 +0000 UTC m=+21.284034317" observedRunningTime="2026-05-21 18:20:40.984322621 +0000 UTC m=+21.777170880" watchObservedRunningTime="2026-05-21 18:20:40.984431378 +0000 UTC m=+21.777279637"
May 21 18:20:41.018322 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.018272    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kn4wt" podStartSLOduration=7.695209022 podStartE2EDuration="22.018256098s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.341450154 +0000 UTC m=+3.134298396" lastFinishedPulling="2026-05-21 18:20:36.664497222 +0000 UTC m=+17.457345472" observedRunningTime="2026-05-21 18:20:41.017701597 +0000 UTC m=+21.810549855" watchObservedRunningTime="2026-05-21 18:20:41.018256098 +0000 UTC m=+21.811104367"
May 21 18:20:41.032642 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.032483    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-r5r6h" podStartSLOduration=3.872493414 podStartE2EDuration="22.032466679s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.331210513 +0000 UTC m=+3.124058787" lastFinishedPulling="2026-05-21 18:20:40.49118381 +0000 UTC m=+21.284032052" observedRunningTime="2026-05-21 18:20:41.032063335 +0000 UTC m=+21.824911594" watchObservedRunningTime="2026-05-21 18:20:41.032466679 +0000 UTC m=+21.825314938"
May 21 18:20:41.760912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.760879    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:41.761209 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:41.761001    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:41.761209 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.760879    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:41.761209 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:41.761126    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:41.761209 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.760879    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:41.761209 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:41.761204    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:41.948495 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.948332    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wp222" event={"ID":"debc01e9-5712-4adb-8eb0-e876bf912c52","Type":"ContainerStarted","Data":"aa919b3babddda9e9548ed1cdf4812ec2df96711248ce4ad8f3adc0754bb0f2d"}
May 21 18:20:41.952587 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.952555    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 18:20:41.954488 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.954462    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:20:41.954894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.954850    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"be8779b78632f215aa3f54bff18077dd2194d47b2ed69c5356cc1f7788a6907b"}
May 21 18:20:41.955044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.954905    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"6c1f2b2ddddb0d35985a64747adfb011c0e132379f9bc906f7ee70e1c0224f50"}
May 21 18:20:41.955044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.954921    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"a421d711e511fb2d133cc7a983450b9035130198e08fb21197d1b8a40bb4b73c"}
May 21 18:20:41.955044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.954934    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"cea5f8daab109b2d39cd5b931475965c8ef8acbb3fa31c6ecf3fda76c904ca65"}
May 21 18:20:41.956847 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.956803    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7" event={"ID":"1f166a44-1f96-42a0-91db-2f9654fdc144","Type":"ContainerStarted","Data":"b7fef2ff95ac294fe4fb5cd641b50d4a9af3998800cce5f392dda872f5fbb56b"}
May 21 18:20:41.965786 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:41.965712    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wp222" podStartSLOduration=4.812011832 podStartE2EDuration="22.965698452s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.337498545 +0000 UTC m=+3.130346784" lastFinishedPulling="2026-05-21 18:20:40.491185164 +0000 UTC m=+21.284033404" observedRunningTime="2026-05-21 18:20:41.96535191 +0000 UTC m=+22.758200172" watchObservedRunningTime="2026-05-21 18:20:41.965698452 +0000 UTC m=+22.758546704"
May 21 18:20:42.288801 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.288594    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:42.637746 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.637706    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:42.638925 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.638888    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:42.722351 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.722236    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:20:41.952580808Z","UUID":"4f6a1ea3-dd2c-4d9a-9b63-f9eebbc534ed","Handler":null,"Name":"","Endpoint":""}
May 21 18:20:42.724218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.724189    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 18:20:42.724218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.724224    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 18:20:42.959619 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:42.959392    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qbglv"
May 21 18:20:43.760308 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.760271    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:43.760504 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.760271    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:43.760504 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:43.760414    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:43.760504 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.760271    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:43.760663 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:43.760517    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:43.760663 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:43.760588    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:43.963673 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.963643    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:20:43.964293 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.964024    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"1f0878b280149f67a7943bc30f4492743ef3f8639b4bc88de5fa577325f9d8a2"}
May 21 18:20:43.966200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.966156    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7" event={"ID":"1f166a44-1f96-42a0-91db-2f9654fdc144","Type":"ContainerStarted","Data":"a52256f792e6470ab2dacbdbb7377331da42a04518c083504f1e8eb5d2169bfa"}
May 21 18:20:43.983125 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:43.983052    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs5d7" podStartSLOduration=4.176707406 podStartE2EDuration="24.983031467s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.328495433 +0000 UTC m=+3.121343668" lastFinishedPulling="2026-05-21 18:20:43.134819478 +0000 UTC m=+23.927667729" observedRunningTime="2026-05-21 18:20:43.982788265 +0000 UTC m=+24.775636524" watchObservedRunningTime="2026-05-21 18:20:43.983031467 +0000 UTC m=+24.775879722"
May 21 18:20:45.760684 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.760409    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:45.760684 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.760409    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:45.761374 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:45.760706    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:45.761374 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.760454    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:45.761374 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:45.760759    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:45.761374 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:45.760832    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:45.971812 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.971775    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="0d3db208a39f380f0dc8e1c1d29ecaa18415b9d487c20ad32746027ccaf613e8" exitCode=0
May 21 18:20:45.972019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.971868    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"0d3db208a39f380f0dc8e1c1d29ecaa18415b9d487c20ad32746027ccaf613e8"}
May 21 18:20:45.974927 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.974908    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:20:45.975231 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.975210    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"103b41cb904f5bc2c1041c2907b243b20fa4f1dd8684391266f8653dc3f9752b"}
May 21 18:20:45.975518 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.975501    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:45.975601 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.975526    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:45.975671 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.975656    2557 scope.go:117] "RemoveContainer" containerID="cb34df78c259a61361f97490f971e3457b19b27e854cebf304c04d8175b7eb94"
May 21 18:20:45.992975 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:45.992951    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:46.978710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.978676    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="a46b1826f86ef438f829354a2bdc91d3e9ea4b97b181b8b8fe5dd29779883366" exitCode=0
May 21 18:20:46.979139 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.978772    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"a46b1826f86ef438f829354a2bdc91d3e9ea4b97b181b8b8fe5dd29779883366"}
May 21 18:20:46.981980 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.981963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:20:46.982303 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.982282    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" event={"ID":"9106c2d4-ddd2-454c-9324-e21483abe021","Type":"ContainerStarted","Data":"e4e0d770eaf32786ff434807139fc06e2b8f1cf0ebd3190b48b52a2d41568aca"}
May 21 18:20:46.982534 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.982518    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:46.997869 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:46.997841    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:20:47.040712 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.040659    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx" podStartSLOduration=9.826280995 podStartE2EDuration="28.040643756s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.333757661 +0000 UTC m=+3.126605897" lastFinishedPulling="2026-05-21 18:20:40.548120407 +0000 UTC m=+21.340968658" observedRunningTime="2026-05-21 18:20:47.038383312 +0000 UTC m=+27.831231581" watchObservedRunningTime="2026-05-21 18:20:47.040643756 +0000 UTC m=+27.833492013"
May 21 18:20:47.708785 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.708606    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2crcx"]
May 21 18:20:47.708919 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.708902    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:47.709034 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:47.709015    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:47.711235 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.711210    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj98l"]
May 21 18:20:47.711333 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.711322    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:47.711417 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:47.711400    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:47.711913 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.711886    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvz85"]
May 21 18:20:47.712042 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.711996    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:47.712097 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:47.712081    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:47.985878 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.985846    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="c474ff229348c20f3532d587150b701b678f98f583d5bff5b57890dbde2a5b76" exitCode=0
May 21 18:20:47.986271 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:47.985920    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"c474ff229348c20f3532d587150b701b678f98f583d5bff5b57890dbde2a5b76"}
May 21 18:20:49.761993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:49.761942    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:49.762559 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:49.762041    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:49.762559 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:49.762078    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:49.762559 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:49.762079    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:49.762559 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:49.762187    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:49.762559 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:49.762263    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:51.761095 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:51.761043    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:51.761654 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:51.761114    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:51.761654 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:51.761260    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:51.761654 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:51.761306    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:51.761654 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:51.761389    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:51.761654 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:51.761590    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:53.497933 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:53.497888    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:53.497975    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498073    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498108    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498121    2557 projected.go:194] Error preparing data for projected volume kube-api-access-66fp9 for pod openshift-network-diagnostics/network-check-target-xj98l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498084    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498187    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9 podName:567796a7-c77b-476b-8d3f-5ac62e64ca24 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:25.498155518 +0000 UTC m=+66.291003758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-66fp9" (UniqueName: "kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9") pod "network-check-target-xj98l" (UID: "567796a7-c77b-476b-8d3f-5ac62e64ca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:53.498599 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.498224    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:21:25.498212258 +0000 UTC m=+66.291060494 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:53.760726 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:53.760642    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:53.760893 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:53.760773    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:53.760893 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.760784    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvz85" podUID="b04bbd4b-eb0e-4acb-a58c-f12dc0420e26"
May 21 18:20:53.760997 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.760893    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj98l" podUID="567796a7-c77b-476b-8d3f-5ac62e64ca24"
May 21 18:20:53.760997 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:53.760927    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:53.761084 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:53.761018    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:20:54.547519 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.547438    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeReady"
May 21 18:20:54.548040 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.547584    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 18:20:54.580119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.580093    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:20:54.599755 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.599720    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r8dc7"]
May 21 18:20:54.599976 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.599953    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.602066 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.602045    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 18:20:54.602528 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.602485    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 18:20:54.602638 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.602581    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 18:20:54.602825 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.602809    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v98cm\""
May 21 18:20:54.610315 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.610294    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 18:20:54.624154 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.624080    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-22vmf"]
May 21 18:20:54.624456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.624439    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.626771 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.626748    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 18:20:54.626771 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.626762    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 18:20:54.626940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.626808    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\""
May 21 18:20:54.646128 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.646094    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:20:54.646128 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.646130    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8dc7"]
May 21 18:20:54.646370 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.646141    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22vmf"]
May 21 18:20:54.646370 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.646302    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:54.648689 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.648661    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 18:20:54.648890 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.648875    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 18:20:54.649103 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.649083    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\""
May 21 18:20:54.649248 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.649222    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 18:20:54.709279 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-config-volume\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.709378 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcrq5\" (UniqueName: \"kubernetes.io/projected/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-kube-api-access-dcrq5\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.709378 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709378 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709386    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.709838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.709838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-tmp-dir\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.709838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.709729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvzf\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810488    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-config-volume\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.810566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810528    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcrq5\" (UniqueName: \"kubernetes.io/projected/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-kube-api-access-dcrq5\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.810566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810552    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810809 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810669    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810809 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810723    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810809 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810768    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810809 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810796    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.810995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8pl9\" (UniqueName: \"kubernetes.io/projected/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-kube-api-access-x8pl9\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:54.810995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:54.810995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810913    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.810995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.810952    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.811203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811009    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.811203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811053    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-tmp-dir\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.811203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811089    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvzf\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.811203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811140    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.811394 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811257    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.811394 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-config-volume\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.811394 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.811306    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:20:54.811394 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.811325    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:20:54.811582 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.811383    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:54.811582 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.811401    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:20:55.311379481 +0000 UTC m=+36.104227732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:20:54.811582 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.811489    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:55.311469113 +0000 UTC m=+36.104317364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:20:54.811761 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.811743    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-tmp-dir\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.812312 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.812289    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.815351 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.815225    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.815440 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.815238    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.822665 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.822640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.822665 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.822671    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcrq5\" (UniqueName: \"kubernetes.io/projected/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-kube-api-access-dcrq5\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:54.823217 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.823198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvzf\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:54.911437 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.911398    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8pl9\" (UniqueName: \"kubernetes.io/projected/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-kube-api-access-x8pl9\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:54.911605 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.911444    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:54.911669 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.911605    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:54.911707 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:54.911671    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:20:55.411655474 +0000 UTC m=+36.204503710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:20:54.920571 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:54.920541    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8pl9\" (UniqueName: \"kubernetes.io/projected/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-kube-api-access-x8pl9\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:55.002403 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.002368    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="0fe5b4235eeb91635f8d64a6e0a97a864b49496b7797e6490b8187d25ce006dd" exitCode=0
May 21 18:20:55.002546 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.002433    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"0fe5b4235eeb91635f8d64a6e0a97a864b49496b7797e6490b8187d25ce006dd"}
May 21 18:20:55.315144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.315101    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:55.315144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.315162    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:55.315390 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.315271    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:55.315390 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.315278    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:20:55.315390 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.315298    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:20:55.315390 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.315327    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:56.315313577 +0000 UTC m=+37.108161812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:20:55.315390 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.315341    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:20:56.315335209 +0000 UTC m=+37.108183444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:20:55.415926 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.415891    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:55.416058 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.416036    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:55.416113 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.416102    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:20:56.416084542 +0000 UTC m=+37.208932790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:20:55.718973 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.718884    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:55.719366 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.719040    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:20:55.719366 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:55.719106    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret podName:b04bbd4b-eb0e-4acb-a58c-f12dc0420e26 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:27.719090306 +0000 UTC m=+68.511938542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret") pod "global-pull-secret-syncer-tvz85" (UID: "b04bbd4b-eb0e-4acb-a58c-f12dc0420e26") : object "kube-system"/"original-pull-secret" not registered
May 21 18:20:55.760178 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.760140    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:20:55.760350 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.760258    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:20:55.760463 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.760424    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:20:55.762518 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762489    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:20:55.762518 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762504    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:20:55.762756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762622    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\""
May 21 18:20:55.762756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762745    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:20:55.762825 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762787    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\""
May 21 18:20:55.762875 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:55.762853    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 18:20:56.007527 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:56.007444    2557 generic.go:358] "Generic (PLEG): container finished" podID="54241619-c527-4fd1-9fa8-bd713aad1d9e" containerID="e9292445ac39f50937502729ce4eb20a8168b7ceac00ad2c3a661a9304817672" exitCode=0
May 21 18:20:56.007527 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:56.007482    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerDied","Data":"e9292445ac39f50937502729ce4eb20a8168b7ceac00ad2c3a661a9304817672"}
May 21 18:20:56.325101 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:56.325007    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:56.325101 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:56.325069    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:56.325311 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.325155    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:20:56.325311 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.325193    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:20:56.325311 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.325201    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:56.325311 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.325269    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.325250159 +0000 UTC m=+39.118098400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:20:56.325311 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.325287    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.325279767 +0000 UTC m=+39.118128012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:20:56.426159 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:56.426127    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:56.426326 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.426273    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:56.426362 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:56.426338    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.426319545 +0000 UTC m=+39.219167780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:20:57.011736 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:57.011703    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" event={"ID":"54241619-c527-4fd1-9fa8-bd713aad1d9e","Type":"ContainerStarted","Data":"2798222db55b1c17050592c2254c6d063e63a8980409f29a1e2e5290a4e2d38c"}
May 21 18:20:57.033549 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:57.033478    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8vwfw" podStartSLOduration=5.801140405 podStartE2EDuration="38.033462796s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:22.339657917 +0000 UTC m=+3.132506160" lastFinishedPulling="2026-05-21 18:20:54.571980313 +0000 UTC m=+35.364828551" observedRunningTime="2026-05-21 18:20:57.032560263 +0000 UTC m=+37.825408521" watchObservedRunningTime="2026-05-21 18:20:57.033462796 +0000 UTC m=+37.826311053"
May 21 18:20:58.341382 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:58.341338    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:58.341399    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.341520    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.341552    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.341526    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.341621    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:21:02.341599375 +0000 UTC m=+43.134447619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:20:58.341895 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.341654    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:02.341643418 +0000 UTC m=+43.134491653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:20:58.441768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:20:58.441727    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:20:58.441926 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.441872    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:58.441968 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:20:58.441939    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:21:02.441921635 +0000 UTC m=+43.234769871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:21:02.372850 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:02.372804    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:02.372863    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.372952    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.372971    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.372974    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.373030    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:10.373015089 +0000 UTC m=+51.165863325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:21:02.373280 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.373044    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:21:10.373038282 +0000 UTC m=+51.165886518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:21:02.473797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:02.473747    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:21:02.473928 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.473879    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:02.473962 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:02.473943    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:21:10.473929578 +0000 UTC m=+51.266777814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:21:10.438673 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:10.438625    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:10.438685    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.438786    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.438811    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.438796    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.438873    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:21:26.438856257 +0000 UTC m=+67.231704493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:21:10.439144 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.438887    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:26.438880664 +0000 UTC m=+67.231728900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:21:10.539897 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:10.539863    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:21:10.540006 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.539993    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:10.540056 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:10.540047    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:21:26.540032837 +0000 UTC m=+67.332881073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:21:18.998818 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:18.998789    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfjxx"
May 21 18:21:25.547456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.547416    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:21:25.547947 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.547488    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:21:25.549997 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.549978    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:21:25.550045 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.549982    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:21:25.557970 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:25.557949    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:21:25.558034 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:25.558023    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:22:29.558000184 +0000 UTC m=+130.350848421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : secret "metrics-daemon-secret" not found
May 21 18:21:25.559914 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.559887    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:21:25.571584 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.571554    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66fp9\" (UniqueName: \"kubernetes.io/projected/567796a7-c77b-476b-8d3f-5ac62e64ca24-kube-api-access-66fp9\") pod \"network-check-target-xj98l\" (UID: \"567796a7-c77b-476b-8d3f-5ac62e64ca24\") " pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:21:25.772122 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.772092    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\""
May 21 18:21:25.780862 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.780834    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:21:25.956817 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:25.955048    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj98l"]
May 21 18:21:25.958033 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:21:25.958004    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567796a7_c77b_476b_8d3f_5ac62e64ca24.slice/crio-08dcb0e87e4f446378baf90002aff4fc611ae1263ee02d27aa68eccacb40b2c1 WatchSource:0}: Error finding container 08dcb0e87e4f446378baf90002aff4fc611ae1263ee02d27aa68eccacb40b2c1: Status 404 returned error can't find the container with id 08dcb0e87e4f446378baf90002aff4fc611ae1263ee02d27aa68eccacb40b2c1
May 21 18:21:26.069039 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:26.068999    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj98l" event={"ID":"567796a7-c77b-476b-8d3f-5ac62e64ca24","Type":"ContainerStarted","Data":"08dcb0e87e4f446378baf90002aff4fc611ae1263ee02d27aa68eccacb40b2c1"}
May 21 18:21:26.454523 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:26.454469    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:21:26.454710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:26.454545    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:21:26.454710 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.454658    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:21:26.454710 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.454683    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:21:26.454872 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.454745    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:26.454872 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.454753    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:21:58.454730869 +0000 UTC m=+99.247579120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:21:26.454872 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.454830    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:58.45481162 +0000 UTC m=+99.247659861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:21:26.555481 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:26.555442    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:21:26.555928 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.555632    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:26.555928 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:26.555725    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:21:58.555703746 +0000 UTC m=+99.348551998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:21:27.767043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:27.767000    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:21:27.769643 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:27.769617    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 18:21:27.779864 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:27.779835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b04bbd4b-eb0e-4acb-a58c-f12dc0420e26-original-pull-secret\") pod \"global-pull-secret-syncer-tvz85\" (UID: \"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26\") " pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:21:27.880978 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:27.880940    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvz85"
May 21 18:21:28.682710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:28.682677    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvz85"]
May 21 18:21:28.685771 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:21:28.685743    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04bbd4b_eb0e_4acb_a58c_f12dc0420e26.slice/crio-edabd96f75d04d16cc255df29b472845d81c7e6c6faaf1479da4a97682413eb8 WatchSource:0}: Error finding container edabd96f75d04d16cc255df29b472845d81c7e6c6faaf1479da4a97682413eb8: Status 404 returned error can't find the container with id edabd96f75d04d16cc255df29b472845d81c7e6c6faaf1479da4a97682413eb8
May 21 18:21:29.077636 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:29.077586    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj98l" event={"ID":"567796a7-c77b-476b-8d3f-5ac62e64ca24","Type":"ContainerStarted","Data":"4d2658f678c488cb268f11c0588764f3768506d45aef779829522ca9c6e1d1c5"}
May 21 18:21:29.078086 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:29.077925    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:21:29.078840 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:29.078804    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvz85" event={"ID":"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26","Type":"ContainerStarted","Data":"edabd96f75d04d16cc255df29b472845d81c7e6c6faaf1479da4a97682413eb8"}
May 21 18:21:29.093503 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:29.093438    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xj98l" podStartSLOduration=67.474418177 podStartE2EDuration="1m10.093405369s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:21:25.959823649 +0000 UTC m=+66.752671886" lastFinishedPulling="2026-05-21 18:21:28.578810824 +0000 UTC m=+69.371659078" observedRunningTime="2026-05-21 18:21:29.092711226 +0000 UTC m=+69.885559484" watchObservedRunningTime="2026-05-21 18:21:29.093405369 +0000 UTC m=+69.886253628"
May 21 18:21:33.089586 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:33.089545    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvz85" event={"ID":"b04bbd4b-eb0e-4acb-a58c-f12dc0420e26","Type":"ContainerStarted","Data":"5bbd7adcd2f4244375353da907c24eec7192452295432cf85aa5477a8ddd55b0"}
May 21 18:21:33.103911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:33.103800    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tvz85" podStartSLOduration=66.231798633 podStartE2EDuration="1m10.103784619s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:21:28.687499611 +0000 UTC m=+69.480347847" lastFinishedPulling="2026-05-21 18:21:32.559485584 +0000 UTC m=+73.352333833" observedRunningTime="2026-05-21 18:21:33.10343013 +0000 UTC m=+73.896278403" watchObservedRunningTime="2026-05-21 18:21:33.103784619 +0000 UTC m=+73.896632877"
May 21 18:21:58.489210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:58.489154    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:58.489222    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.489314    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.489344    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.489366    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6c4c479b-pmp4r: secret "image-registry-tls" not found
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.489375    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls podName:b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:02.489359835 +0000 UTC m=+163.282208070 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls") pod "dns-default-r8dc7" (UID: "b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1") : secret "dns-default-metrics-tls" not found
May 21 18:21:58.489650 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.489458    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls podName:8df6b75c-eacd-4da3-a2cf-891f791a47ed nodeName:}" failed. No retries permitted until 2026-05-21 18:23:02.489437534 +0000 UTC m=+163.282285784 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls") pod "image-registry-f6c4c479b-pmp4r" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed") : secret "image-registry-tls" not found
May 21 18:21:58.590049 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:21:58.590011    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:21:58.590189 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.590153    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:58.590243 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:21:58.590234    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert podName:d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea nodeName:}" failed. No retries permitted until 2026-05-21 18:23:02.590218407 +0000 UTC m=+163.383066648 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert") pod "ingress-canary-22vmf" (UID: "d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea") : secret "canary-serving-cert" not found
May 21 18:22:00.082889 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:00.082857    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xj98l"
May 21 18:22:29.606330 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:29.606275    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:22:29.606817 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:29.606429    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:22:29.606817 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:29.606506    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs podName:abc12d08-504c-463b-9194-653d0407336b nodeName:}" failed. No retries permitted until 2026-05-21 18:24:31.606488588 +0000 UTC m=+252.399336825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs") pod "network-metrics-daemon-2crcx" (UID: "abc12d08-504c-463b-9194-653d0407336b") : secret "metrics-daemon-secret" not found
May 21 18:22:35.481072 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.481037    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"]
May 21 18:22:35.482807 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.482790    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.484638 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.484615    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dqlrs\""
May 21 18:22:35.484762 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.484615    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 21 18:22:35.484762 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.484614    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 21 18:22:35.485264 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.485245    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 21 18:22:35.496442 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.496416    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"]
May 21 18:22:35.553942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.553905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.554127 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.553953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6sc9\" (UniqueName: \"kubernetes.io/projected/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-kube-api-access-w6sc9\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.577586 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.577547    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rxjnb"]
May 21 18:22:35.579218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.579203    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.581350 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.581320    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zr7wp\""
May 21 18:22:35.581350 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.581329    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 21 18:22:35.581561 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.581379    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 21 18:22:35.581561 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.581398    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 21 18:22:35.581689 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.581673    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 21 18:22:35.588943 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.588919    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 21 18:22:35.593709 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.593684    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rxjnb"]
May 21 18:22:35.654995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.654952    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6sc9\" (UniqueName: \"kubernetes.io/projected/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-kube-api-access-w6sc9\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.655226 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.655018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db4cf268-984e-490b-97a0-bc6f7448c45a-serving-cert\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.655226 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.655057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-trusted-ca\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.655226 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.655104    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.655226 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.655128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsvb\" (UniqueName: \"kubernetes.io/projected/db4cf268-984e-490b-97a0-bc6f7448c45a-kube-api-access-kdsvb\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.655226 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.655148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-config\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.655460 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:35.655253    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 18:22:35.655460 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:35.655318    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls podName:936f575b-ecea-47ea-a6dd-6d2724a7b5f5 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:36.155303053 +0000 UTC m=+136.948151289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls") pod "cluster-samples-operator-697587599-7cs8h" (UID: "936f575b-ecea-47ea-a6dd-6d2724a7b5f5") : secret "samples-operator-tls" not found
May 21 18:22:35.663302 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.663281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6sc9\" (UniqueName: \"kubernetes.io/projected/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-kube-api-access-w6sc9\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:35.679856 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.679827    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"]
May 21 18:22:35.681715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.681701    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.683739 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.683707    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-26t2z\""
May 21 18:22:35.683739 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.683712    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 18:22:35.683909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.683712    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 18:22:35.683909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.683833    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 18:22:35.684120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.684102    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 18:22:35.693707 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.693683    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"]
May 21 18:22:35.755964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.755882    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db4cf268-984e-490b-97a0-bc6f7448c45a-serving-cert\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.755964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.755917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb80f476-1328-48b5-bfe6-c6e9a006c122-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.755964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.755941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf9h8\" (UniqueName: \"kubernetes.io/projected/eb80f476-1328-48b5-bfe6-c6e9a006c122-kube-api-access-zf9h8\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.756281 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.756041    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-trusted-ca\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.756281 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.756127    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsvb\" (UniqueName: \"kubernetes.io/projected/db4cf268-984e-490b-97a0-bc6f7448c45a-kube-api-access-kdsvb\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.756281 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.756157    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-config\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.756281 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.756233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb80f476-1328-48b5-bfe6-c6e9a006c122-config\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.756835 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.756809    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-config\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.757024 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.757009    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db4cf268-984e-490b-97a0-bc6f7448c45a-trusted-ca\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.758227 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.758212    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db4cf268-984e-490b-97a0-bc6f7448c45a-serving-cert\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.765915 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.765892    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsvb\" (UniqueName: \"kubernetes.io/projected/db4cf268-984e-490b-97a0-bc6f7448c45a-kube-api-access-kdsvb\") pod \"console-operator-76dff48d59-rxjnb\" (UID: \"db4cf268-984e-490b-97a0-bc6f7448c45a\") " pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.856574 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.856519    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb80f476-1328-48b5-bfe6-c6e9a006c122-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.856574 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.856572    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf9h8\" (UniqueName: \"kubernetes.io/projected/eb80f476-1328-48b5-bfe6-c6e9a006c122-kube-api-access-zf9h8\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.856817 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.856791    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb80f476-1328-48b5-bfe6-c6e9a006c122-config\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.857400 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.857373    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb80f476-1328-48b5-bfe6-c6e9a006c122-config\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.858894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.858871    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb80f476-1328-48b5-bfe6-c6e9a006c122-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.867254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.867233    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf9h8\" (UniqueName: \"kubernetes.io/projected/eb80f476-1328-48b5-bfe6-c6e9a006c122-kube-api-access-zf9h8\") pod \"kube-storage-version-migrator-operator-565644f49-skv8q\" (UID: \"eb80f476-1328-48b5-bfe6-c6e9a006c122\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:35.888252 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.888228    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:35.990565 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:35.990536    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"
May 21 18:22:36.010067 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:36.009992    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rxjnb"]
May 21 18:22:36.013001 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:22:36.012973    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4cf268_984e_490b_97a0_bc6f7448c45a.slice/crio-00c88f485ed0711ecce6ecce8aa8544b26749598fb4516b8e3dad216e9194bce WatchSource:0}: Error finding container 00c88f485ed0711ecce6ecce8aa8544b26749598fb4516b8e3dad216e9194bce: Status 404 returned error can't find the container with id 00c88f485ed0711ecce6ecce8aa8544b26749598fb4516b8e3dad216e9194bce
May 21 18:22:36.111684 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:36.111651    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q"]
May 21 18:22:36.115042 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:22:36.115017    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb80f476_1328_48b5_bfe6_c6e9a006c122.slice/crio-55a7419fdc58133fb4f782c911a2eed770f77c5d633fa7379397a546cc9d1bb7 WatchSource:0}: Error finding container 55a7419fdc58133fb4f782c911a2eed770f77c5d633fa7379397a546cc9d1bb7: Status 404 returned error can't find the container with id 55a7419fdc58133fb4f782c911a2eed770f77c5d633fa7379397a546cc9d1bb7
May 21 18:22:36.159672 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:36.159640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:36.159863 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:36.159812    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 18:22:36.159927 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:36.159894    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls podName:936f575b-ecea-47ea-a6dd-6d2724a7b5f5 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:37.15986963 +0000 UTC m=+137.952717865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls") pod "cluster-samples-operator-697587599-7cs8h" (UID: "936f575b-ecea-47ea-a6dd-6d2724a7b5f5") : secret "samples-operator-tls" not found
May 21 18:22:36.204838 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:36.204794    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q" event={"ID":"eb80f476-1328-48b5-bfe6-c6e9a006c122","Type":"ContainerStarted","Data":"55a7419fdc58133fb4f782c911a2eed770f77c5d633fa7379397a546cc9d1bb7"}
May 21 18:22:36.205792 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:36.205754    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" event={"ID":"db4cf268-984e-490b-97a0-bc6f7448c45a","Type":"ContainerStarted","Data":"00c88f485ed0711ecce6ecce8aa8544b26749598fb4516b8e3dad216e9194bce"}
May 21 18:22:37.168444 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:37.168397    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:37.168928 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:37.168539    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 18:22:37.168928 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:37.168602    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls podName:936f575b-ecea-47ea-a6dd-6d2724a7b5f5 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:39.168585626 +0000 UTC m=+139.961433861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls") pod "cluster-samples-operator-697587599-7cs8h" (UID: "936f575b-ecea-47ea-a6dd-6d2724a7b5f5") : secret "samples-operator-tls" not found
May 21 18:22:39.186456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.186416    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:39.186963 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:39.186562    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 18:22:39.186963 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:39.186629    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls podName:936f575b-ecea-47ea-a6dd-6d2724a7b5f5 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:43.186612728 +0000 UTC m=+143.979460964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls") pod "cluster-samples-operator-697587599-7cs8h" (UID: "936f575b-ecea-47ea-a6dd-6d2724a7b5f5") : secret "samples-operator-tls" not found
May 21 18:22:39.213313 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.213285    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/0.log"
May 21 18:22:39.213476 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.213322    2557 generic.go:358] "Generic (PLEG): container finished" podID="db4cf268-984e-490b-97a0-bc6f7448c45a" containerID="5e0b6231a51b478bd758ae5ac32e8f47424b7dceb8a93a7744b44fa89e72ad73" exitCode=255
May 21 18:22:39.213476 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.213387    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" event={"ID":"db4cf268-984e-490b-97a0-bc6f7448c45a","Type":"ContainerDied","Data":"5e0b6231a51b478bd758ae5ac32e8f47424b7dceb8a93a7744b44fa89e72ad73"}
May 21 18:22:39.213715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.213693    2557 scope.go:117] "RemoveContainer" containerID="5e0b6231a51b478bd758ae5ac32e8f47424b7dceb8a93a7744b44fa89e72ad73"
May 21 18:22:39.214741 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.214721    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q" event={"ID":"eb80f476-1328-48b5-bfe6-c6e9a006c122","Type":"ContainerStarted","Data":"e8164cb8ac4977bd2a9860ce06ad1cdc274d1d36b2fde96c6393e123234e83fc"}
May 21 18:22:39.241384 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:39.241340    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q" podStartSLOduration=1.75798093 podStartE2EDuration="4.241325419s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:22:36.116724776 +0000 UTC m=+136.909573013" lastFinishedPulling="2026-05-21 18:22:38.600069266 +0000 UTC m=+139.392917502" observedRunningTime="2026-05-21 18:22:39.240947976 +0000 UTC m=+140.033796234" watchObservedRunningTime="2026-05-21 18:22:39.241325419 +0000 UTC m=+140.034173711"
May 21 18:22:40.218727 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.218699    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/1.log"
May 21 18:22:40.219129 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.219069    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/0.log"
May 21 18:22:40.219129 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.219105    2557 generic.go:358] "Generic (PLEG): container finished" podID="db4cf268-984e-490b-97a0-bc6f7448c45a" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1" exitCode=255
May 21 18:22:40.219248 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.219204    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" event={"ID":"db4cf268-984e-490b-97a0-bc6f7448c45a","Type":"ContainerDied","Data":"941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"}
May 21 18:22:40.219302 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.219254    2557 scope.go:117] "RemoveContainer" containerID="5e0b6231a51b478bd758ae5ac32e8f47424b7dceb8a93a7744b44fa89e72ad73"
May 21 18:22:40.219458 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.219435    2557 scope.go:117] "RemoveContainer" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"
May 21 18:22:40.219659 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:40.219640    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:22:40.705822 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.705789    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"]
May 21 18:22:40.708092 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.708076    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"
May 21 18:22:40.710012 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.709991    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bvq7g\""
May 21 18:22:40.715587 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.715565    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"]
May 21 18:22:40.801280 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.801241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsxz7\" (UniqueName: \"kubernetes.io/projected/449a5df2-d254-40b7-a1cf-3bca6fc33d35-kube-api-access-qsxz7\") pod \"network-check-source-7f44b6dd87-wd2ff\" (UID: \"449a5df2-d254-40b7-a1cf-3bca6fc33d35\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"
May 21 18:22:40.901971 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.901927    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsxz7\" (UniqueName: \"kubernetes.io/projected/449a5df2-d254-40b7-a1cf-3bca6fc33d35-kube-api-access-qsxz7\") pod \"network-check-source-7f44b6dd87-wd2ff\" (UID: \"449a5df2-d254-40b7-a1cf-3bca6fc33d35\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"
May 21 18:22:40.910638 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:40.910612    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsxz7\" (UniqueName: \"kubernetes.io/projected/449a5df2-d254-40b7-a1cf-3bca6fc33d35-kube-api-access-qsxz7\") pod \"network-check-source-7f44b6dd87-wd2ff\" (UID: \"449a5df2-d254-40b7-a1cf-3bca6fc33d35\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"
May 21 18:22:41.016867 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.016778    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"
May 21 18:22:41.140288 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.140255    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff"]
May 21 18:22:41.143403 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:22:41.143375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449a5df2_d254_40b7_a1cf_3bca6fc33d35.slice/crio-6768d6b6ff50de79a6b714af5e4ebb72b7f57952ca9f5028481c2395c8354e17 WatchSource:0}: Error finding container 6768d6b6ff50de79a6b714af5e4ebb72b7f57952ca9f5028481c2395c8354e17: Status 404 returned error can't find the container with id 6768d6b6ff50de79a6b714af5e4ebb72b7f57952ca9f5028481c2395c8354e17
May 21 18:22:41.223476 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.223450    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/1.log"
May 21 18:22:41.224058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.223835    2557 scope.go:117] "RemoveContainer" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"
May 21 18:22:41.224058 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:41.224028    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:22:41.224956 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.224931    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff" event={"ID":"449a5df2-d254-40b7-a1cf-3bca6fc33d35","Type":"ContainerStarted","Data":"0a109f3d407ee9ac67af966b25837529cb6d16146baa8de5d1a53b3d24890190"}
May 21 18:22:41.225059 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.224961    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff" event={"ID":"449a5df2-d254-40b7-a1cf-3bca6fc33d35","Type":"ContainerStarted","Data":"6768d6b6ff50de79a6b714af5e4ebb72b7f57952ca9f5028481c2395c8354e17"}
May 21 18:22:41.254361 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.254307    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-wd2ff" podStartSLOduration=1.254292489 podStartE2EDuration="1.254292489s" podCreationTimestamp="2026-05-21 18:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:22:41.253954583 +0000 UTC m=+142.046802841" watchObservedRunningTime="2026-05-21 18:22:41.254292489 +0000 UTC m=+142.047140746"
May 21 18:22:41.666622 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:41.666594    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5r6h_40b2e50c-f0bb-4771-806f-46de4e22fda0/dns-node-resolver/0.log"
May 21 18:22:42.663288 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:42.663259    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kn4wt_713b4e2f-d823-47c5-9569-590331d77c51/node-ca/0.log"
May 21 18:22:43.221972 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:43.221936    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:43.222138 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:43.222074    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 18:22:43.222138 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:43.222136    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls podName:936f575b-ecea-47ea-a6dd-6d2724a7b5f5 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:51.22211894 +0000 UTC m=+152.014967175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls") pod "cluster-samples-operator-697587599-7cs8h" (UID: "936f575b-ecea-47ea-a6dd-6d2724a7b5f5") : secret "samples-operator-tls" not found
May 21 18:22:44.900687 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.900653    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wfpcp"]
May 21 18:22:44.902818 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.902802    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:44.905013 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.904986    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 18:22:44.905146 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.904986    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-57qds\""
May 21 18:22:44.905517 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.905500    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 18:22:44.905618 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.905568    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 18:22:44.905669 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.905617    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 18:22:44.915754 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:44.915733    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wfpcp"]
May 21 18:22:45.037405 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.037364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-cabundle\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.037405 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.037413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7jp\" (UniqueName: \"kubernetes.io/projected/34a8c01b-05ab-4186-be9b-9b9c75f788a9-kube-api-access-ft7jp\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.037664 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.037484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-key\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.138328 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.138274    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-cabundle\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.138491 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.138343    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7jp\" (UniqueName: \"kubernetes.io/projected/34a8c01b-05ab-4186-be9b-9b9c75f788a9-kube-api-access-ft7jp\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.138491 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.138390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-key\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.138920 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.138898    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-cabundle\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.140697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.140675    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34a8c01b-05ab-4186-be9b-9b9c75f788a9-signing-key\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.146213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.146192    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7jp\" (UniqueName: \"kubernetes.io/projected/34a8c01b-05ab-4186-be9b-9b9c75f788a9-kube-api-access-ft7jp\") pod \"service-ca-67d667c7d-wfpcp\" (UID: \"34a8c01b-05ab-4186-be9b-9b9c75f788a9\") " pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.212273 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.212148    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-wfpcp"
May 21 18:22:45.332700 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.332673    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wfpcp"]
May 21 18:22:45.337946 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:22:45.337919    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a8c01b_05ab_4186_be9b_9b9c75f788a9.slice/crio-8c20987a9542e3c9237d74caa868c21ed65d2aad8c405fbee2990df66d260c28 WatchSource:0}: Error finding container 8c20987a9542e3c9237d74caa868c21ed65d2aad8c405fbee2990df66d260c28: Status 404 returned error can't find the container with id 8c20987a9542e3c9237d74caa868c21ed65d2aad8c405fbee2990df66d260c28
May 21 18:22:45.889419 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.889387    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:45.889419 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.889427    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:22:45.889892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:45.889877    2557 scope.go:117] "RemoveContainer" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"
May 21 18:22:45.890101 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:45.890077    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:22:46.241022 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:46.240859    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-wfpcp" event={"ID":"34a8c01b-05ab-4186-be9b-9b9c75f788a9","Type":"ContainerStarted","Data":"8c20987a9542e3c9237d74caa868c21ed65d2aad8c405fbee2990df66d260c28"}
May 21 18:22:48.247417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:48.247380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-wfpcp" event={"ID":"34a8c01b-05ab-4186-be9b-9b9c75f788a9","Type":"ContainerStarted","Data":"ede6adce00f0f446425449e73118d7966815acd0039e5f9d90ed052350c535ce"}
May 21 18:22:48.265492 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:48.265442    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-wfpcp" podStartSLOduration=2.23385655 podStartE2EDuration="4.265427333s" podCreationTimestamp="2026-05-21 18:22:44 +0000 UTC" firstStartedPulling="2026-05-21 18:22:45.339904115 +0000 UTC m=+146.132752367" lastFinishedPulling="2026-05-21 18:22:47.371474911 +0000 UTC m=+148.164323150" observedRunningTime="2026-05-21 18:22:48.263432271 +0000 UTC m=+149.056280528" watchObservedRunningTime="2026-05-21 18:22:48.265427333 +0000 UTC m=+149.058275614"
May 21 18:22:51.292375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:51.292331    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:51.294988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:51.294961    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/936f575b-ecea-47ea-a6dd-6d2724a7b5f5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7cs8h\" (UID: \"936f575b-ecea-47ea-a6dd-6d2724a7b5f5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:51.390983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:51.390943    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"
May 21 18:22:51.520914 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:51.520877    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h"]
May 21 18:22:52.259739 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:52.259698    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h" event={"ID":"936f575b-ecea-47ea-a6dd-6d2724a7b5f5","Type":"ContainerStarted","Data":"241f8cb7cf8ca5e9967c4a8b7eb9fead186e9c662ae5427074eea0e9e6f2d3ca"}
May 21 18:22:54.266641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:54.266604    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h" event={"ID":"936f575b-ecea-47ea-a6dd-6d2724a7b5f5","Type":"ContainerStarted","Data":"ccc5c73032b1a5bb4ad243d9b7a5a297082016f5837579c69983ffe74e7061c7"}
May 21 18:22:54.266641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:54.266640    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h" event={"ID":"936f575b-ecea-47ea-a6dd-6d2724a7b5f5","Type":"ContainerStarted","Data":"281891e676263a7027be0abbc5c86a36de9de74900d6309f34ac2fa2eaf44caa"}
May 21 18:22:54.283063 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:54.283012    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7cs8h" podStartSLOduration=17.429124516999998 podStartE2EDuration="19.282996833s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:22:51.56390109 +0000 UTC m=+152.356749330" lastFinishedPulling="2026-05-21 18:22:53.417773407 +0000 UTC m=+154.210621646" observedRunningTime="2026-05-21 18:22:54.282248854 +0000 UTC m=+155.075097109" watchObservedRunningTime="2026-05-21 18:22:54.282996833 +0000 UTC m=+155.075845089"
May 21 18:22:57.611473 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:57.611424    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed"
May 21 18:22:57.637244 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:57.637205    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r8dc7" podUID="b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1"
May 21 18:22:57.668181 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:57.668123    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-22vmf" podUID="d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea"
May 21 18:22:58.278636 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:58.278606    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:22:58.278829 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:58.278793    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8dc7"
May 21 18:22:58.775841 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:22:58.775792    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2crcx" podUID="abc12d08-504c-463b-9194-653d0407336b"
May 21 18:22:59.761727 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:22:59.761697    2557 scope.go:117] "RemoveContainer" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"
May 21 18:23:00.283860 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.283833    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:23:00.284251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.284200    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/1.log"
May 21 18:23:00.284251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.284228    2557 generic.go:358] "Generic (PLEG): container finished" podID="db4cf268-984e-490b-97a0-bc6f7448c45a" containerID="e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d" exitCode=255
May 21 18:23:00.284343 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.284279    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" event={"ID":"db4cf268-984e-490b-97a0-bc6f7448c45a","Type":"ContainerDied","Data":"e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d"}
May 21 18:23:00.284343 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.284310    2557 scope.go:117] "RemoveContainer" containerID="941af87d7937abd48597a7534ed862352ee63638765b9f113206e3c49e8a85c1"
May 21 18:23:00.284664 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:00.284645    2557 scope.go:117] "RemoveContainer" containerID="e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d"
May 21 18:23:00.284863 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:00.284847    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:23:01.288030 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:01.288004    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:23:02.581380 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.581329    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:23:02.581785 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.581405    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:02.583740 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.583709    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1-metrics-tls\") pod \"dns-default-r8dc7\" (UID: \"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1\") " pod="openshift-dns/dns-default-r8dc7"
May 21 18:23:02.583858 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.583842    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"image-registry-f6c4c479b-pmp4r\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") " pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:02.682075 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.682033    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:23:02.684328 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.684310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea-cert\") pod \"ingress-canary-22vmf\" (UID: \"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea\") " pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:23:02.782522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.782493    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v98cm\""
May 21 18:23:02.782522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.782494    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\""
May 21 18:23:02.790160 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.790140    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:02.790307 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.790247    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8dc7"
May 21 18:23:02.924183 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.924132    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:23:02.926993 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:02.926966    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df6b75c_eacd_4da3_a2cf_891f791a47ed.slice/crio-b7fc1d8ba8e8c0de753f2619b8bde76f40136cdc71c8ef0873a76c645ea33d4b WatchSource:0}: Error finding container b7fc1d8ba8e8c0de753f2619b8bde76f40136cdc71c8ef0873a76c645ea33d4b: Status 404 returned error can't find the container with id b7fc1d8ba8e8c0de753f2619b8bde76f40136cdc71c8ef0873a76c645ea33d4b
May 21 18:23:02.936004 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:02.935982    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8dc7"]
May 21 18:23:02.939779 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:02.939753    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50e19e7_b6c7_44a6_ad1e_4e88be6b92c1.slice/crio-efc0eea251950cdd550c151272ff9426126e9cad3624b6d1f50da13b4e8d35c3 WatchSource:0}: Error finding container efc0eea251950cdd550c151272ff9426126e9cad3624b6d1f50da13b4e8d35c3: Status 404 returned error can't find the container with id efc0eea251950cdd550c151272ff9426126e9cad3624b6d1f50da13b4e8d35c3
May 21 18:23:03.295335 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:03.295303    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" event={"ID":"8df6b75c-eacd-4da3-a2cf-891f791a47ed","Type":"ContainerStarted","Data":"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"}
May 21 18:23:03.295335 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:03.295342    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" event={"ID":"8df6b75c-eacd-4da3-a2cf-891f791a47ed","Type":"ContainerStarted","Data":"b7fc1d8ba8e8c0de753f2619b8bde76f40136cdc71c8ef0873a76c645ea33d4b"}
May 21 18:23:03.295589 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:03.295451    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:03.296521 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:03.296496    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8dc7" event={"ID":"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1","Type":"ContainerStarted","Data":"efc0eea251950cdd550c151272ff9426126e9cad3624b6d1f50da13b4e8d35c3"}
May 21 18:23:03.317372 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:03.317320    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" podStartSLOduration=156.31730327 podStartE2EDuration="2m36.31730327s" podCreationTimestamp="2026-05-21 18:20:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:03.31584369 +0000 UTC m=+164.108691947" watchObservedRunningTime="2026-05-21 18:23:03.31730327 +0000 UTC m=+164.110151591"
May 21 18:23:04.300251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:04.300203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8dc7" event={"ID":"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1","Type":"ContainerStarted","Data":"e738af58fb5b517de4c51266239a1c6a92b5206a7183986a69500860df399712"}
May 21 18:23:04.300251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:04.300254    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8dc7" event={"ID":"b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1","Type":"ContainerStarted","Data":"78e7eef25561a19b351f79b831a90c6743fd2bf397db372d60b9601f73fd3e7a"}
May 21 18:23:04.300724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:04.300326    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r8dc7"
May 21 18:23:04.318779 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:04.318730    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-r8dc7" podStartSLOduration=129.162875387 podStartE2EDuration="2m10.318716179s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:23:02.941961304 +0000 UTC m=+163.734809540" lastFinishedPulling="2026-05-21 18:23:04.09780208 +0000 UTC m=+164.890650332" observedRunningTime="2026-05-21 18:23:04.317728753 +0000 UTC m=+165.110577010" watchObservedRunningTime="2026-05-21 18:23:04.318716179 +0000 UTC m=+165.111564437"
May 21 18:23:05.888613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:05.888517    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:23:05.888613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:05.888574    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:23:05.889205 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:05.889004    2557 scope.go:117] "RemoveContainer" containerID="e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d"
May 21 18:23:05.889288 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:05.889263    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:23:08.292337 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.292302    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:23:08.380001 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.379969    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mntgl"]
May 21 18:23:08.384709 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.384691    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.386780 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.386761    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 18:23:08.386933 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.386918    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-khvvx\""
May 21 18:23:08.387416 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.387400    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 18:23:08.387512 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.387496    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 18:23:08.387673 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.387655    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 18:23:08.395114 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.395093    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mntgl"]
May 21 18:23:08.422742 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.422707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-crio-socket\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.422944 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.422754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.422944 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.422815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxzg\" (UniqueName: \"kubernetes.io/projected/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-api-access-trxzg\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.422944 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.422848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.422944 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.422909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-data-volume\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.448410 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.448375    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b667c559b-48nm7"]
May 21 18:23:08.451288 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.451267    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.466232 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.466200    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b667c559b-48nm7"]
May 21 18:23:08.523427 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.523427 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-registry-tls\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523468    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trxzg\" (UniqueName: \"kubernetes.io/projected/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-api-access-trxzg\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523489    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-image-registry-private-configuration\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-installation-pull-secrets\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-registry-certificates\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523673    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-data-volume\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c10f166f-0bd0-4970-873b-f15831abf664-ca-trust-extracted\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523760    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-crio-socket\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523797    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-trusted-ca\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-bound-sa-token\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8v5\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-kube-api-access-xb8v5\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.523964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523902    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-crio-socket\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.524252 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.523966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-data-volume\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.524252 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.524123    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.525906 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.525883    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.532822 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.532800    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxzg\" (UniqueName: \"kubernetes.io/projected/6d5cb3af-ba41-475c-b5bb-d9ba273f18c7-kube-api-access-trxzg\") pod \"insights-runtime-extractor-mntgl\" (UID: \"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7\") " pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.624473 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624436    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c10f166f-0bd0-4970-873b-f15831abf664-ca-trust-extracted\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624693 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624483    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-trusted-ca\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624693 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624499    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-bound-sa-token\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624693 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624514    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8v5\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-kube-api-access-xb8v5\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624693 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624644    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-registry-tls\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624727    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-image-registry-private-configuration\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624755    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-installation-pull-secrets\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-registry-certificates\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.624910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.624835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c10f166f-0bd0-4970-873b-f15831abf664-ca-trust-extracted\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.625608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.625569    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-registry-certificates\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.625743 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.625653    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c10f166f-0bd0-4970-873b-f15831abf664-trusted-ca\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.627097 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.627072    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-installation-pull-secrets\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.627237 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.627126    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c10f166f-0bd0-4970-873b-f15831abf664-image-registry-private-configuration\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.627326 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.627301    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-registry-tls\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.635487 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.635459    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8v5\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-kube-api-access-xb8v5\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.635586 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.635498    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c10f166f-0bd0-4970-873b-f15831abf664-bound-sa-token\") pod \"image-registry-5b667c559b-48nm7\" (UID: \"c10f166f-0bd0-4970-873b-f15831abf664\") " pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.693347 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.693315    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mntgl"
May 21 18:23:08.760000 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.759898    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:08.819773 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.819711    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mntgl"]
May 21 18:23:08.822831 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:08.822790    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5cb3af_ba41_475c_b5bb_d9ba273f18c7.slice/crio-9bba7c8950cb75d5f3c2deaec1ded4e95527bef9f28b549dd189df71a5aedaec WatchSource:0}: Error finding container 9bba7c8950cb75d5f3c2deaec1ded4e95527bef9f28b549dd189df71a5aedaec: Status 404 returned error can't find the container with id 9bba7c8950cb75d5f3c2deaec1ded4e95527bef9f28b549dd189df71a5aedaec
May 21 18:23:08.890555 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:08.890522    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b667c559b-48nm7"]
May 21 18:23:08.893615 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:08.893567    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10f166f_0bd0_4970_873b_f15831abf664.slice/crio-b2f9671e1d0b81043527f1ffa07de38765c87bc48601c69b05266c88e1d7c29c WatchSource:0}: Error finding container b2f9671e1d0b81043527f1ffa07de38765c87bc48601c69b05266c88e1d7c29c: Status 404 returned error can't find the container with id b2f9671e1d0b81043527f1ffa07de38765c87bc48601c69b05266c88e1d7c29c
May 21 18:23:09.317062 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.316964    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b667c559b-48nm7" event={"ID":"c10f166f-0bd0-4970-873b-f15831abf664","Type":"ContainerStarted","Data":"556ee23b9f5e1656548b300e67391fd17e9aa1cf3868134e68ec10c93fa0b4f8"}
May 21 18:23:09.317062 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.317006    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b667c559b-48nm7" event={"ID":"c10f166f-0bd0-4970-873b-f15831abf664","Type":"ContainerStarted","Data":"b2f9671e1d0b81043527f1ffa07de38765c87bc48601c69b05266c88e1d7c29c"}
May 21 18:23:09.317498 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.317156    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:09.318304 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.318283    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mntgl" event={"ID":"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7","Type":"ContainerStarted","Data":"256dd2af54d203fac069dfe2b2593a1254dbd8b13055a3a8e8f2f93c74d40ae3"}
May 21 18:23:09.318397 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.318309    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mntgl" event={"ID":"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7","Type":"ContainerStarted","Data":"9bba7c8950cb75d5f3c2deaec1ded4e95527bef9f28b549dd189df71a5aedaec"}
May 21 18:23:09.335892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.335852    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b667c559b-48nm7" podStartSLOduration=1.335839857 podStartE2EDuration="1.335839857s" podCreationTimestamp="2026-05-21 18:23:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:09.335566769 +0000 UTC m=+170.128415054" watchObservedRunningTime="2026-05-21 18:23:09.335839857 +0000 UTC m=+170.128688113"
May 21 18:23:09.762098 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.762072    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:23:09.764245 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.764223    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\""
May 21 18:23:09.772676 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.772658    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22vmf"
May 21 18:23:09.889928 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:09.889845    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22vmf"]
May 21 18:23:09.892646 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:09.892612    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3bd2d2b_02c4_4a27_a1cc_7e45e2f783ea.slice/crio-6fa850611aebc71668d08624ee2428bd4b1d4bc851feda99c2b4d0ea2fe1e44c WatchSource:0}: Error finding container 6fa850611aebc71668d08624ee2428bd4b1d4bc851feda99c2b4d0ea2fe1e44c: Status 404 returned error can't find the container with id 6fa850611aebc71668d08624ee2428bd4b1d4bc851feda99c2b4d0ea2fe1e44c
May 21 18:23:10.321933 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:10.321830    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22vmf" event={"ID":"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea","Type":"ContainerStarted","Data":"6fa850611aebc71668d08624ee2428bd4b1d4bc851feda99c2b4d0ea2fe1e44c"}
May 21 18:23:10.323344 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:10.323319    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mntgl" event={"ID":"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7","Type":"ContainerStarted","Data":"bd6fb979249bf3a6570aeaf65d9d24b93edd63bdc9cf85ed77e88f8efc3702ad"}
May 21 18:23:12.330341 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:12.330298    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22vmf" event={"ID":"d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea","Type":"ContainerStarted","Data":"9f799a48d81fade8b49f50f01a8cfee87ff96a20d228444bf107559f5adf5988"}
May 21 18:23:12.332011 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:12.331986    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mntgl" event={"ID":"6d5cb3af-ba41-475c-b5bb-d9ba273f18c7","Type":"ContainerStarted","Data":"ce03b7b0876cc47795cdaf1836ada1fa20c6b20e117060f62c88b73646a9fcf8"}
May 21 18:23:12.345326 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:12.345269    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-22vmf" podStartSLOduration=136.469269632 podStartE2EDuration="2m18.345251239s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:23:09.894709369 +0000 UTC m=+170.687557618" lastFinishedPulling="2026-05-21 18:23:11.770690983 +0000 UTC m=+172.563539225" observedRunningTime="2026-05-21 18:23:12.344497443 +0000 UTC m=+173.137345722" watchObservedRunningTime="2026-05-21 18:23:12.345251239 +0000 UTC m=+173.138099497"
May 21 18:23:12.361333 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:12.361275    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mntgl" podStartSLOduration=1.488596837 podStartE2EDuration="4.361253825s" podCreationTimestamp="2026-05-21 18:23:08 +0000 UTC" firstStartedPulling="2026-05-21 18:23:08.892524433 +0000 UTC m=+169.685372668" lastFinishedPulling="2026-05-21 18:23:11.765181404 +0000 UTC m=+172.558029656" observedRunningTime="2026-05-21 18:23:12.359634657 +0000 UTC m=+173.152482906" watchObservedRunningTime="2026-05-21 18:23:12.361253825 +0000 UTC m=+173.154102082"
May 21 18:23:12.760413 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:12.760375    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:23:14.307694 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:14.307667    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r8dc7"
May 21 18:23:17.491974 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.491934    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"]
May 21 18:23:17.494970 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.494951    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.497215 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497195    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 18:23:17.497594 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497573    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 18:23:17.497662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497580    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 18:23:17.497894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497880    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 18:23:17.498003 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497984    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gqssg\""
May 21 18:23:17.498067 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.497997    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 18:23:17.504626 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.504600    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"]
May 21 18:23:17.598153 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.598117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.598320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.598187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fc62b5-c778-45c4-b41a-dd8f51ebf103-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.598320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.598219    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69pp\" (UniqueName: \"kubernetes.io/projected/46fc62b5-c778-45c4-b41a-dd8f51ebf103-kube-api-access-c69pp\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.598320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.598314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.699207 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.699140    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fc62b5-c778-45c4-b41a-dd8f51ebf103-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.699478 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.699454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c69pp\" (UniqueName: \"kubernetes.io/projected/46fc62b5-c778-45c4-b41a-dd8f51ebf103-kube-api-access-c69pp\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.699692 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.699673    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.699824 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.699811    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.700060 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:17.700042    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 21 18:23:17.700237 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:17.700225    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls podName:46fc62b5-c778-45c4-b41a-dd8f51ebf103 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:18.200193476 +0000 UTC m=+178.993041729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-4j7px" (UID: "46fc62b5-c778-45c4-b41a-dd8f51ebf103") : secret "prometheus-operator-tls" not found
May 21 18:23:17.701371 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.701345    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fc62b5-c778-45c4-b41a-dd8f51ebf103-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.704490 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.704457    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:17.712253 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:17.712228    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69pp\" (UniqueName: \"kubernetes.io/projected/46fc62b5-c778-45c4-b41a-dd8f51ebf103-kube-api-access-c69pp\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:18.203490 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.203450    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:18.205855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.205828    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46fc62b5-c778-45c4-b41a-dd8f51ebf103-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4j7px\" (UID: \"46fc62b5-c778-45c4-b41a-dd8f51ebf103\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:18.297997 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.297966    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:18.405918 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.405880    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"
May 21 18:23:18.532578 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.532548    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4j7px"]
May 21 18:23:18.532947 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:18.532922    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fc62b5_c778_45c4_b41a_dd8f51ebf103.slice/crio-bbf969d8ace43741cbf85c3adc3dd3369e3f843f40ea9fc95f7eb6175c5708c5 WatchSource:0}: Error finding container bbf969d8ace43741cbf85c3adc3dd3369e3f843f40ea9fc95f7eb6175c5708c5: Status 404 returned error can't find the container with id bbf969d8ace43741cbf85c3adc3dd3369e3f843f40ea9fc95f7eb6175c5708c5
May 21 18:23:18.760559 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:18.760467    2557 scope.go:117] "RemoveContainer" containerID="e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d"
May 21 18:23:18.760736 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:18.760715    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rxjnb_openshift-console-operator(db4cf268-984e-490b-97a0-bc6f7448c45a)\"" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podUID="db4cf268-984e-490b-97a0-bc6f7448c45a"
May 21 18:23:19.351519 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:19.351485    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px" event={"ID":"46fc62b5-c778-45c4-b41a-dd8f51ebf103","Type":"ContainerStarted","Data":"bbf969d8ace43741cbf85c3adc3dd3369e3f843f40ea9fc95f7eb6175c5708c5"}
May 21 18:23:20.356724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:20.356671    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px" event={"ID":"46fc62b5-c778-45c4-b41a-dd8f51ebf103","Type":"ContainerStarted","Data":"be2a02d96407c0f34a62ee83dab70bee0fc0417c2e45d135753256aa89c57b83"}
May 21 18:23:20.357135 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:20.356731    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px" event={"ID":"46fc62b5-c778-45c4-b41a-dd8f51ebf103","Type":"ContainerStarted","Data":"e9ca6dc692fc1ef9db595b2104d2e42f4b55e3d7771fc5a0ea0abfe5dbd8943d"}
May 21 18:23:20.377133 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:20.377072    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4j7px" podStartSLOduration=1.87809516 podStartE2EDuration="3.377056577s" podCreationTimestamp="2026-05-21 18:23:17 +0000 UTC" firstStartedPulling="2026-05-21 18:23:18.534822456 +0000 UTC m=+179.327670696" lastFinishedPulling="2026-05-21 18:23:20.033783872 +0000 UTC m=+180.826632113" observedRunningTime="2026-05-21 18:23:20.375710967 +0000 UTC m=+181.168559225" watchObservedRunningTime="2026-05-21 18:23:20.377056577 +0000 UTC m=+181.169904835"
May 21 18:23:22.034797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.034756    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"]
May 21 18:23:22.037321 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.037300    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.039564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.039542    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 18:23:22.039735 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.039553    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 18:23:22.040103 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.040086    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fw7sl\""
May 21 18:23:22.040360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.040331    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 18:23:22.047581 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.047563    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k2f5z"]
May 21 18:23:22.049891 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.049872    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.051709 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.051690    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 18:23:22.051998 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.051977    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"]
May 21 18:23:22.052102 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.052022    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 18:23:22.052300 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.052271    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8h69f\""
May 21 18:23:22.052390 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.052317    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 18:23:22.135120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-wtmp\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135314 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-sys\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135314 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.135314 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135314 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135302    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.135544 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-root\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135544 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-metrics-client-ca\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135544 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.135544 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135544 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.135768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-textfile\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgzv\" (UniqueName: \"kubernetes.io/projected/63276d39-db6b-4b7a-a821-8838de70f320-kube-api-access-wsgzv\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.135768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x246r\" (UniqueName: \"kubernetes.io/projected/4bc54888-5c6b-45f7-b960-961344d37982-kube-api-access-x246r\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.135768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.135676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63276d39-db6b-4b7a-a821-8838de70f320-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.236595 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236551    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-root\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236609    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-metrics-client-ca\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236672    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236677    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-root\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236704    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.236800 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236782    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-textfile\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.236936    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgzv\" (UniqueName: \"kubernetes.io/projected/63276d39-db6b-4b7a-a821-8838de70f320-kube-api-access-wsgzv\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237246    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-textfile\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237298    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x246r\" (UniqueName: \"kubernetes.io/projected/4bc54888-5c6b-45f7-b960-961344d37982-kube-api-access-x246r\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237489    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-metrics-client-ca\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237494    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237522    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63276d39-db6b-4b7a-a821-8838de70f320-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237606    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-wtmp\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:22.237611    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:22.237665    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls podName:4bc54888-5c6b-45f7-b960-961344d37982 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:22.737645658 +0000 UTC m=+183.530493900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls") pod "node-exporter-k2f5z" (UID: "4bc54888-5c6b-45f7-b960-961344d37982") : secret "node-exporter-tls" not found
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237680    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-sys\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237705    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237742    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237766    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-wtmp\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237774    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237888    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63276d39-db6b-4b7a-a821-8838de70f320-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.237995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.237955    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc54888-5c6b-45f7-b960-961344d37982-sys\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.238764 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.238421    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63276d39-db6b-4b7a-a821-8838de70f320-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.239264 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.239223    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.240690 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.240663    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.240817 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.240750    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.240963 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.240941    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63276d39-db6b-4b7a-a821-8838de70f320-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.251949 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.251914    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgzv\" (UniqueName: \"kubernetes.io/projected/63276d39-db6b-4b7a-a821-8838de70f320-kube-api-access-wsgzv\") pod \"kube-state-metrics-54fd6bc5c4-s96qk\" (UID: \"63276d39-db6b-4b7a-a821-8838de70f320\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.252141 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.252121    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x246r\" (UniqueName: \"kubernetes.io/projected/4bc54888-5c6b-45f7-b960-961344d37982-kube-api-access-x246r\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.348985 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.348956    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"
May 21 18:23:22.497910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.497724    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk"]
May 21 18:23:22.500558 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:22.500523    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63276d39_db6b_4b7a_a821_8838de70f320.slice/crio-9c36abc5279c3d99bc3f70da558648d176e0e81e2d921082e745e035d6992c7b WatchSource:0}: Error finding container 9c36abc5279c3d99bc3f70da558648d176e0e81e2d921082e745e035d6992c7b: Status 404 returned error can't find the container with id 9c36abc5279c3d99bc3f70da558648d176e0e81e2d921082e745e035d6992c7b
May 21 18:23:22.742350 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.742264    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.744495 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.744465    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc54888-5c6b-45f7-b960-961344d37982-node-exporter-tls\") pod \"node-exporter-k2f5z\" (UID: \"4bc54888-5c6b-45f7-b960-961344d37982\") " pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.962090 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:22.962049    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2f5z"
May 21 18:23:22.970221 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:22.970190    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc54888_5c6b_45f7_b960_961344d37982.slice/crio-13e37e47a6f98afa955a57abd3a6f0c2c6dc43c3c8c41d2a12aa49f77914827a WatchSource:0}: Error finding container 13e37e47a6f98afa955a57abd3a6f0c2c6dc43c3c8c41d2a12aa49f77914827a: Status 404 returned error can't find the container with id 13e37e47a6f98afa955a57abd3a6f0c2c6dc43c3c8c41d2a12aa49f77914827a
May 21 18:23:23.368532 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:23.368485    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2f5z" event={"ID":"4bc54888-5c6b-45f7-b960-961344d37982","Type":"ContainerStarted","Data":"13e37e47a6f98afa955a57abd3a6f0c2c6dc43c3c8c41d2a12aa49f77914827a"}
May 21 18:23:23.369675 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:23.369650    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk" event={"ID":"63276d39-db6b-4b7a-a821-8838de70f320","Type":"ContainerStarted","Data":"9c36abc5279c3d99bc3f70da558648d176e0e81e2d921082e745e035d6992c7b"}
May 21 18:23:24.376151 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:24.376106    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2f5z" event={"ID":"4bc54888-5c6b-45f7-b960-961344d37982","Type":"ContainerStarted","Data":"794d0bb5665554ee2c1602d41b85d855554e467534861501ae5eb4c977e81bb3"}
May 21 18:23:24.378830 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:24.378715    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk" event={"ID":"63276d39-db6b-4b7a-a821-8838de70f320","Type":"ContainerStarted","Data":"b5dd08e05f1376f6704b9ebf29f293a7f09c4394cfc535034cd28ce726ca8f16"}
May 21 18:23:24.378830 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:24.378760    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk" event={"ID":"63276d39-db6b-4b7a-a821-8838de70f320","Type":"ContainerStarted","Data":"c98ec5efb4dec8e9b07d20c5003cf9736bacdc4cd5ad265c7eea19b6dcf2a53b"}
May 21 18:23:25.383148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:25.383105    2557 generic.go:358] "Generic (PLEG): container finished" podID="4bc54888-5c6b-45f7-b960-961344d37982" containerID="794d0bb5665554ee2c1602d41b85d855554e467534861501ae5eb4c977e81bb3" exitCode=0
May 21 18:23:25.383610 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:25.383198    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2f5z" event={"ID":"4bc54888-5c6b-45f7-b960-961344d37982","Type":"ContainerDied","Data":"794d0bb5665554ee2c1602d41b85d855554e467534861501ae5eb4c977e81bb3"}
May 21 18:23:25.385193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:25.385149    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk" event={"ID":"63276d39-db6b-4b7a-a821-8838de70f320","Type":"ContainerStarted","Data":"180aa179705955e6777277c2c561129a73a939509d4f931480004602407714c5"}
May 21 18:23:25.425114 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:25.425058    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s96qk" podStartSLOduration=1.7528527760000001 podStartE2EDuration="3.42504144s" podCreationTimestamp="2026-05-21 18:23:22 +0000 UTC" firstStartedPulling="2026-05-21 18:23:22.502626879 +0000 UTC m=+183.295475115" lastFinishedPulling="2026-05-21 18:23:24.174815539 +0000 UTC m=+184.967663779" observedRunningTime="2026-05-21 18:23:25.423914215 +0000 UTC m=+186.216762475" watchObservedRunningTime="2026-05-21 18:23:25.42504144 +0000 UTC m=+186.217889697"
May 21 18:23:26.389658 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:26.389620    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2f5z" event={"ID":"4bc54888-5c6b-45f7-b960-961344d37982","Type":"ContainerStarted","Data":"6bd86798458595d4fa71cc6df7a198c328481a801804bab0ae4b3e7078f9a8d1"}
May 21 18:23:26.390047 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:26.389666    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2f5z" event={"ID":"4bc54888-5c6b-45f7-b960-961344d37982","Type":"ContainerStarted","Data":"2da44bcf3869a3ef072bb295e02489083f63b01a0b2fadcc4fe7d108cd5ddbe2"}
May 21 18:23:26.408973 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:26.408922    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k2f5z" podStartSLOduration=3.203559429 podStartE2EDuration="4.408906249s" podCreationTimestamp="2026-05-21 18:23:22 +0000 UTC" firstStartedPulling="2026-05-21 18:23:22.971887433 +0000 UTC m=+183.764735673" lastFinishedPulling="2026-05-21 18:23:24.177234257 +0000 UTC m=+184.970082493" observedRunningTime="2026-05-21 18:23:26.407634899 +0000 UTC m=+187.200483161" watchObservedRunningTime="2026-05-21 18:23:26.408906249 +0000 UTC m=+187.201754507"
May 21 18:23:29.762808 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:29.762776    2557 scope.go:117] "RemoveContainer" containerID="e17fcb87b0e6617d3ee0bc1517e738e5fab722b61ee7ccdc2da6f0d6aeb1dd8d"
May 21 18:23:30.327436 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.327410    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b667c559b-48nm7"
May 21 18:23:30.403496 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.403469    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:23:30.403682 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.403540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" event={"ID":"db4cf268-984e-490b-97a0-bc6f7448c45a","Type":"ContainerStarted","Data":"d85954589d67e6d28e7ae6315d64b78cf3792dceea5e11fb6a8b0bff6319d003"}
May 21 18:23:30.403810 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.403790    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:23:30.420358 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.420308    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb" podStartSLOduration=52.833081124 podStartE2EDuration="55.420293215s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:22:36.014863786 +0000 UTC m=+136.807712022" lastFinishedPulling="2026-05-21 18:22:38.602075865 +0000 UTC m=+139.394924113" observedRunningTime="2026-05-21 18:23:30.419136947 +0000 UTC m=+191.211985196" watchObservedRunningTime="2026-05-21 18:23:30.420293215 +0000 UTC m=+191.213141472"
May 21 18:23:30.677466 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.677422    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-rxjnb"
May 21 18:23:30.886559 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.886524    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-622jn"]
May 21 18:23:30.889686 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.889665    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:30.892180 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.892153    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 18:23:30.892714 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.892699    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 18:23:30.892795 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.892746    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bdh7h\""
May 21 18:23:30.899423 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:30.899400    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-622jn"]
May 21 18:23:31.014051 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.013952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5g9\" (UniqueName: \"kubernetes.io/projected/5e386e7f-3ca9-429a-9029-b186ca977520-kube-api-access-7k5g9\") pod \"downloads-57bd96b888-622jn\" (UID: \"5e386e7f-3ca9-429a-9029-b186ca977520\") " pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:31.114546 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.114508    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5g9\" (UniqueName: \"kubernetes.io/projected/5e386e7f-3ca9-429a-9029-b186ca977520-kube-api-access-7k5g9\") pod \"downloads-57bd96b888-622jn\" (UID: \"5e386e7f-3ca9-429a-9029-b186ca977520\") " pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:31.125649 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.125618    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5g9\" (UniqueName: \"kubernetes.io/projected/5e386e7f-3ca9-429a-9029-b186ca977520-kube-api-access-7k5g9\") pod \"downloads-57bd96b888-622jn\" (UID: \"5e386e7f-3ca9-429a-9029-b186ca977520\") " pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:31.199610 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.199572    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:31.345658 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.345624    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-622jn"]
May 21 18:23:31.348487 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:31.348448    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e386e7f_3ca9_429a_9029_b186ca977520.slice/crio-4f168e20a4cb61e517a176fb3111daafb9ff54c044783dfcba7004c94ab099c7 WatchSource:0}: Error finding container 4f168e20a4cb61e517a176fb3111daafb9ff54c044783dfcba7004c94ab099c7: Status 404 returned error can't find the container with id 4f168e20a4cb61e517a176fb3111daafb9ff54c044783dfcba7004c94ab099c7
May 21 18:23:31.411521 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:31.411486    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-622jn" event={"ID":"5e386e7f-3ca9-429a-9029-b186ca977520","Type":"ContainerStarted","Data":"4f168e20a4cb61e517a176fb3111daafb9ff54c044783dfcba7004c94ab099c7"}
May 21 18:23:33.310725 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.310504    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" containerName="registry" containerID="cri-o://1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb" gracePeriod=30
May 21 18:23:33.578667 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.578640    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:33.741628 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741598    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.741803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741654    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.741803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741686    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.741803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741717    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlvzf\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.741803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741746    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.741803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741780    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.742038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741818    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.742038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.741878    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token\") pod \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\" (UID: \"8df6b75c-eacd-4da3-a2cf-891f791a47ed\") "
May 21 18:23:33.742450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.742392    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:23:33.742450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.742414    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:23:33.745268 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.745211    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:23:33.745453 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.745268    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:23:33.745453 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.745338    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:23:33.745706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.745684    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:23:33.745764 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.745733    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf" (OuterVolumeSpecName: "kube-api-access-dlvzf") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "kube-api-access-dlvzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:23:33.752757 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.752721    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8df6b75c-eacd-4da3-a2cf-891f791a47ed" (UID: "8df6b75c-eacd-4da3-a2cf-891f791a47ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:23:33.843074 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.842986    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-image-registry-private-configuration\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843074 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843026    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlvzf\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-kube-api-access-dlvzf\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843074 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843042    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-tls\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843074 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843056    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-trusted-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843074 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843070    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8df6b75c-eacd-4da3-a2cf-891f791a47ed-registry-certificates\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843475 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843089    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8df6b75c-eacd-4da3-a2cf-891f791a47ed-bound-sa-token\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843475 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843105    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8df6b75c-eacd-4da3-a2cf-891f791a47ed-ca-trust-extracted\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:33.843475 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:33.843118    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8df6b75c-eacd-4da3-a2cf-891f791a47ed-installation-pull-secrets\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:23:34.425386 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.425345    2557 generic.go:358] "Generic (PLEG): container finished" podID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" containerID="1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb" exitCode=0
May 21 18:23:34.425834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.425417    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" event={"ID":"8df6b75c-eacd-4da3-a2cf-891f791a47ed","Type":"ContainerDied","Data":"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"}
May 21 18:23:34.425834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.425426    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r"
May 21 18:23:34.425834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.425451    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6c4c479b-pmp4r" event={"ID":"8df6b75c-eacd-4da3-a2cf-891f791a47ed","Type":"ContainerDied","Data":"b7fc1d8ba8e8c0de753f2619b8bde76f40136cdc71c8ef0873a76c645ea33d4b"}
May 21 18:23:34.425834 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.425468    2557 scope.go:117] "RemoveContainer" containerID="1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"
May 21 18:23:34.434637 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.434605    2557 scope.go:117] "RemoveContainer" containerID="1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"
May 21 18:23:34.435046 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:23:34.435015    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb\": container with ID starting with 1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb not found: ID does not exist" containerID="1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"
May 21 18:23:34.435136 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.435056    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb"} err="failed to get container status \"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb\": rpc error: code = NotFound desc = could not find container \"1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb\": container with ID starting with 1cd3f6da4d795775ce47a6355fdcf159cab8d98efbe3256a265199bb4e4f88eb not found: ID does not exist"
May 21 18:23:34.443316 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.443288    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:23:34.446583 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:34.446560    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f6c4c479b-pmp4r"]
May 21 18:23:35.765339 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:35.765308    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" path="/var/lib/kubelet/pods/8df6b75c-eacd-4da3-a2cf-891f791a47ed/volumes"
May 21 18:23:40.820906 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.820872    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:23:40.821361 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.821147    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" containerName="registry"
May 21 18:23:40.821361 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.821158    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" containerName="registry"
May 21 18:23:40.821361 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.821225    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8df6b75c-eacd-4da3-a2cf-891f791a47ed" containerName="registry"
May 21 18:23:40.824262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.824244    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:40.826251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.826226    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 18:23:40.827002 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.826976    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 18:23:40.827119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.827063    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 18:23:40.827119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.827108    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 18:23:40.827387 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.827371    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vvnjl\""
May 21 18:23:40.827704 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.827684    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 18:23:40.834518 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:40.834491    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:23:41.013194 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.013375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.013375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.013375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.013375 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.013526 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.013443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztll\" (UniqueName: \"kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114609 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114573    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114609 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114616    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114870 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114870 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114659    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114870 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114691    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.114870 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.114720    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztll\" (UniqueName: \"kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.115558 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.115528    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.115669 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.115646    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.115950 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.115922    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.117422 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.117394    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.117551 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.117532    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.124095 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.124055    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztll\" (UniqueName: \"kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll\") pod \"console-6d9c5fd84-t8x7k\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") " pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:41.135068 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:41.135041    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:23:47.689443 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:47.689413    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:23:47.691840 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:47.691817    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53fcf43_bd4c_4d0d_84a8_66e47b6035ad.slice/crio-6e38416acf0c00865706cb0ad794de68cf673a17b5cb51abe37c79a6d752a489 WatchSource:0}: Error finding container 6e38416acf0c00865706cb0ad794de68cf673a17b5cb51abe37c79a6d752a489: Status 404 returned error can't find the container with id 6e38416acf0c00865706cb0ad794de68cf673a17b5cb51abe37c79a6d752a489
May 21 18:23:48.471060 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:48.471010    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-622jn" event={"ID":"5e386e7f-3ca9-429a-9029-b186ca977520","Type":"ContainerStarted","Data":"40468d06efeabccdf495feb9d1b5e50b563468522d9e07ff129053a6daaab6e0"}
May 21 18:23:48.471433 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:48.471375    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:48.473599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:48.473540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c5fd84-t8x7k" event={"ID":"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad","Type":"ContainerStarted","Data":"6e38416acf0c00865706cb0ad794de68cf673a17b5cb51abe37c79a6d752a489"}
May 21 18:23:48.490449 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:48.490390    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-622jn" podStartSLOduration=2.2086392950000002 podStartE2EDuration="18.490374391s" podCreationTimestamp="2026-05-21 18:23:30 +0000 UTC" firstStartedPulling="2026-05-21 18:23:31.350391946 +0000 UTC m=+192.143240185" lastFinishedPulling="2026-05-21 18:23:47.632127043 +0000 UTC m=+208.424975281" observedRunningTime="2026-05-21 18:23:48.489736468 +0000 UTC m=+209.282584738" watchObservedRunningTime="2026-05-21 18:23:48.490374391 +0000 UTC m=+209.283222649"
May 21 18:23:48.492360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:48.492330    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-622jn"
May 21 18:23:49.791430 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.790098    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:23:49.823300 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.823257    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:23:49.823581 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.823416    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.832417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.832262    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xk8x\" (UniqueName: \"kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.897855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.897736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998623    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xk8x\" (UniqueName: \"kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998666    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998722    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998745    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998788    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998827    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.998905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.998850    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.999661 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.999610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.999778 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.999664    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.999778 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.999753    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:49.999910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:49.999856    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:50.002492 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:50.002442    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:50.005125 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:50.005103    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:50.007776 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:50.007731    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xk8x\" (UniqueName: \"kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x\") pod \"console-65f78b6b46-kmxgf\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") " pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:50.138451 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:50.138339    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:23:51.429919 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:51.429877    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:23:51.595453 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:23:51.595375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe21ef64_6e2b_465a_bb1b_e9ba5a1962f0.slice/crio-c8098c455b04b78bb6f00151e5d5dd497888cceea274332a768e58bd1d72747b WatchSource:0}: Error finding container c8098c455b04b78bb6f00151e5d5dd497888cceea274332a768e58bd1d72747b: Status 404 returned error can't find the container with id c8098c455b04b78bb6f00151e5d5dd497888cceea274332a768e58bd1d72747b
May 21 18:23:52.493239 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:52.493153    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c5fd84-t8x7k" event={"ID":"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad","Type":"ContainerStarted","Data":"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"}
May 21 18:23:52.494830 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:52.494804    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f78b6b46-kmxgf" event={"ID":"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0","Type":"ContainerStarted","Data":"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"}
May 21 18:23:52.494953 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:52.494835    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f78b6b46-kmxgf" event={"ID":"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0","Type":"ContainerStarted","Data":"c8098c455b04b78bb6f00151e5d5dd497888cceea274332a768e58bd1d72747b"}
May 21 18:23:52.511698 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:52.511473    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d9c5fd84-t8x7k" podStartSLOduration=8.585354433 podStartE2EDuration="12.511455176s" podCreationTimestamp="2026-05-21 18:23:40 +0000 UTC" firstStartedPulling="2026-05-21 18:23:47.694137772 +0000 UTC m=+208.486986008" lastFinishedPulling="2026-05-21 18:23:51.620238513 +0000 UTC m=+212.413086751" observedRunningTime="2026-05-21 18:23:52.510752225 +0000 UTC m=+213.303600504" watchObservedRunningTime="2026-05-21 18:23:52.511455176 +0000 UTC m=+213.304303439"
May 21 18:23:52.530823 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:52.530762    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65f78b6b46-kmxgf" podStartSLOduration=3.530745808 podStartE2EDuration="3.530745808s" podCreationTimestamp="2026-05-21 18:23:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:52.529147495 +0000 UTC m=+213.321995975" watchObservedRunningTime="2026-05-21 18:23:52.530745808 +0000 UTC m=+213.323594069"
May 21 18:23:54.501940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:54.501854    2557 generic.go:358] "Generic (PLEG): container finished" podID="eb80f476-1328-48b5-bfe6-c6e9a006c122" containerID="e8164cb8ac4977bd2a9860ce06ad1cdc274d1d36b2fde96c6393e123234e83fc" exitCode=0
May 21 18:23:54.502372 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:54.501931    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q" event={"ID":"eb80f476-1328-48b5-bfe6-c6e9a006c122","Type":"ContainerDied","Data":"e8164cb8ac4977bd2a9860ce06ad1cdc274d1d36b2fde96c6393e123234e83fc"}
May 21 18:23:54.502372 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:54.502322    2557 scope.go:117] "RemoveContainer" containerID="e8164cb8ac4977bd2a9860ce06ad1cdc274d1d36b2fde96c6393e123234e83fc"
May 21 18:23:55.507450 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:23:55.507414    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-skv8q" event={"ID":"eb80f476-1328-48b5-bfe6-c6e9a006c122","Type":"ContainerStarted","Data":"1031e32ea37147ed327b53b2ec3b2110fe0c18919c8c7677dc2236f21a1b9462"}
May 21 18:24:00.138931 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:00.138893    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:24:00.138931 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:00.138940    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:24:00.143613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:00.143585    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:24:00.526952 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:00.526870    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:24:00.628219 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:00.628184    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:24:01.135587 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:01.135549    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:24:25.647560 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:25.647523    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d9c5fd84-t8x7k" podUID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" containerName="console" containerID="cri-o://1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85" gracePeriod=15
May 21 18:24:25.938371 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:25.938346    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d9c5fd84-t8x7k_d53fcf43-bd4c-4d0d-84a8-66e47b6035ad/console/0.log"
May 21 18:24:25.938534 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:25.938410    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:24:26.008706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008661    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.008901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008717    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.008901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008745    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ztll\" (UniqueName: \"kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.008901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008822    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.008901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008856    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.008901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.008888    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert\") pod \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\" (UID: \"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad\") "
May 21 18:24:26.009183 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.009079    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config" (OuterVolumeSpecName: "console-config") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:26.009278 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.009248    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:26.009399 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.009352    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:26.011327 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.011304    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:26.011417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.011316    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:26.011417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.011380    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll" (OuterVolumeSpecName: "kube-api-access-8ztll") pod "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" (UID: "d53fcf43-bd4c-4d0d-84a8-66e47b6035ad"). InnerVolumeSpecName "kube-api-access-8ztll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:26.109512 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109479    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.109512 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109509    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.109512 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109519    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.109756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109528    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.109756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109538    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.109756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.109548    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ztll\" (UniqueName: \"kubernetes.io/projected/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad-kube-api-access-8ztll\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:24:26.598869 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598843    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d9c5fd84-t8x7k_d53fcf43-bd4c-4d0d-84a8-66e47b6035ad/console/0.log"
May 21 18:24:26.599065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598887    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" containerID="1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85" exitCode=2
May 21 18:24:26.599065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598931    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c5fd84-t8x7k" event={"ID":"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad","Type":"ContainerDied","Data":"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"}
May 21 18:24:26.599065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598948    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c5fd84-t8x7k"
May 21 18:24:26.599065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598966    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c5fd84-t8x7k" event={"ID":"d53fcf43-bd4c-4d0d-84a8-66e47b6035ad","Type":"ContainerDied","Data":"6e38416acf0c00865706cb0ad794de68cf673a17b5cb51abe37c79a6d752a489"}
May 21 18:24:26.599065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.598986    2557 scope.go:117] "RemoveContainer" containerID="1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"
May 21 18:24:26.608058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.608028    2557 scope.go:117] "RemoveContainer" containerID="1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"
May 21 18:24:26.608402 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:24:26.608382    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85\": container with ID starting with 1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85 not found: ID does not exist" containerID="1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"
May 21 18:24:26.608474 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.608413    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85"} err="failed to get container status \"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85\": rpc error: code = NotFound desc = could not find container \"1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85\": container with ID starting with 1c2e43db5fc68162e84702945afd04ee07b60789261f9ac301c0290dfa58cb85 not found: ID does not exist"
May 21 18:24:26.623576 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.623546    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:24:26.627237 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:26.627208    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d9c5fd84-t8x7k"]
May 21 18:24:27.764555 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:27.764523    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" path="/var/lib/kubelet/pods/d53fcf43-bd4c-4d0d-84a8-66e47b6035ad/volumes"
May 21 18:24:31.654693 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:31.654654    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:24:31.656981 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:31.656959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc12d08-504c-463b-9194-653d0407336b-metrics-certs\") pod \"network-metrics-daemon-2crcx\" (UID: \"abc12d08-504c-463b-9194-653d0407336b\") " pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:24:31.663365 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:31.663344    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\""
May 21 18:24:31.671233 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:31.671212    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2crcx"
May 21 18:24:31.821679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:31.821642    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2crcx"]
May 21 18:24:31.825410 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:24:31.825381    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc12d08_504c_463b_9194_653d0407336b.slice/crio-8777ea00f82ed344f883be44170ac026991395f902c71ec487c39861f4c5d12f WatchSource:0}: Error finding container 8777ea00f82ed344f883be44170ac026991395f902c71ec487c39861f4c5d12f: Status 404 returned error can't find the container with id 8777ea00f82ed344f883be44170ac026991395f902c71ec487c39861f4c5d12f
May 21 18:24:32.622630 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:32.622572    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2crcx" event={"ID":"abc12d08-504c-463b-9194-653d0407336b","Type":"ContainerStarted","Data":"8777ea00f82ed344f883be44170ac026991395f902c71ec487c39861f4c5d12f"}
May 21 18:24:33.626687 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:33.626647    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2crcx" event={"ID":"abc12d08-504c-463b-9194-653d0407336b","Type":"ContainerStarted","Data":"7683ffa987489674c4829c67672dd3ac95ac9d641d66f7c6c42ab4f7270ed877"}
May 21 18:24:33.627069 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:33.626694    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2crcx" event={"ID":"abc12d08-504c-463b-9194-653d0407336b","Type":"ContainerStarted","Data":"26b1a0d1f07237b92861cc03b294007bfef17dd7f85c2a2046d20de90163a2c2"}
May 21 18:24:33.654773 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:33.654720    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2crcx" podStartSLOduration=253.696139745 podStartE2EDuration="4m14.654706086s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:24:31.826850195 +0000 UTC m=+252.619698431" lastFinishedPulling="2026-05-21 18:24:32.785416537 +0000 UTC m=+253.578264772" observedRunningTime="2026-05-21 18:24:33.654224565 +0000 UTC m=+254.447072824" watchObservedRunningTime="2026-05-21 18:24:33.654706086 +0000 UTC m=+254.447554344"
May 21 18:24:43.371191 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.371078    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:24:43.371590 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.371428    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" containerName="console"
May 21 18:24:43.371590 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.371442    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" containerName="console"
May 21 18:24:43.371590 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.371501    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53fcf43-bd4c-4d0d-84a8-66e47b6035ad" containerName="console"
May 21 18:24:43.373765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.373738    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.390901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.390867    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:24:43.445982 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.445950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446204 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446204 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446204 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzjvh\" (UniqueName: \"kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.446360 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.446290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547463    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547738 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547608    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547738 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547659    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547738 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547694    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547738 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547712    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547920 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547740    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzjvh\" (UniqueName: \"kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.547920 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.547787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.548357 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.548330    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.548499 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.548393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.548499 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.548479    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.548623 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.548600    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.550663 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.550642    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.550753 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.550731    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.558698 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.558670    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzjvh\" (UniqueName: \"kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh\") pod \"console-75ff655f9b-s28ff\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") " pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.683902 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.683814    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:43.819924 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:43.819884    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:24:43.823161 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:24:43.823129    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d19131_9ddc_4ec0_83db_79b5adad4276.slice/crio-cc107baf6d0057a16b83a0171398d7c61d52e93c64d0b67acab68d67e48f6a89 WatchSource:0}: Error finding container cc107baf6d0057a16b83a0171398d7c61d52e93c64d0b67acab68d67e48f6a89: Status 404 returned error can't find the container with id cc107baf6d0057a16b83a0171398d7c61d52e93c64d0b67acab68d67e48f6a89
May 21 18:24:44.661135 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:44.661099    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff655f9b-s28ff" event={"ID":"a6d19131-9ddc-4ec0-83db-79b5adad4276","Type":"ContainerStarted","Data":"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"}
May 21 18:24:44.661135 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:44.661136    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff655f9b-s28ff" event={"ID":"a6d19131-9ddc-4ec0-83db-79b5adad4276","Type":"ContainerStarted","Data":"cc107baf6d0057a16b83a0171398d7c61d52e93c64d0b67acab68d67e48f6a89"}
May 21 18:24:44.699836 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:44.699778    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75ff655f9b-s28ff" podStartSLOduration=1.6997638990000001 podStartE2EDuration="1.699763899s" podCreationTimestamp="2026-05-21 18:24:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:24:44.698284781 +0000 UTC m=+265.491133058" watchObservedRunningTime="2026-05-21 18:24:44.699763899 +0000 UTC m=+265.492612157"
May 21 18:24:53.684148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:53.684104    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:53.684148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:53.684151    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:53.689016 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:53.688992    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:54.693144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:54.693112    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:24:54.784641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:24:54.784611    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:25:19.653917 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.653888    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:25:19.655401 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.655374    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:25:19.659687 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.659664    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:25:19.660799 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.660775    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:25:19.663482 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.663465    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 21 18:25:19.803326 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:19.803183    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65f78b6b46-kmxgf" podUID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" containerName="console" containerID="cri-o://065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f" gracePeriod=15
May 21 18:25:20.045448 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.045426    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65f78b6b46-kmxgf_fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0/console/0.log"
May 21 18:25:20.045586 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.045484    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:25:20.159319 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159284    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159335    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159364    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159379    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159505    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159744 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159590    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159744 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159637    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xk8x\" (UniqueName: \"kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x\") pod \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\" (UID: \"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0\") "
May 21 18:25:20.159844 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159798    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config" (OuterVolumeSpecName: "console-config") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:25:20.159844 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159816    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:25:20.159936 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159770    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:25:20.159988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159941    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.159988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159969    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.159988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.159942    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:25:20.161776 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.161753    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x" (OuterVolumeSpecName: "kube-api-access-8xk8x") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "kube-api-access-8xk8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:25:20.162025 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.162001    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:25:20.162025 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.162021    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" (UID: "fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:25:20.260608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.260517    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.260608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.260551    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xk8x\" (UniqueName: \"kubernetes.io/projected/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-kube-api-access-8xk8x\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.260608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.260564    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.260608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.260573    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.260608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.260582    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:25:20.759519 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759487    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65f78b6b46-kmxgf_fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0/console/0.log"
May 21 18:25:20.759911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759529    2557 generic.go:358] "Generic (PLEG): container finished" podID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" containerID="065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f" exitCode=2
May 21 18:25:20.759911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759562    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f78b6b46-kmxgf" event={"ID":"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0","Type":"ContainerDied","Data":"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"}
May 21 18:25:20.759911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759614    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f78b6b46-kmxgf" event={"ID":"fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0","Type":"ContainerDied","Data":"c8098c455b04b78bb6f00151e5d5dd497888cceea274332a768e58bd1d72747b"}
May 21 18:25:20.759911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759635    2557 scope.go:117] "RemoveContainer" containerID="065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"
May 21 18:25:20.759911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.759635    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f78b6b46-kmxgf"
May 21 18:25:20.767564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.767541    2557 scope.go:117] "RemoveContainer" containerID="065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"
May 21 18:25:20.767833 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:25:20.767808    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f\": container with ID starting with 065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f not found: ID does not exist" containerID="065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"
May 21 18:25:20.767894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.767843    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f"} err="failed to get container status \"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f\": rpc error: code = NotFound desc = could not find container \"065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f\": container with ID starting with 065fa1bbb1b5925c9fdeb3414a0a2f31b4d1ee0561ddefdf11f96cde7004380f not found: ID does not exist"
May 21 18:25:20.789045 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.789015    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:25:20.790033 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:20.790002    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f78b6b46-kmxgf"]
May 21 18:25:21.764552 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:25:21.764523    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" path="/var/lib/kubelet/pods/fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0/volumes"
May 21 18:26:05.925861 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.925764    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"]
May 21 18:26:05.926307 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.926059    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" containerName="console"
May 21 18:26:05.926307 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.926070    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" containerName="console"
May 21 18:26:05.926307 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.926114    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe21ef64-6e2b-465a-bb1b-e9ba5a1962f0" containerName="console"
May 21 18:26:05.927911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.927894    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:05.930246 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.930226    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:26:05.930825 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.930807    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:26:05.930918 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.930814    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:26:05.939867 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:05.939840    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"]
May 21 18:26:06.018869 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.018831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.019043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.018874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.019043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.018963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfqn\" (UniqueName: \"kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.120295 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.120254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfqn\" (UniqueName: \"kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.120424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.120303    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.120424 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.120325    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.120665 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.120647    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.120702 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.120685    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.128909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.128872    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfqn\" (UniqueName: \"kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.236465 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.236374    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:06.362011 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.361981    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"]
May 21 18:26:06.366574 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:06.366538    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5edf38c_933b_4ad3_80e4_67c0592c19bd.slice/crio-ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48 WatchSource:0}: Error finding container ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48: Status 404 returned error can't find the container with id ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48
May 21 18:26:06.368362 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.368345    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:26:06.889539 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:06.889503    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss" event={"ID":"d5edf38c-933b-4ad3-80e4-67c0592c19bd","Type":"ContainerStarted","Data":"ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48"}
May 21 18:26:11.905290 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:11.905200    2557 generic.go:358] "Generic (PLEG): container finished" podID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerID="09ca31190d2428872f0c2e86d95108fc8571c9e3d81f42be7f888b49b54c1775" exitCode=0
May 21 18:26:11.905666 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:11.905295    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss" event={"ID":"d5edf38c-933b-4ad3-80e4-67c0592c19bd","Type":"ContainerDied","Data":"09ca31190d2428872f0c2e86d95108fc8571c9e3d81f42be7f888b49b54c1775"}
May 21 18:26:19.929553 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:19.929460    2557 generic.go:358] "Generic (PLEG): container finished" podID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerID="ed7ec51a438d068e124d48b6c832cbd2676d466306f08d7b2bc53c80dd2bf54e" exitCode=0
May 21 18:26:19.929553 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:19.929512    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss" event={"ID":"d5edf38c-933b-4ad3-80e4-67c0592c19bd","Type":"ContainerDied","Data":"ed7ec51a438d068e124d48b6c832cbd2676d466306f08d7b2bc53c80dd2bf54e"}
May 21 18:26:25.949459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:25.949363    2557 generic.go:358] "Generic (PLEG): container finished" podID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerID="dd993ed296c84ad1ef214594cb9fda6073f5acca4e490d4b251550947affd0e2" exitCode=0
May 21 18:26:25.949459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:25.949408    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss" event={"ID":"d5edf38c-933b-4ad3-80e4-67c0592c19bd","Type":"ContainerDied","Data":"dd993ed296c84ad1ef214594cb9fda6073f5acca4e490d4b251550947affd0e2"}
May 21 18:26:27.079711 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.079686    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:27.095768 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.095732    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtfqn\" (UniqueName: \"kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn\") pod \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") "
May 21 18:26:27.095922 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.095787    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util\") pod \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") "
May 21 18:26:27.095922 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.095820    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle\") pod \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\" (UID: \"d5edf38c-933b-4ad3-80e4-67c0592c19bd\") "
May 21 18:26:27.096513 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.096483    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle" (OuterVolumeSpecName: "bundle") pod "d5edf38c-933b-4ad3-80e4-67c0592c19bd" (UID: "d5edf38c-933b-4ad3-80e4-67c0592c19bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:26:27.098007 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.097981    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn" (OuterVolumeSpecName: "kube-api-access-vtfqn") pod "d5edf38c-933b-4ad3-80e4-67c0592c19bd" (UID: "d5edf38c-933b-4ad3-80e4-67c0592c19bd"). InnerVolumeSpecName "kube-api-access-vtfqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:26:27.100241 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.100220    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util" (OuterVolumeSpecName: "util") pod "d5edf38c-933b-4ad3-80e4-67c0592c19bd" (UID: "d5edf38c-933b-4ad3-80e4-67c0592c19bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:26:27.197185 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.197142    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtfqn\" (UniqueName: \"kubernetes.io/projected/d5edf38c-933b-4ad3-80e4-67c0592c19bd-kube-api-access-vtfqn\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:27.197358 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.197198    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:27.197358 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.197208    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5edf38c-933b-4ad3-80e4-67c0592c19bd-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:27.956867 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.956834    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss" event={"ID":"d5edf38c-933b-4ad3-80e4-67c0592c19bd","Type":"ContainerDied","Data":"ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48"}
May 21 18:26:27.956867 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.956870    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac52ff38685388459c96efb4d29e3817f3fda78ab0ef7479e31b102b805f3d48"
May 21 18:26:27.957061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:27.956843    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djpjss"
May 21 18:26:34.098549 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098515    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"]
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098836    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="pull"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098851    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="pull"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098866    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="extract"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098872    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="extract"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098881    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="util"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098886    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="util"
May 21 18:26:34.099038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.098934    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5edf38c-933b-4ad3-80e4-67c0592c19bd" containerName="extract"
May 21 18:26:34.103469 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.103452    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.107357 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.107329    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-26hpb\""
May 21 18:26:34.107573 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.107557    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 21 18:26:34.107774 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.107760    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 21 18:26:34.113231 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.113205    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"]
May 21 18:26:34.153797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.153753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efa363-711f-46e2-95b8-c7f2e5d344a0-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.153977 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.153810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvpz\" (UniqueName: \"kubernetes.io/projected/03efa363-711f-46e2-95b8-c7f2e5d344a0-kube-api-access-ckvpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.254494 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.254454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efa363-711f-46e2-95b8-c7f2e5d344a0-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.254685 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.254505    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvpz\" (UniqueName: \"kubernetes.io/projected/03efa363-711f-46e2-95b8-c7f2e5d344a0-kube-api-access-ckvpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.254889 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.254866    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efa363-711f-46e2-95b8-c7f2e5d344a0-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.263658 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.263627    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvpz\" (UniqueName: \"kubernetes.io/projected/03efa363-711f-46e2-95b8-c7f2e5d344a0-kube-api-access-ckvpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qvk7x\" (UID: \"03efa363-711f-46e2-95b8-c7f2e5d344a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.413078 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.413039    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"
May 21 18:26:34.548008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.547973    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x"]
May 21 18:26:34.551786 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:34.551753    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03efa363_711f_46e2_95b8_c7f2e5d344a0.slice/crio-3f9e6212110736026d92154600da848260a5b2eb7539e77393d152af7980a71b WatchSource:0}: Error finding container 3f9e6212110736026d92154600da848260a5b2eb7539e77393d152af7980a71b: Status 404 returned error can't find the container with id 3f9e6212110736026d92154600da848260a5b2eb7539e77393d152af7980a71b
May 21 18:26:34.977792 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:34.977761    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x" event={"ID":"03efa363-711f-46e2-95b8-c7f2e5d344a0","Type":"ContainerStarted","Data":"3f9e6212110736026d92154600da848260a5b2eb7539e77393d152af7980a71b"}
May 21 18:26:36.989037 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:36.988949    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x" event={"ID":"03efa363-711f-46e2-95b8-c7f2e5d344a0","Type":"ContainerStarted","Data":"968aea40b33eda07267585910d407cd4a4ad0440bb92751cc2567f929d060ef7"}
May 21 18:26:37.016200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.016121    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qvk7x" podStartSLOduration=0.907354348 podStartE2EDuration="3.016100708s" podCreationTimestamp="2026-05-21 18:26:34 +0000 UTC" firstStartedPulling="2026-05-21 18:26:34.554232345 +0000 UTC m=+375.347080586" lastFinishedPulling="2026-05-21 18:26:36.662978707 +0000 UTC m=+377.455826946" observedRunningTime="2026-05-21 18:26:37.013954202 +0000 UTC m=+377.806802459" watchObservedRunningTime="2026-05-21 18:26:37.016100708 +0000 UTC m=+377.808948969"
May 21 18:26:37.976995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.976957    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"]
May 21 18:26:37.979757 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.979737    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:37.982054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.982034    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:26:37.982227 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.982084    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:26:37.982371 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:37.982355    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:26:38.000467 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.000425    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"]
May 21 18:26:38.087864 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.087818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chrhd\" (UniqueName: \"kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.088062 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.087884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.088062 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.087910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.188997 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.188958    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chrhd\" (UniqueName: \"kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.188997 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.189004    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.189307 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.189027    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.189416 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.189400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.189457 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.189421    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.199802 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.199767    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chrhd\" (UniqueName: \"kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.289496 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.289400    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:38.412471 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.412440    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"]
May 21 18:26:38.414967 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:38.414939    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b3fdf6_a9fc_4175_8de9_0e1d17aa3a5e.slice/crio-5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8 WatchSource:0}: Error finding container 5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8: Status 404 returned error can't find the container with id 5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8
May 21 18:26:38.895071 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.895037    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-cqqc5"]
May 21 18:26:38.897040 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.897023    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:38.899379 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.899356    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 18:26:38.900008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.899985    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bx98l\""
May 21 18:26:38.900147 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.899985    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 18:26:38.906148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.906120    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-cqqc5"]
May 21 18:26:38.995767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.995733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:38.995970 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.995795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsj7d\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-kube-api-access-bsj7d\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:38.996927 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.996892    2557 generic.go:358] "Generic (PLEG): container finished" podID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerID="26b6d0aa97434cfe4c5e6053ae9c67c5f9aca523c15a0feda4bcc9511701cd41" exitCode=0
May 21 18:26:38.997047 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.996949    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5" event={"ID":"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e","Type":"ContainerDied","Data":"26b6d0aa97434cfe4c5e6053ae9c67c5f9aca523c15a0feda4bcc9511701cd41"}
May 21 18:26:38.997047 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:38.996987    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5" event={"ID":"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e","Type":"ContainerStarted","Data":"5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8"}
May 21 18:26:39.097018 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.096981    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:39.097018 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.097035    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsj7d\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-kube-api-access-bsj7d\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:39.105529 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.105496    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:39.105667 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.105638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsj7d\" (UniqueName: \"kubernetes.io/projected/ff93dd41-0772-4f43-8f6c-5ea83a5d2935-kube-api-access-bsj7d\") pod \"cert-manager-webhook-587ccfb98-cqqc5\" (UID: \"ff93dd41-0772-4f43-8f6c-5ea83a5d2935\") " pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:39.221177 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.221143    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:39.348509 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:39.348482    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-cqqc5"]
May 21 18:26:39.350641 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:39.350612    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff93dd41_0772_4f43_8f6c_5ea83a5d2935.slice/crio-93dfee8ce8817f123a93fd2f86a85a8d9513e31616401ee591249173ebe4ea3a WatchSource:0}: Error finding container 93dfee8ce8817f123a93fd2f86a85a8d9513e31616401ee591249173ebe4ea3a: Status 404 returned error can't find the container with id 93dfee8ce8817f123a93fd2f86a85a8d9513e31616401ee591249173ebe4ea3a
May 21 18:26:40.001956 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:40.001916    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5" event={"ID":"ff93dd41-0772-4f43-8f6c-5ea83a5d2935","Type":"ContainerStarted","Data":"93dfee8ce8817f123a93fd2f86a85a8d9513e31616401ee591249173ebe4ea3a"}
May 21 18:26:42.010848 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:42.010806    2557 generic.go:358] "Generic (PLEG): container finished" podID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerID="0f3b32498cff728926ebc44675fd1d8844ba98ca6a7ff43334477343b930d9ea" exitCode=0
May 21 18:26:42.011269 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:42.010887    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5" event={"ID":"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e","Type":"ContainerDied","Data":"0f3b32498cff728926ebc44675fd1d8844ba98ca6a7ff43334477343b930d9ea"}
May 21 18:26:43.015144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:43.015103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5" event={"ID":"ff93dd41-0772-4f43-8f6c-5ea83a5d2935","Type":"ContainerStarted","Data":"08464d4eed814323dd726088fb956edfa35d4e8227fa7958d4a9985ea829a549"}
May 21 18:26:43.015144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:43.015155    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:43.016873 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:43.016848    2557 generic.go:358] "Generic (PLEG): container finished" podID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerID="803781cee8d1d2b77c575a018d88fda187297ce14f3fb13f3ab262fc28f7e75e" exitCode=0
May 21 18:26:43.016972 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:43.016899    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5" event={"ID":"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e","Type":"ContainerDied","Data":"803781cee8d1d2b77c575a018d88fda187297ce14f3fb13f3ab262fc28f7e75e"}
May 21 18:26:43.033921 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:43.033857    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5" podStartSLOduration=1.937867043 podStartE2EDuration="5.033837947s" podCreationTimestamp="2026-05-21 18:26:38 +0000 UTC" firstStartedPulling="2026-05-21 18:26:39.35253566 +0000 UTC m=+380.145383914" lastFinishedPulling="2026-05-21 18:26:42.44850657 +0000 UTC m=+383.241354818" observedRunningTime="2026-05-21 18:26:43.032715028 +0000 UTC m=+383.825563287" watchObservedRunningTime="2026-05-21 18:26:43.033837947 +0000 UTC m=+383.826686206"
May 21 18:26:44.141219 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.141191    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:44.241156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.241119    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle\") pod \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") "
May 21 18:26:44.241363 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.241218    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chrhd\" (UniqueName: \"kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd\") pod \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") "
May 21 18:26:44.241363 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.241251    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util\") pod \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\" (UID: \"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e\") "
May 21 18:26:44.241656 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.241629    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle" (OuterVolumeSpecName: "bundle") pod "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" (UID: "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:26:44.243381 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.243356    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd" (OuterVolumeSpecName: "kube-api-access-chrhd") pod "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" (UID: "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e"). InnerVolumeSpecName "kube-api-access-chrhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:26:44.245662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.245640    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util" (OuterVolumeSpecName: "util") pod "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" (UID: "b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:26:44.342735 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.342640    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:44.342735 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.342673    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:44.342735 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:44.342683    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chrhd\" (UniqueName: \"kubernetes.io/projected/b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e-kube-api-access-chrhd\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:26:45.024568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:45.024533    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5" event={"ID":"b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e","Type":"ContainerDied","Data":"5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8"}
May 21 18:26:45.024568 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:45.024567    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ca0d91d703721add711730cb7c68d334da018bb399322e3878c52e299fe49f8"
May 21 18:26:45.024782 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:45.024594    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7tqr5"
May 21 18:26:49.021886 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:49.021854    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-cqqc5"
May 21 18:26:52.104468 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104429    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"]
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104714    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="extract"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104724    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="extract"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104737    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="pull"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104742    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="pull"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104749    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="util"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104754    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="util"
May 21 18:26:52.104849 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.104794    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0b3fdf6-a9fc-4175-8de9-0e1d17aa3a5e" containerName="extract"
May 21 18:26:52.132510 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.132479    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"]
May 21 18:26:52.132709 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.132585    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.134878 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.134851    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9sjw4\""
May 21 18:26:52.135495 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.135476    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 18:26:52.135598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.135485    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 18:26:52.206533 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.206499    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14edad-5c43-48c4-b333-2e03ead7dc6a-tmp\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.206685 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.206554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsh7j\" (UniqueName: \"kubernetes.io/projected/aa14edad-5c43-48c4-b333-2e03ead7dc6a-kube-api-access-lsh7j\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.307611 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.307562    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsh7j\" (UniqueName: \"kubernetes.io/projected/aa14edad-5c43-48c4-b333-2e03ead7dc6a-kube-api-access-lsh7j\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.307786 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.307650    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14edad-5c43-48c4-b333-2e03ead7dc6a-tmp\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.308006 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.307987    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14edad-5c43-48c4-b333-2e03ead7dc6a-tmp\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.315935 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.315902    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsh7j\" (UniqueName: \"kubernetes.io/projected/aa14edad-5c43-48c4-b333-2e03ead7dc6a-kube-api-access-lsh7j\") pod \"openshift-lws-operator-bfc7f696d-p24zn\" (UID: \"aa14edad-5c43-48c4-b333-2e03ead7dc6a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.441575 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.441459    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"
May 21 18:26:52.574833 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:52.574803    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn"]
May 21 18:26:52.577492 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:52.577460    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa14edad_5c43_48c4_b333_2e03ead7dc6a.slice/crio-5e12d740b821346df67449509c167adc93ac70daf328c6b5f6b213925ee8ac4f WatchSource:0}: Error finding container 5e12d740b821346df67449509c167adc93ac70daf328c6b5f6b213925ee8ac4f: Status 404 returned error can't find the container with id 5e12d740b821346df67449509c167adc93ac70daf328c6b5f6b213925ee8ac4f
May 21 18:26:53.049123 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:53.049077    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn" event={"ID":"aa14edad-5c43-48c4-b333-2e03ead7dc6a","Type":"ContainerStarted","Data":"5e12d740b821346df67449509c167adc93ac70daf328c6b5f6b213925ee8ac4f"}
May 21 18:26:58.259808 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.259772    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-jm87g"]
May 21 18:26:58.262339 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.262317    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.264576 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.264541    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ktjwp\""
May 21 18:26:58.274301 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.274273    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-jm87g"]
May 21 18:26:58.359260 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.359216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-bound-sa-token\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.359436 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.359342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfslb\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-kube-api-access-xfslb\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.460078 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.460037    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfslb\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-kube-api-access-xfslb\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.460078 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.460079    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-bound-sa-token\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.469247 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.469219    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-bound-sa-token\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.469384 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.469280    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfslb\" (UniqueName: \"kubernetes.io/projected/d4e4b8bf-75f4-47f0-b774-f1ad0252982f-kube-api-access-xfslb\") pod \"cert-manager-79c8d999ff-jm87g\" (UID: \"d4e4b8bf-75f4-47f0-b774-f1ad0252982f\") " pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.572274 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.572189    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-jm87g"
May 21 18:26:58.699070 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:58.699045    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-jm87g"]
May 21 18:26:58.701505 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:26:58.701470    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4e4b8bf_75f4_47f0_b774_f1ad0252982f.slice/crio-172ab8fc6f1e5103b9d08315320208eb07100a2cf2a0d22279b20a07bfb6eebf WatchSource:0}: Error finding container 172ab8fc6f1e5103b9d08315320208eb07100a2cf2a0d22279b20a07bfb6eebf: Status 404 returned error can't find the container with id 172ab8fc6f1e5103b9d08315320208eb07100a2cf2a0d22279b20a07bfb6eebf
May 21 18:26:59.071909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:59.071875    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-jm87g" event={"ID":"d4e4b8bf-75f4-47f0-b774-f1ad0252982f","Type":"ContainerStarted","Data":"91596e0a963c478aec3f8844da30bf4b6d1f71ba594da95e05b2e81c19b54fac"}
May 21 18:26:59.071909 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:59.071909    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-jm87g" event={"ID":"d4e4b8bf-75f4-47f0-b774-f1ad0252982f","Type":"ContainerStarted","Data":"172ab8fc6f1e5103b9d08315320208eb07100a2cf2a0d22279b20a07bfb6eebf"}
May 21 18:26:59.092256 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:26:59.092206    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-jm87g" podStartSLOduration=1.092189928 podStartE2EDuration="1.092189928s" podCreationTimestamp="2026-05-21 18:26:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:26:59.089902986 +0000 UTC m=+399.882751246" watchObservedRunningTime="2026-05-21 18:26:59.092189928 +0000 UTC m=+399.885038183"
May 21 18:27:02.083114 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:02.083015    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn" event={"ID":"aa14edad-5c43-48c4-b333-2e03ead7dc6a","Type":"ContainerStarted","Data":"a18c3ca285329aa1e0d54c78fcc17be731d7bca4f7abcff92a3ff35432978ff0"}
May 21 18:27:02.100937 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:02.100534    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p24zn" podStartSLOduration=0.962408369 podStartE2EDuration="10.100514607s" podCreationTimestamp="2026-05-21 18:26:52 +0000 UTC" firstStartedPulling="2026-05-21 18:26:52.579139451 +0000 UTC m=+393.371987687" lastFinishedPulling="2026-05-21 18:27:01.717245673 +0000 UTC m=+402.510093925" observedRunningTime="2026-05-21 18:27:02.098769229 +0000 UTC m=+402.891617488" watchObservedRunningTime="2026-05-21 18:27:02.100514607 +0000 UTC m=+402.893362866"
May 21 18:27:03.663640 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.663605    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"]
May 21 18:27:03.666022 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.666000    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.668440 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.668416    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:27:03.669049 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.669033    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:27:03.669428 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.669410    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:27:03.680481 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.680449    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"]
May 21 18:27:03.808852 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.808819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.809054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.808906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.809054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.808935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfzx\" (UniqueName: \"kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.910260 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.910220    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.910438 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.910275    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krfzx\" (UniqueName: \"kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.910438 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.910319    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.910697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.910675    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.910735 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.910699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.918029 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.917967    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfzx\" (UniqueName: \"kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:03.975216 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:03.975134    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:04.106486 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:04.106457    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"]
May 21 18:27:04.109489 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:04.109458    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ee2963_77c2_4f04_a93a_642bdd0c1050.slice/crio-a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a WatchSource:0}: Error finding container a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a: Status 404 returned error can't find the container with id a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a
May 21 18:27:05.093606 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:05.093570    2557 generic.go:358] "Generic (PLEG): container finished" podID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerID="6a840766e554fcc2ad61fcb566d378a6b9268c56252de96e076a16430e49653f" exitCode=0
May 21 18:27:05.094061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:05.093657    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv" event={"ID":"47ee2963-77c2-4f04-a93a-642bdd0c1050","Type":"ContainerDied","Data":"6a840766e554fcc2ad61fcb566d378a6b9268c56252de96e076a16430e49653f"}
May 21 18:27:05.094061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:05.093696    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv" event={"ID":"47ee2963-77c2-4f04-a93a-642bdd0c1050","Type":"ContainerStarted","Data":"a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a"}
May 21 18:27:06.098710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:06.098611    2557 generic.go:358] "Generic (PLEG): container finished" podID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerID="f4379dcbaf34fffb7b24b35c7c8f9971bb60d79d7f0fb7081de0ce91ca74329d" exitCode=0
May 21 18:27:06.098710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:06.098694    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv" event={"ID":"47ee2963-77c2-4f04-a93a-642bdd0c1050","Type":"ContainerDied","Data":"f4379dcbaf34fffb7b24b35c7c8f9971bb60d79d7f0fb7081de0ce91ca74329d"}
May 21 18:27:07.104961 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:07.104929    2557 generic.go:358] "Generic (PLEG): container finished" podID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerID="1825348dfbe412c7ad09421debf38c74629c508ee599d5edfcfc23df93606adc" exitCode=0
May 21 18:27:07.105374 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:07.105002    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv" event={"ID":"47ee2963-77c2-4f04-a93a-642bdd0c1050","Type":"ContainerDied","Data":"1825348dfbe412c7ad09421debf38c74629c508ee599d5edfcfc23df93606adc"}
May 21 18:27:08.235926 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.235901    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:08.349337 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.349283    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krfzx\" (UniqueName: \"kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx\") pod \"47ee2963-77c2-4f04-a93a-642bdd0c1050\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") "
May 21 18:27:08.349337 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.349358    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle\") pod \"47ee2963-77c2-4f04-a93a-642bdd0c1050\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") "
May 21 18:27:08.349609 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.349454    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util\") pod \"47ee2963-77c2-4f04-a93a-642bdd0c1050\" (UID: \"47ee2963-77c2-4f04-a93a-642bdd0c1050\") "
May 21 18:27:08.350024 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.350000    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle" (OuterVolumeSpecName: "bundle") pod "47ee2963-77c2-4f04-a93a-642bdd0c1050" (UID: "47ee2963-77c2-4f04-a93a-642bdd0c1050"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:08.351410 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.351384    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx" (OuterVolumeSpecName: "kube-api-access-krfzx") pod "47ee2963-77c2-4f04-a93a-642bdd0c1050" (UID: "47ee2963-77c2-4f04-a93a-642bdd0c1050"). InnerVolumeSpecName "kube-api-access-krfzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:27:08.355268 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.355240    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util" (OuterVolumeSpecName: "util") pod "47ee2963-77c2-4f04-a93a-642bdd0c1050" (UID: "47ee2963-77c2-4f04-a93a-642bdd0c1050"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:08.451029 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.450932    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:08.451029 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.450966    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krfzx\" (UniqueName: \"kubernetes.io/projected/47ee2963-77c2-4f04-a93a-642bdd0c1050-kube-api-access-krfzx\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:08.451029 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:08.450985    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47ee2963-77c2-4f04-a93a-642bdd0c1050-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:09.113653 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:09.113608    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv" event={"ID":"47ee2963-77c2-4f04-a93a-642bdd0c1050","Type":"ContainerDied","Data":"a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a"}
May 21 18:27:09.113653 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:09.113641    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9bc84b12617decf2407eb9b26eae009100b6f6a0b52b269108a3fa46c4b324a"
May 21 18:27:09.113653 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:09.113646    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c569rxv"
May 21 18:27:18.213706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.213670    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"]
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.213976    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="pull"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.213987    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="pull"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.213997    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="util"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.214002    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="util"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.214011    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="extract"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.214017    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="extract"
May 21 18:27:18.214076 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.214064    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="47ee2963-77c2-4f04-a93a-642bdd0c1050" containerName="extract"
May 21 18:27:18.218430 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.218410    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.220550 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.220526    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:27:18.220671 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.220527    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:27:18.221075 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.221060    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:27:18.225310 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.225279    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"]
May 21 18:27:18.328599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.328561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwpn\" (UniqueName: \"kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.329033 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.329010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.329204 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.329190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.430139 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.430098    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.430139 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.430140    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.430372 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.430213    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwpn\" (UniqueName: \"kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.430537 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.430516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.430597 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.430578    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.438504 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.438467    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwpn\" (UniqueName: \"kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.528796 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.528709    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:18.676198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:18.676152    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"]
May 21 18:27:18.679155 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:18.679121    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5237bde_0ab4_4ade_a6ce_f9086b43d8b7.slice/crio-78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b WatchSource:0}: Error finding container 78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b: Status 404 returned error can't find the container with id 78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b
May 21 18:27:19.146988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:19.146948    2557 generic.go:358] "Generic (PLEG): container finished" podID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerID="f2568b876e04336444b0dfb8ffdd9d1e4a209168e17d2cb114f603f34d413bfa" exitCode=0
May 21 18:27:19.146988 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:19.146991    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q" event={"ID":"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7","Type":"ContainerDied","Data":"f2568b876e04336444b0dfb8ffdd9d1e4a209168e17d2cb114f603f34d413bfa"}
May 21 18:27:19.147289 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:19.147023    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q" event={"ID":"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7","Type":"ContainerStarted","Data":"78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b"}
May 21 18:27:20.118013 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.117975    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"]
May 21 18:27:20.121431 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.121409    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.123940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.123916    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 18:27:20.124136 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.124117    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 18:27:20.124233 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.124124    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gnvp9\""
May 21 18:27:20.124453 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.124438    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 18:27:20.126763 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.126744    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 18:27:20.132500 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.132463    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"]
May 21 18:27:20.152061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.152031    2557 generic.go:358] "Generic (PLEG): container finished" podID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerID="8e0a5fbe8a94c9ddd75d60f43737fd0bedfa2c55f1b7a8a34e16871a3cb8ade1" exitCode=0
May 21 18:27:20.152224 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.152069    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q" event={"ID":"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7","Type":"ContainerDied","Data":"8e0a5fbe8a94c9ddd75d60f43737fd0bedfa2c55f1b7a8a34e16871a3cb8ade1"}
May 21 18:27:20.245349 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.245307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdh6\" (UniqueName: \"kubernetes.io/projected/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-kube-api-access-qtdh6\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.245542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.245372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.245542 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.245406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.346100 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.346064    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.346100 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.346107    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.346339 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.346160    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdh6\" (UniqueName: \"kubernetes.io/projected/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-kube-api-access-qtdh6\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.348559 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.348532    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.348669 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.348563    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.354532 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.354511    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdh6\" (UniqueName: \"kubernetes.io/projected/ebf15ef1-cbf0-4cc9-8e57-abe139af0940-kube-api-access-qtdh6\") pod \"opendatahub-operator-controller-manager-67595b8579-td927\" (UID: \"ebf15ef1-cbf0-4cc9-8e57-abe139af0940\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.432192 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.432083    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:20.592967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:20.592940    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"]
May 21 18:27:20.595613 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:20.595576    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf15ef1_cbf0_4cc9_8e57_abe139af0940.slice/crio-d394b84e10bdf27f5d8d0120740d6439829b5a3e155e4eb54c14a6d3ee32e258 WatchSource:0}: Error finding container d394b84e10bdf27f5d8d0120740d6439829b5a3e155e4eb54c14a6d3ee32e258: Status 404 returned error can't find the container with id d394b84e10bdf27f5d8d0120740d6439829b5a3e155e4eb54c14a6d3ee32e258
May 21 18:27:21.158764 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:21.158691    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927" event={"ID":"ebf15ef1-cbf0-4cc9-8e57-abe139af0940","Type":"ContainerStarted","Data":"d394b84e10bdf27f5d8d0120740d6439829b5a3e155e4eb54c14a6d3ee32e258"}
May 21 18:27:21.161409 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:21.161377    2557 generic.go:358] "Generic (PLEG): container finished" podID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerID="e8e7ca7cb360aedb929789a8f20b1986cf3865d1de465b6601bbaaaca1b2459a" exitCode=0
May 21 18:27:21.161561 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:21.161415    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q" event={"ID":"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7","Type":"ContainerDied","Data":"e8e7ca7cb360aedb929789a8f20b1986cf3865d1de465b6601bbaaaca1b2459a"}
May 21 18:27:23.195724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.195700    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:23.371651 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.371611    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle\") pod \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") "
May 21 18:27:23.371823 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.371676    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util\") pod \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") "
May 21 18:27:23.371823 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.371724    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkwpn\" (UniqueName: \"kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn\") pod \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\" (UID: \"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7\") "
May 21 18:27:23.372448 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.372425    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle" (OuterVolumeSpecName: "bundle") pod "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" (UID: "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:23.373875 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.373852    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn" (OuterVolumeSpecName: "kube-api-access-zkwpn") pod "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" (UID: "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7"). InnerVolumeSpecName "kube-api-access-zkwpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:27:23.377777 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.377746    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util" (OuterVolumeSpecName: "util") pod "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" (UID: "f5237bde-0ab4-4ade-a6ce-f9086b43d8b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:23.472564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.472484    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:23.472564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.472518    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:23.472564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:23.472529    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwpn\" (UniqueName: \"kubernetes.io/projected/f5237bde-0ab4-4ade-a6ce-f9086b43d8b7-kube-api-access-zkwpn\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:24.172797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.172756    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927" event={"ID":"ebf15ef1-cbf0-4cc9-8e57-abe139af0940","Type":"ContainerStarted","Data":"f8557b84f13c8b2bd4613757e7447420396eb4259bfd2eb7a16e6a8e845927a1"}
May 21 18:27:24.172984 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.172916    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:24.174456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.174424    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q" event={"ID":"f5237bde-0ab4-4ade-a6ce-f9086b43d8b7","Type":"ContainerDied","Data":"78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b"}
May 21 18:27:24.174456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.174444    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96m94q"
May 21 18:27:24.174456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.174459    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78b28182dcd9c209b0c3d48efc181bd1ddbb332a3c674bfadbc7ddf730736a8b"
May 21 18:27:24.192280 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:24.192223    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927" podStartSLOduration=1.561455834 podStartE2EDuration="4.192207274s" podCreationTimestamp="2026-05-21 18:27:20 +0000 UTC" firstStartedPulling="2026-05-21 18:27:20.597363553 +0000 UTC m=+421.390211790" lastFinishedPulling="2026-05-21 18:27:23.228114979 +0000 UTC m=+424.020963230" observedRunningTime="2026-05-21 18:27:24.19112645 +0000 UTC m=+424.983974717" watchObservedRunningTime="2026-05-21 18:27:24.192207274 +0000 UTC m=+424.985055529"
May 21 18:27:35.180965 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:35.180868    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-td927"
May 21 18:27:37.568535 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568499    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"]
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568777    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="util"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568788    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="util"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568801    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="extract"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568807    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="extract"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568812    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="pull"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568817    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="pull"
May 21 18:27:37.568912 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.568879    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5237bde-0ab4-4ade-a6ce-f9086b43d8b7" containerName="extract"
May 21 18:27:37.571990 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.571973    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.575791 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.575769    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:27:37.576934 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.576868    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:27:37.578339 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.578312    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:27:37.586854 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.586831    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"]
May 21 18:27:37.594947 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.594924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.595065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.595016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.595065 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.595055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5qj\" (UniqueName: \"kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.695446 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.695400    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5qj\" (UniqueName: \"kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.695646 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.695454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.695646 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.695539    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.695915 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.695892    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.695990 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.695925    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.708262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.708239    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5qj\" (UniqueName: \"kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:37.881698 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:37.881665    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:38.019775 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.019748    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"]
May 21 18:27:38.022317 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:38.022286    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bacc5c_0162_4f75_a7fd_b0398c739e73.slice/crio-10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19 WatchSource:0}: Error finding container 10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19: Status 404 returned error can't find the container with id 10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19
May 21 18:27:38.223751 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.223716    2557 generic.go:358] "Generic (PLEG): container finished" podID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerID="d5d494d2b81a02425b64ca41f3a6d62886cc08aea608bddf1a21856ce2cd3b8a" exitCode=0
May 21 18:27:38.223936 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.223804    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm" event={"ID":"c1bacc5c-0162-4f75-a7fd-b0398c739e73","Type":"ContainerDied","Data":"d5d494d2b81a02425b64ca41f3a6d62886cc08aea608bddf1a21856ce2cd3b8a"}
May 21 18:27:38.223936 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.223844    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm" event={"ID":"c1bacc5c-0162-4f75-a7fd-b0398c739e73","Type":"ContainerStarted","Data":"10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19"}
May 21 18:27:38.735753 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.735712    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"]
May 21 18:27:38.739216 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.739192    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.741890 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.741845    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 18:27:38.742041 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.741846    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 18:27:38.742590 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.742574    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxjvn\""
May 21 18:27:38.742668 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.742648    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 18:27:38.742728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.742663    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 18:27:38.750671 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.750645    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"]
May 21 18:27:38.802459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.802422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tmp\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.802459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.802462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxltw\" (UniqueName: \"kubernetes.io/projected/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-kube-api-access-kxltw\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.802685 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.802660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.903134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.903092    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tmp\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.903134 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.903136    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxltw\" (UniqueName: \"kubernetes.io/projected/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-kube-api-access-kxltw\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.903367 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.903193    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.905420 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.905384    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tmp\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.905756 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.905734    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:38.916860 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:38.916833    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxltw\" (UniqueName: \"kubernetes.io/projected/b8b361eb-f8aa-4ade-a082-8a9483a6a3cf-kube-api-access-kxltw\") pod \"kube-auth-proxy-d887b4ccb-mxn89\" (UID: \"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:39.048822 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:39.048722    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"
May 21 18:27:39.178546 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:39.178507    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89"]
May 21 18:27:39.180884 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:39.180858    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b361eb_f8aa_4ade_a082_8a9483a6a3cf.slice/crio-cd497502053907aa5f6790b241e28ee03682e5a9c72f9fb53ec119a6fb55cc58 WatchSource:0}: Error finding container cd497502053907aa5f6790b241e28ee03682e5a9c72f9fb53ec119a6fb55cc58: Status 404 returned error can't find the container with id cd497502053907aa5f6790b241e28ee03682e5a9c72f9fb53ec119a6fb55cc58
May 21 18:27:39.228807 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:39.228774    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89" event={"ID":"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf","Type":"ContainerStarted","Data":"cd497502053907aa5f6790b241e28ee03682e5a9c72f9fb53ec119a6fb55cc58"}
May 21 18:27:40.234904 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:40.234863    2557 generic.go:358] "Generic (PLEG): container finished" podID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerID="9d67f0ff20ee9ab2ecb564a1c5130d1719e2560d75270954348af77f5413d9a8" exitCode=0
May 21 18:27:40.235349 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:40.234966    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm" event={"ID":"c1bacc5c-0162-4f75-a7fd-b0398c739e73","Type":"ContainerDied","Data":"9d67f0ff20ee9ab2ecb564a1c5130d1719e2560d75270954348af77f5413d9a8"}
May 21 18:27:41.240230 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.240138    2557 generic.go:358] "Generic (PLEG): container finished" podID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerID="f9ba861b253beb8a98012638bdad4a486aae70cada991c3376c766fadaadaa87" exitCode=0
May 21 18:27:41.240230 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.240197    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm" event={"ID":"c1bacc5c-0162-4f75-a7fd-b0398c739e73","Type":"ContainerDied","Data":"f9ba861b253beb8a98012638bdad4a486aae70cada991c3376c766fadaadaa87"}
May 21 18:27:41.651697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.651658    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fcn58"]
May 21 18:27:41.655392 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.655371    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:41.657451 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.657427    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 18:27:41.657586 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.657537    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4bmq5\""
May 21 18:27:41.662631 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.662589    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fcn58"]
May 21 18:27:41.731901 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.731868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:41.732138 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.731987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9k8\" (UniqueName: \"kubernetes.io/projected/ede0a427-21d5-4956-a80e-04a908fb9112-kube-api-access-lf9k8\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:41.832908 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.832870    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:41.833117 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.832959    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9k8\" (UniqueName: \"kubernetes.io/projected/ede0a427-21d5-4956-a80e-04a908fb9112-kube-api-access-lf9k8\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:41.833117 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:41.832991    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 18:27:41.833117 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:41.833071    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert podName:ede0a427-21d5-4956-a80e-04a908fb9112 nodeName:}" failed. No retries permitted until 2026-05-21 18:27:42.333050964 +0000 UTC m=+443.125899203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert") pod "odh-model-controller-858dbf95b8-fcn58" (UID: "ede0a427-21d5-4956-a80e-04a908fb9112") : secret "odh-model-controller-webhook-cert" not found
May 21 18:27:41.844593 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:41.844562    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9k8\" (UniqueName: \"kubernetes.io/projected/ede0a427-21d5-4956-a80e-04a908fb9112-kube-api-access-lf9k8\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:42.337715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.337661    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:42.340223 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.340190    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede0a427-21d5-4956-a80e-04a908fb9112-cert\") pod \"odh-model-controller-858dbf95b8-fcn58\" (UID: \"ede0a427-21d5-4956-a80e-04a908fb9112\") " pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:42.389048 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.389024    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:42.438408 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.438370    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh5qj\" (UniqueName: \"kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj\") pod \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") "
May 21 18:27:42.438594 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.438457    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle\") pod \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") "
May 21 18:27:42.438594 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.438497    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util\") pod \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\" (UID: \"c1bacc5c-0162-4f75-a7fd-b0398c739e73\") "
May 21 18:27:42.439611 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.439557    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle" (OuterVolumeSpecName: "bundle") pod "c1bacc5c-0162-4f75-a7fd-b0398c739e73" (UID: "c1bacc5c-0162-4f75-a7fd-b0398c739e73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:42.440942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.440911    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj" (OuterVolumeSpecName: "kube-api-access-mh5qj") pod "c1bacc5c-0162-4f75-a7fd-b0398c739e73" (UID: "c1bacc5c-0162-4f75-a7fd-b0398c739e73"). InnerVolumeSpecName "kube-api-access-mh5qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:27:42.445048 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.445022    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util" (OuterVolumeSpecName: "util") pod "c1bacc5c-0162-4f75-a7fd-b0398c739e73" (UID: "c1bacc5c-0162-4f75-a7fd-b0398c739e73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:42.539273 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.539161    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:42.539273 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.539219    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1bacc5c-0162-4f75-a7fd-b0398c739e73-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:42.539273 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.539228    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh5qj\" (UniqueName: \"kubernetes.io/projected/c1bacc5c-0162-4f75-a7fd-b0398c739e73-kube-api-access-mh5qj\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:42.569191 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.569128    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:42.696619 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:42.696581    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fcn58"]
May 21 18:27:43.249808 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.249762    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89" event={"ID":"b8b361eb-f8aa-4ade-a082-8a9483a6a3cf","Type":"ContainerStarted","Data":"c2e24444019b4474a2e68ea7ed912db4de4988d7f2ea11ea075a558344233fbe"}
May 21 18:27:43.251112 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.251076    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" event={"ID":"ede0a427-21d5-4956-a80e-04a908fb9112","Type":"ContainerStarted","Data":"b4d7f4a6a1d3219d45d0d9f6f6c248a664098998310f7f3d1c6146354aa7b144"}
May 21 18:27:43.253012 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.252952    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm" event={"ID":"c1bacc5c-0162-4f75-a7fd-b0398c739e73","Type":"ContainerDied","Data":"10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19"}
May 21 18:27:43.253012 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.252974    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835x54pm"
May 21 18:27:43.253012 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.252984    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10c3f675f4c2cf4d46639fca0c2e9212117fbc13f8ee7dd9bbd4d221d6f36e19"
May 21 18:27:43.269628 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:43.269554    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-mxn89" podStartSLOduration=2.173964399 podStartE2EDuration="5.269535048s" podCreationTimestamp="2026-05-21 18:27:38 +0000 UTC" firstStartedPulling="2026-05-21 18:27:39.182642386 +0000 UTC m=+439.975490623" lastFinishedPulling="2026-05-21 18:27:42.278213036 +0000 UTC m=+443.071061272" observedRunningTime="2026-05-21 18:27:43.267960852 +0000 UTC m=+444.060809109" watchObservedRunningTime="2026-05-21 18:27:43.269535048 +0000 UTC m=+444.062383296"
May 21 18:27:46.266530 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:46.266492    2557 generic.go:358] "Generic (PLEG): container finished" podID="ede0a427-21d5-4956-a80e-04a908fb9112" containerID="34de469e3e62aedaf76f2ab663323b968e107890f7af3d3bf4807756b7a977eb" exitCode=1
May 21 18:27:46.267023 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:46.266575    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" event={"ID":"ede0a427-21d5-4956-a80e-04a908fb9112","Type":"ContainerDied","Data":"34de469e3e62aedaf76f2ab663323b968e107890f7af3d3bf4807756b7a977eb"}
May 21 18:27:46.267023 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:46.266873    2557 scope.go:117] "RemoveContainer" containerID="34de469e3e62aedaf76f2ab663323b968e107890f7af3d3bf4807756b7a977eb"
May 21 18:27:47.271636 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.271599    2557 generic.go:358] "Generic (PLEG): container finished" podID="ede0a427-21d5-4956-a80e-04a908fb9112" containerID="5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7" exitCode=1
May 21 18:27:47.272089 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.271668    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" event={"ID":"ede0a427-21d5-4956-a80e-04a908fb9112","Type":"ContainerDied","Data":"5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7"}
May 21 18:27:47.272089 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.271721    2557 scope.go:117] "RemoveContainer" containerID="34de469e3e62aedaf76f2ab663323b968e107890f7af3d3bf4807756b7a977eb"
May 21 18:27:47.272089 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.271902    2557 scope.go:117] "RemoveContainer" containerID="5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7"
May 21 18:27:47.272236 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:47.272114    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fcn58_opendatahub(ede0a427-21d5-4956-a80e-04a908fb9112)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" podUID="ede0a427-21d5-4956-a80e-04a908fb9112"
May 21 18:27:47.291116 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291089    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-kzzqm"]
May 21 18:27:47.291430 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291416    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="util"
May 21 18:27:47.291480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291432    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="util"
May 21 18:27:47.291480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291444    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="extract"
May 21 18:27:47.291480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291449    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="extract"
May 21 18:27:47.291480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291458    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="pull"
May 21 18:27:47.291480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291463    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="pull"
May 21 18:27:47.291619 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.291516    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1bacc5c-0162-4f75-a7fd-b0398c739e73" containerName="extract"
May 21 18:27:47.295567 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.295548    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.298564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.298540    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 18:27:47.298718 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.298702    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gnchb\""
May 21 18:27:47.311942 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.311915    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-kzzqm"]
May 21 18:27:47.380932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.380899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbbp\" (UniqueName: \"kubernetes.io/projected/d16bd277-dc3f-4cdf-b398-7d4151c5557f-kube-api-access-wjbbp\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.380932 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.380933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.482381 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.482342    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbbp\" (UniqueName: \"kubernetes.io/projected/d16bd277-dc3f-4cdf-b398-7d4151c5557f-kube-api-access-wjbbp\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.482566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.482394    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.482566 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:47.482499    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 18:27:47.482683 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:47.482573    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert podName:d16bd277-dc3f-4cdf-b398-7d4151c5557f nodeName:}" failed. No retries permitted until 2026-05-21 18:27:47.982550427 +0000 UTC m=+448.775398664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert") pod "kserve-controller-manager-856948b99f-kzzqm" (UID: "d16bd277-dc3f-4cdf-b398-7d4151c5557f") : secret "kserve-webhook-server-cert" not found
May 21 18:27:47.494848 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.494819    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbbp\" (UniqueName: \"kubernetes.io/projected/d16bd277-dc3f-4cdf-b398-7d4151c5557f-kube-api-access-wjbbp\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.985772 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:47.985730    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:47.985958 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:47.985877    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 18:27:47.985958 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:47.985952    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert podName:d16bd277-dc3f-4cdf-b398-7d4151c5557f nodeName:}" failed. No retries permitted until 2026-05-21 18:27:48.985933813 +0000 UTC m=+449.778782051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert") pod "kserve-controller-manager-856948b99f-kzzqm" (UID: "d16bd277-dc3f-4cdf-b398-7d4151c5557f") : secret "kserve-webhook-server-cert" not found
May 21 18:27:48.277331 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:48.277250    2557 scope.go:117] "RemoveContainer" containerID="5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7"
May 21 18:27:48.277709 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:48.277456    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fcn58_opendatahub(ede0a427-21d5-4956-a80e-04a908fb9112)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" podUID="ede0a427-21d5-4956-a80e-04a908fb9112"
May 21 18:27:48.995907 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:48.995874    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:48.998228 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:48.998196    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16bd277-dc3f-4cdf-b398-7d4151c5557f-cert\") pod \"kserve-controller-manager-856948b99f-kzzqm\" (UID: \"d16bd277-dc3f-4cdf-b398-7d4151c5557f\") " pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:49.106395 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:49.106355    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:49.235874 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:49.235838    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-kzzqm"]
May 21 18:27:49.239359 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:49.239330    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16bd277_dc3f_4cdf_b398_7d4151c5557f.slice/crio-aba8f82575d78ccd1189e6011a36d5afe3a972fa213f87588543444e044d37e0 WatchSource:0}: Error finding container aba8f82575d78ccd1189e6011a36d5afe3a972fa213f87588543444e044d37e0: Status 404 returned error can't find the container with id aba8f82575d78ccd1189e6011a36d5afe3a972fa213f87588543444e044d37e0
May 21 18:27:49.281679 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:49.281558    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm" event={"ID":"d16bd277-dc3f-4cdf-b398-7d4151c5557f","Type":"ContainerStarted","Data":"aba8f82575d78ccd1189e6011a36d5afe3a972fa213f87588543444e044d37e0"}
May 21 18:27:51.811240 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.811204    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"]
May 21 18:27:51.815128 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.815097    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:51.817420 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.817395    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 18:27:51.817584 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.817525    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 18:27:51.817647 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.817629    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6wgz\""
May 21 18:27:51.833011 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.832977    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"]
May 21 18:27:51.928537 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.928500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:51.928730 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.928560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:51.928730 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:51.928615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw45k\" (UniqueName: \"kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.029143 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.029105    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.029349 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.029178    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.029349 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.029211    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45k\" (UniqueName: \"kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.029520 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.029498    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.029605 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.029581    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.040639 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.040605    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw45k\" (UniqueName: \"kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.124812 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.124775    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:52.283877 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.283852    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"]
May 21 18:27:52.569795 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.569702    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:27:52.570238 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:52.570218    2557 scope.go:117] "RemoveContainer" containerID="5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7"
May 21 18:27:52.570479 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:27:52.570459    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fcn58_opendatahub(ede0a427-21d5-4956-a80e-04a908fb9112)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" podUID="ede0a427-21d5-4956-a80e-04a908fb9112"
May 21 18:27:52.741462 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:52.741426    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce57064e_b568_466c_86f4_e1bb69c79b82.slice/crio-b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e WatchSource:0}: Error finding container b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e: Status 404 returned error can't find the container with id b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e
May 21 18:27:53.301676 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.301624    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm" event={"ID":"d16bd277-dc3f-4cdf-b398-7d4151c5557f","Type":"ContainerStarted","Data":"3d15b7086528c241bf27358e6afdfb15359cea8058575cfda2cee1cf9fbd381f"}
May 21 18:27:53.302148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.301730    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:27:53.303055 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.303029    2557 generic.go:358] "Generic (PLEG): container finished" podID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerID="560f5c3cbfd78cd1578c9edff321850c935153fcd4957c2419f469e43cd83c8e" exitCode=0
May 21 18:27:53.303132 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.303108    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl" event={"ID":"ce57064e-b568-466c-86f4-e1bb69c79b82","Type":"ContainerDied","Data":"560f5c3cbfd78cd1578c9edff321850c935153fcd4957c2419f469e43cd83c8e"}
May 21 18:27:53.303191 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.303143    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl" event={"ID":"ce57064e-b568-466c-86f4-e1bb69c79b82","Type":"ContainerStarted","Data":"b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e"}
May 21 18:27:53.327085 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.327027    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm" podStartSLOduration=2.776024891 podStartE2EDuration="6.327011678s" podCreationTimestamp="2026-05-21 18:27:47 +0000 UTC" firstStartedPulling="2026-05-21 18:27:49.240750801 +0000 UTC m=+450.033599036" lastFinishedPulling="2026-05-21 18:27:52.791737567 +0000 UTC m=+453.584585823" observedRunningTime="2026-05-21 18:27:53.324469278 +0000 UTC m=+454.117317533" watchObservedRunningTime="2026-05-21 18:27:53.327011678 +0000 UTC m=+454.119859934"
May 21 18:27:53.568705 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.568617    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"]
May 21 18:27:53.572284 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.572262    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.576326 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.576301    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 18:27:53.576573 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.576556    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 18:27:53.576619 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.576600    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hqmjw\""
May 21 18:27:53.588154 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.588124    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"]
May 21 18:27:53.644659 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.644615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xjh\" (UniqueName: \"kubernetes.io/projected/7888cc49-84e4-4c41-97e1-5866bf97ddc7-kube-api-access-64xjh\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.644659 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.644664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7888cc49-84e4-4c41-97e1-5866bf97ddc7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.746213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.746147    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64xjh\" (UniqueName: \"kubernetes.io/projected/7888cc49-84e4-4c41-97e1-5866bf97ddc7-kube-api-access-64xjh\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.746388 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.746237    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7888cc49-84e4-4c41-97e1-5866bf97ddc7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.748743 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.748718    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7888cc49-84e4-4c41-97e1-5866bf97ddc7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.765924 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.765890    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xjh\" (UniqueName: \"kubernetes.io/projected/7888cc49-84e4-4c41-97e1-5866bf97ddc7-kube-api-access-64xjh\") pod \"servicemesh-operator3-55f49c5f94-twgvd\" (UID: \"7888cc49-84e4-4c41-97e1-5866bf97ddc7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:53.881705 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:53.881673    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:54.054712 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:54.054681    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"]
May 21 18:27:54.075246 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:27:54.075217    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7888cc49_84e4_4c41_97e1_5866bf97ddc7.slice/crio-0abe885f11d3c55982c0881fb70998a1cee0161ff21286a1d05f9daf5bc716ff WatchSource:0}: Error finding container 0abe885f11d3c55982c0881fb70998a1cee0161ff21286a1d05f9daf5bc716ff: Status 404 returned error can't find the container with id 0abe885f11d3c55982c0881fb70998a1cee0161ff21286a1d05f9daf5bc716ff
May 21 18:27:54.309883 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:54.309843    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd" event={"ID":"7888cc49-84e4-4c41-97e1-5866bf97ddc7","Type":"ContainerStarted","Data":"0abe885f11d3c55982c0881fb70998a1cee0161ff21286a1d05f9daf5bc716ff"}
May 21 18:27:54.312028 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:54.311994    2557 generic.go:358] "Generic (PLEG): container finished" podID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerID="700136871c15866e0de5669151aef505c8c361913e81edd1f90e8e3c6cf45f56" exitCode=0
May 21 18:27:54.312199 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:54.312080    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl" event={"ID":"ce57064e-b568-466c-86f4-e1bb69c79b82","Type":"ContainerDied","Data":"700136871c15866e0de5669151aef505c8c361913e81edd1f90e8e3c6cf45f56"}
May 21 18:27:55.318718 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:55.318668    2557 generic.go:358] "Generic (PLEG): container finished" podID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerID="e6fbf4cbd3b3561032e9ad66d16e5eaa74bf78afe03457d3ed64d9914503db60" exitCode=0
May 21 18:27:55.319230 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:55.318745    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl" event={"ID":"ce57064e-b568-466c-86f4-e1bb69c79b82","Type":"ContainerDied","Data":"e6fbf4cbd3b3561032e9ad66d16e5eaa74bf78afe03457d3ed64d9914503db60"}
May 21 18:27:57.015179 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.015147    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:57.075818 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.075796    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle\") pod \"ce57064e-b568-466c-86f4-e1bb69c79b82\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") "
May 21 18:27:57.075896 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.075833    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw45k\" (UniqueName: \"kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k\") pod \"ce57064e-b568-466c-86f4-e1bb69c79b82\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") "
May 21 18:27:57.075896 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.075894    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util\") pod \"ce57064e-b568-466c-86f4-e1bb69c79b82\" (UID: \"ce57064e-b568-466c-86f4-e1bb69c79b82\") "
May 21 18:27:57.076644 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.076616    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle" (OuterVolumeSpecName: "bundle") pod "ce57064e-b568-466c-86f4-e1bb69c79b82" (UID: "ce57064e-b568-466c-86f4-e1bb69c79b82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:57.078019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.077997    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k" (OuterVolumeSpecName: "kube-api-access-zw45k") pod "ce57064e-b568-466c-86f4-e1bb69c79b82" (UID: "ce57064e-b568-466c-86f4-e1bb69c79b82"). InnerVolumeSpecName "kube-api-access-zw45k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:27:57.083156 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.083129    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util" (OuterVolumeSpecName: "util") pod "ce57064e-b568-466c-86f4-e1bb69c79b82" (UID: "ce57064e-b568-466c-86f4-e1bb69c79b82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:27:57.176598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.176565    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:57.176598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.176594    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce57064e-b568-466c-86f4-e1bb69c79b82-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:57.176598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.176603    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw45k\" (UniqueName: \"kubernetes.io/projected/ce57064e-b568-466c-86f4-e1bb69c79b82-kube-api-access-zw45k\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:27:57.328828 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.328722    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd" event={"ID":"7888cc49-84e4-4c41-97e1-5866bf97ddc7","Type":"ContainerStarted","Data":"8dd7673ac1a515d05c6aa51b9f637b77e3c7cdfe226f0a86050cbe4a584e31ef"}
May 21 18:27:57.328991 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.328814    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:27:57.331043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.331001    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl"
May 21 18:27:57.331043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.331021    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahlbbl" event={"ID":"ce57064e-b568-466c-86f4-e1bb69c79b82","Type":"ContainerDied","Data":"b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e"}
May 21 18:27:57.331252 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.331052    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b46a0b85fc1b36aa1ad6c0c2e318c156eb76c00435cd6ba159c1c3296812713e"
May 21 18:27:57.351543 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:27:57.351479    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd" podStartSLOduration=1.365922162 podStartE2EDuration="4.351457711s" podCreationTimestamp="2026-05-21 18:27:53 +0000 UTC" firstStartedPulling="2026-05-21 18:27:54.079196982 +0000 UTC m=+454.872045230" lastFinishedPulling="2026-05-21 18:27:57.064732541 +0000 UTC m=+457.857580779" observedRunningTime="2026-05-21 18:27:57.34977335 +0000 UTC m=+458.142621631" watchObservedRunningTime="2026-05-21 18:27:57.351457711 +0000 UTC m=+458.144305963"
May 21 18:28:02.569890 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:02.569850    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:28:02.570321 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:02.570291    2557 scope.go:117] "RemoveContainer" containerID="5fc3107d71c7a50840680ddea557506158f8af8c7916838f964b8e68a24300e7"
May 21 18:28:03.356222 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.356180    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" event={"ID":"ede0a427-21d5-4956-a80e-04a908fb9112","Type":"ContainerStarted","Data":"6ea5685a3c204aafd9ed2b1c67fc6dd13dda2093cfa573134efdae97f0253943"}
May 21 18:28:03.357557 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.357501    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:28:03.377749 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.377689    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58" podStartSLOduration=2.245684495 podStartE2EDuration="22.377673782s" podCreationTimestamp="2026-05-21 18:27:41 +0000 UTC" firstStartedPulling="2026-05-21 18:27:42.703437249 +0000 UTC m=+443.496285485" lastFinishedPulling="2026-05-21 18:28:02.835426524 +0000 UTC m=+463.628274772" observedRunningTime="2026-05-21 18:28:03.375132438 +0000 UTC m=+464.167980717" watchObservedRunningTime="2026-05-21 18:28:03.377673782 +0000 UTC m=+464.170522039"
May 21 18:28:03.811200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811098    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"]
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811432    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="util"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811443    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="util"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811449    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="pull"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811455    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="pull"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811471    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="extract"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811476    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="extract"
May 21 18:28:03.811633 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.811531    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce57064e-b568-466c-86f4-e1bb69c79b82" containerName="extract"
May 21 18:28:03.814608 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.814582    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.817860 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.817836    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 18:28:03.818132 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.818110    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 18:28:03.818300 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.818133    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 18:28:03.818300 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.818156    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rgnt8\""
May 21 18:28:03.818300 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.818157    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 18:28:03.829650 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.829617    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"]
May 21 18:28:03.937562 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clb5s\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-kube-api-access-clb5s\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937562 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937813 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937813 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937879 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937879 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a11921-3f2b-451e-beb3-bb0b78208822-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:03.937955 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:03.937892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.038833 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.038799    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.038839    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a11921-3f2b-451e-beb3-bb0b78208822-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.038861    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.038886    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clb5s\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-kube-api-access-clb5s\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.039071    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039198 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.039158    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039303 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.039210    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.039553 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.039531    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.041674 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.041648    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.041795 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.041650    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a11921-3f2b-451e-beb3-bb0b78208822-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.041895 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.041878    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.041945 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.041886    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.050428 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.050398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.050588 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.050570    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clb5s\" (UniqueName: \"kubernetes.io/projected/f5a11921-3f2b-451e-beb3-bb0b78208822-kube-api-access-clb5s\") pod \"istiod-openshift-gateway-798958bb55-zm687\" (UID: \"f5a11921-3f2b-451e-beb3-bb0b78208822\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.125085 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.125046    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:04.307386 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.307086    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"]
May 21 18:28:04.312858 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:04.312827    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a11921_3f2b_451e_beb3_bb0b78208822.slice/crio-810a90c6b8aa1ca60687b57ab35a80afb03c35aea474c95e13076e816b3bd424 WatchSource:0}: Error finding container 810a90c6b8aa1ca60687b57ab35a80afb03c35aea474c95e13076e816b3bd424: Status 404 returned error can't find the container with id 810a90c6b8aa1ca60687b57ab35a80afb03c35aea474c95e13076e816b3bd424
May 21 18:28:04.362143 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:04.362103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687" event={"ID":"f5a11921-3f2b-451e-beb3-bb0b78208822","Type":"ContainerStarted","Data":"810a90c6b8aa1ca60687b57ab35a80afb03c35aea474c95e13076e816b3bd424"}
May 21 18:28:06.837120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:06.837083    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:28:06.837551 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:06.837148    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:28:07.376716 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:07.376683    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687" event={"ID":"f5a11921-3f2b-451e-beb3-bb0b78208822","Type":"ContainerStarted","Data":"6879da2fd70cb9f0e6094dcba6601c48d6999bb0d90a164782cb6dfe21157f13"}
May 21 18:28:07.376929 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:07.376832    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:07.378731 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:07.378685    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-zm687 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 18:28:07.378890 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:07.378759    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687" podUID="f5a11921-3f2b-451e-beb3-bb0b78208822" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 18:28:07.403691 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:07.403640    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687" podStartSLOduration=1.881671469 podStartE2EDuration="4.403626683s" podCreationTimestamp="2026-05-21 18:28:03 +0000 UTC" firstStartedPulling="2026-05-21 18:28:04.31490489 +0000 UTC m=+465.107753126" lastFinishedPulling="2026-05-21 18:28:06.836860091 +0000 UTC m=+467.629708340" observedRunningTime="2026-05-21 18:28:07.40135848 +0000 UTC m=+468.194206738" watchObservedRunningTime="2026-05-21 18:28:07.403626683 +0000 UTC m=+468.196474939"
May 21 18:28:08.337938 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:08.337902    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-twgvd"
May 21 18:28:08.382746 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:08.382707    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-zm687 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 18:28:08.382947 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:08.382805    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687" podUID="f5a11921-3f2b-451e-beb3-bb0b78208822" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 18:28:11.383069 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:11.383032    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zm687"
May 21 18:28:14.364288 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:14.364256    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-fcn58"
May 21 18:28:24.317605 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:24.317550    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-kzzqm"
May 21 18:28:44.677620 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.677562    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-764854694f-hsjgt"]
May 21 18:28:44.686571 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.686538    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.693939 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.693876    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764854694f-hsjgt"]
May 21 18:28:44.799928 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.799885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-service-ca\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.799928 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.799925    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fgj\" (UniqueName: \"kubernetes.io/projected/91e89fae-7b75-42f3-a46e-361c70f9d7b0-kube-api-access-24fgj\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.800144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.800021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-trusted-ca-bundle\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.800144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.800079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-oauth-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.800144 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.800124    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-oauth-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.800283 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.800153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.800283 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.800224    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.900991 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.900950    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901011    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-service-ca\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901038    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24fgj\" (UniqueName: \"kubernetes.io/projected/91e89fae-7b75-42f3-a46e-361c70f9d7b0-kube-api-access-24fgj\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901102    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-trusted-ca-bundle\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901151    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-oauth-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901218 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901211    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-oauth-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901485 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901238    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.901993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.901966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-oauth-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.902119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.902033    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.902119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.902083    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-trusted-ca-bundle\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.902245 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.902117    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91e89fae-7b75-42f3-a46e-361c70f9d7b0-service-ca\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.903745 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.903713    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-oauth-config\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.903837 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.903745    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91e89fae-7b75-42f3-a46e-361c70f9d7b0-console-serving-cert\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.909910 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.909886    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fgj\" (UniqueName: \"kubernetes.io/projected/91e89fae-7b75-42f3-a46e-361c70f9d7b0-kube-api-access-24fgj\") pod \"console-764854694f-hsjgt\" (UID: \"91e89fae-7b75-42f3-a46e-361c70f9d7b0\") " pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:44.999193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:44.999077    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:45.144362 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:45.144333    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764854694f-hsjgt"]
May 21 18:28:45.145647 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:45.145618    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e89fae_7b75_42f3_a46e_361c70f9d7b0.slice/crio-c1408226d9ab44259394a206ce8ca2b2d75404410824b5220a13409b837f529b WatchSource:0}: Error finding container c1408226d9ab44259394a206ce8ca2b2d75404410824b5220a13409b837f529b: Status 404 returned error can't find the container with id c1408226d9ab44259394a206ce8ca2b2d75404410824b5220a13409b837f529b
May 21 18:28:45.522483 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:45.522449    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764854694f-hsjgt" event={"ID":"91e89fae-7b75-42f3-a46e-361c70f9d7b0","Type":"ContainerStarted","Data":"65bac90848e222c2e11e5d936ba28e510dab39c2795ec0954e62daa04f94d2de"}
May 21 18:28:45.522483 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:45.522484    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764854694f-hsjgt" event={"ID":"91e89fae-7b75-42f3-a46e-361c70f9d7b0","Type":"ContainerStarted","Data":"c1408226d9ab44259394a206ce8ca2b2d75404410824b5220a13409b837f529b"}
May 21 18:28:45.548656 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:45.548604    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-764854694f-hsjgt" podStartSLOduration=1.548590817 podStartE2EDuration="1.548590817s" podCreationTimestamp="2026-05-21 18:28:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:28:45.547294969 +0000 UTC m=+506.340143259" watchObservedRunningTime="2026-05-21 18:28:45.548590817 +0000 UTC m=+506.341439073"
May 21 18:28:53.662362 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.662323    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"]
May 21 18:28:53.666077 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.666058    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.668312 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.668290    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:28:53.668428 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.668318    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:28:53.668692 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.668677    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pcmr\""
May 21 18:28:53.674405 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.674137    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"]
May 21 18:28:53.777573 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.777536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2qg\" (UniqueName: \"kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.777573 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.777605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.777824 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.777626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.878502 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.878463    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.878697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.878570    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2qg\" (UniqueName: \"kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.878697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.878617    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.878954 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.878931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.879024 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.878975    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.887584 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.887558    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2qg\" (UniqueName: \"kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:53.977294 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:53.977195    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:54.111658 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.111632    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"]
May 21 18:28:54.113855 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:54.113817    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5738c0_9626_4a9e_9c57_eee5728aaf72.slice/crio-b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7 WatchSource:0}: Error finding container b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7: Status 404 returned error can't find the container with id b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7
May 21 18:28:54.278320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.278244    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"]
May 21 18:28:54.281848 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.281825    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.291036 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.291002    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"]
May 21 18:28:54.383811 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.383773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqckj\" (UniqueName: \"kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.383811 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.383815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.384030 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.383910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.484634 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.484593    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqckj\" (UniqueName: \"kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.484794 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.484641    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.484794 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.484718    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.485121 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.485099    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.485239 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.485146    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.493455 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.493432    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqckj\" (UniqueName: \"kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.555264 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.555144    2557 generic.go:358] "Generic (PLEG): container finished" podID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerID="b4398990098e769385753738f0d85b698e122a434cda94785773b837e87535fa" exitCode=0
May 21 18:28:54.555264 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.555227    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c" event={"ID":"7e5738c0-9626-4a9e-9c57-eee5728aaf72","Type":"ContainerDied","Data":"b4398990098e769385753738f0d85b698e122a434cda94785773b837e87535fa"}
May 21 18:28:54.555264 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.555263    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c" event={"ID":"7e5738c0-9626-4a9e-9c57-eee5728aaf72","Type":"ContainerStarted","Data":"b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7"}
May 21 18:28:54.597355 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.597318    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:54.664856 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.664824    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"]
May 21 18:28:54.669765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.669737    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.675362 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.675334    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"]
May 21 18:28:54.731178 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.731138    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"]
May 21 18:28:54.732815 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:54.732786    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7397b62e_3e22_4005_ad71_69c3f962cc45.slice/crio-6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea WatchSource:0}: Error finding container 6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea: Status 404 returned error can't find the container with id 6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea
May 21 18:28:54.787019 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.786998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.787075 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.787045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxrx\" (UniqueName: \"kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.787111 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.787103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.887582 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.887544    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.887767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.887606    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.887767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.887638    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxrx\" (UniqueName: \"kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.887993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.887972    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.887993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.887985    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.896990 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.896949    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxrx\" (UniqueName: \"kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:54.981330 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:54.981290    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:55.000214 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.000137    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:55.000214 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.000200    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:55.004967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.004906    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:55.070846 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.070806    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"]
May 21 18:28:55.074335 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.074310    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.083620 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.083359    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"]
May 21 18:28:55.121399 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.121372    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"]
May 21 18:28:55.187532 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:55.187494    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c344b5_34f6_4b06_bc25_c2fceedbd29a.slice/crio-6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338 WatchSource:0}: Error finding container 6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338: Status 404 returned error can't find the container with id 6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338
May 21 18:28:55.191436 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.191399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9g26\" (UniqueName: \"kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.191598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.191517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.191598 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.191563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.292754 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.292729    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9g26\" (UniqueName: \"kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.292858 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.292821    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.292923 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.292863    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.293316 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.293296    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.293409 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.293294    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.300826 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.300799    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9g26\" (UniqueName: \"kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.387905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.387874    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:55.518312 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.518285    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"]
May 21 18:28:55.520251 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:28:55.520222    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c26120_7fa9_46a3_914c_5a589bd6e899.slice/crio-3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775 WatchSource:0}: Error finding container 3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775: Status 404 returned error can't find the container with id 3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775
May 21 18:28:55.561044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.561017    2557 generic.go:358] "Generic (PLEG): container finished" podID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerID="e937ac5cf72af488f3e76e3e29c896de330e0667a96bb3405383a7e0fff849e5" exitCode=0
May 21 18:28:55.561189 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.561122    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64" event={"ID":"7397b62e-3e22-4005-ad71-69c3f962cc45","Type":"ContainerDied","Data":"e937ac5cf72af488f3e76e3e29c896de330e0667a96bb3405383a7e0fff849e5"}
May 21 18:28:55.561257 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.561200    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64" event={"ID":"7397b62e-3e22-4005-ad71-69c3f962cc45","Type":"ContainerStarted","Data":"6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea"}
May 21 18:28:55.566080 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.566057    2557 generic.go:358] "Generic (PLEG): container finished" podID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerID="32ca28bc93eb5f8861025b37cf3a2ee16bffd6c5db2c1756c68bde870f133665" exitCode=0
May 21 18:28:55.566207 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.566156    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r" event={"ID":"d2c344b5-34f6-4b06-bc25-c2fceedbd29a","Type":"ContainerDied","Data":"32ca28bc93eb5f8861025b37cf3a2ee16bffd6c5db2c1756c68bde870f133665"}
May 21 18:28:55.566271 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.566228    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r" event={"ID":"d2c344b5-34f6-4b06-bc25-c2fceedbd29a","Type":"ContainerStarted","Data":"6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338"}
May 21 18:28:55.567802 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.567780    2557 generic.go:358] "Generic (PLEG): container finished" podID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerID="04c2b023f42224fd52474f66531ceac79734a264340ce809d6d96e85fcd865c0" exitCode=0
May 21 18:28:55.567892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.567857    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c" event={"ID":"7e5738c0-9626-4a9e-9c57-eee5728aaf72","Type":"ContainerDied","Data":"04c2b023f42224fd52474f66531ceac79734a264340ce809d6d96e85fcd865c0"}
May 21 18:28:55.569147 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.569126    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5" event={"ID":"32c26120-7fa9-46a3-914c-5a589bd6e899","Type":"ContainerStarted","Data":"3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775"}
May 21 18:28:55.573468 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.573443    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-764854694f-hsjgt"
May 21 18:28:55.654748 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:55.654712    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:28:56.574392 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.574353    2557 generic.go:358] "Generic (PLEG): container finished" podID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerID="d489fbc59b4619acd22672bfb06cdb298419f384b18d654df8dc1bfcd520905e" exitCode=0
May 21 18:28:56.574821 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.574413    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5" event={"ID":"32c26120-7fa9-46a3-914c-5a589bd6e899","Type":"ContainerDied","Data":"d489fbc59b4619acd22672bfb06cdb298419f384b18d654df8dc1bfcd520905e"}
May 21 18:28:56.576254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.576232    2557 generic.go:358] "Generic (PLEG): container finished" podID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerID="b0af02e4eb8414d8554f574197a93436511cc948573aa1ee3609684d63cc5285" exitCode=0
May 21 18:28:56.576346 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.576280    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64" event={"ID":"7397b62e-3e22-4005-ad71-69c3f962cc45","Type":"ContainerDied","Data":"b0af02e4eb8414d8554f574197a93436511cc948573aa1ee3609684d63cc5285"}
May 21 18:28:56.578061 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.578041    2557 generic.go:358] "Generic (PLEG): container finished" podID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerID="4e0bdf3acc6d8d54f070895bd642d9c30b5615be973183977496222722beb026" exitCode=0
May 21 18:28:56.578142 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.578115    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r" event={"ID":"d2c344b5-34f6-4b06-bc25-c2fceedbd29a","Type":"ContainerDied","Data":"4e0bdf3acc6d8d54f070895bd642d9c30b5615be973183977496222722beb026"}
May 21 18:28:56.580213 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.580196    2557 generic.go:358] "Generic (PLEG): container finished" podID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerID="ba1a927c8d86a406be229a8e07fd07bc227ff55fa0d5b22827871b33d6bb75f1" exitCode=0
May 21 18:28:56.580311 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:56.580273    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c" event={"ID":"7e5738c0-9626-4a9e-9c57-eee5728aaf72","Type":"ContainerDied","Data":"ba1a927c8d86a406be229a8e07fd07bc227ff55fa0d5b22827871b33d6bb75f1"}
May 21 18:28:57.586154 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.586118    2557 generic.go:358] "Generic (PLEG): container finished" podID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerID="21fb4f743809e57f1ae03716d70456e5bb59574c47d0b59f477c9431c4362855" exitCode=0
May 21 18:28:57.586547 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.586206    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5" event={"ID":"32c26120-7fa9-46a3-914c-5a589bd6e899","Type":"ContainerDied","Data":"21fb4f743809e57f1ae03716d70456e5bb59574c47d0b59f477c9431c4362855"}
May 21 18:28:57.588311 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.588290    2557 generic.go:358] "Generic (PLEG): container finished" podID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerID="91974a409b338cd46ec5c40da1526fa4058dd8317ede600b846631f19e8eb686" exitCode=0
May 21 18:28:57.588400 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.588353    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64" event={"ID":"7397b62e-3e22-4005-ad71-69c3f962cc45","Type":"ContainerDied","Data":"91974a409b338cd46ec5c40da1526fa4058dd8317ede600b846631f19e8eb686"}
May 21 18:28:57.590121 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.590100    2557 generic.go:358] "Generic (PLEG): container finished" podID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerID="84297be3fff7f048f069222e08d150dd666d4a5d22e1fb838aff6527e08f4325" exitCode=0
May 21 18:28:57.590238 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.590187    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r" event={"ID":"d2c344b5-34f6-4b06-bc25-c2fceedbd29a","Type":"ContainerDied","Data":"84297be3fff7f048f069222e08d150dd666d4a5d22e1fb838aff6527e08f4325"}
May 21 18:28:57.715077 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.715052    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:57.815276 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.815239    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr2qg\" (UniqueName: \"kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg\") pod \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") "
May 21 18:28:57.815430 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.815316    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle\") pod \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") "
May 21 18:28:57.815430 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.815380    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util\") pod \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\" (UID: \"7e5738c0-9626-4a9e-9c57-eee5728aaf72\") "
May 21 18:28:57.815784 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.815758    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle" (OuterVolumeSpecName: "bundle") pod "7e5738c0-9626-4a9e-9c57-eee5728aaf72" (UID: "7e5738c0-9626-4a9e-9c57-eee5728aaf72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:57.817474 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.817452    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg" (OuterVolumeSpecName: "kube-api-access-lr2qg") pod "7e5738c0-9626-4a9e-9c57-eee5728aaf72" (UID: "7e5738c0-9626-4a9e-9c57-eee5728aaf72"). InnerVolumeSpecName "kube-api-access-lr2qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:28:57.821055 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.821028    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util" (OuterVolumeSpecName: "util") pod "7e5738c0-9626-4a9e-9c57-eee5728aaf72" (UID: "7e5738c0-9626-4a9e-9c57-eee5728aaf72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:57.916803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.916761    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr2qg\" (UniqueName: \"kubernetes.io/projected/7e5738c0-9626-4a9e-9c57-eee5728aaf72-kube-api-access-lr2qg\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:57.916803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.916797    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:57.916803 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:57.916805    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5738c0-9626-4a9e-9c57-eee5728aaf72-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.595955 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.595917    2557 generic.go:358] "Generic (PLEG): container finished" podID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerID="cb67c420a06b521a7bcc0d51d1289b637b7cfa90fb3b6aded954c8cdbfa7e43c" exitCode=0
May 21 18:28:58.596362 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.596033    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5" event={"ID":"32c26120-7fa9-46a3-914c-5a589bd6e899","Type":"ContainerDied","Data":"cb67c420a06b521a7bcc0d51d1289b637b7cfa90fb3b6aded954c8cdbfa7e43c"}
May 21 18:28:58.597747 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.597722    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c"
May 21 18:28:58.597875 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.597727    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c" event={"ID":"7e5738c0-9626-4a9e-9c57-eee5728aaf72","Type":"ContainerDied","Data":"b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7"}
May 21 18:28:58.597875 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.597813    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0e12ceda80f2bb4f0d85f0bd2e2b8a989368a4c979035482bb604bea697c0b7"
May 21 18:28:58.738532 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.738509    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:58.767719 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.767695    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:58.825305 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825274    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util\") pod \"7397b62e-3e22-4005-ad71-69c3f962cc45\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") "
May 21 18:28:58.825459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825345    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle\") pod \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") "
May 21 18:28:58.825459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825398    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqckj\" (UniqueName: \"kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj\") pod \"7397b62e-3e22-4005-ad71-69c3f962cc45\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") "
May 21 18:28:58.825459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825424    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle\") pod \"7397b62e-3e22-4005-ad71-69c3f962cc45\" (UID: \"7397b62e-3e22-4005-ad71-69c3f962cc45\") "
May 21 18:28:58.825631 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825611    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util\") pod \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") "
May 21 18:28:58.825710 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.825657    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdxrx\" (UniqueName: \"kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx\") pod \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\" (UID: \"d2c344b5-34f6-4b06-bc25-c2fceedbd29a\") "
May 21 18:28:58.826228 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.826200    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle" (OuterVolumeSpecName: "bundle") pod "d2c344b5-34f6-4b06-bc25-c2fceedbd29a" (UID: "d2c344b5-34f6-4b06-bc25-c2fceedbd29a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:58.826445 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.826407    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle" (OuterVolumeSpecName: "bundle") pod "7397b62e-3e22-4005-ad71-69c3f962cc45" (UID: "7397b62e-3e22-4005-ad71-69c3f962cc45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:58.827725 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.827701    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj" (OuterVolumeSpecName: "kube-api-access-jqckj") pod "7397b62e-3e22-4005-ad71-69c3f962cc45" (UID: "7397b62e-3e22-4005-ad71-69c3f962cc45"). InnerVolumeSpecName "kube-api-access-jqckj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:28:58.827868 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.827846    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx" (OuterVolumeSpecName: "kube-api-access-rdxrx") pod "d2c344b5-34f6-4b06-bc25-c2fceedbd29a" (UID: "d2c344b5-34f6-4b06-bc25-c2fceedbd29a"). InnerVolumeSpecName "kube-api-access-rdxrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:28:58.831102 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.831081    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util" (OuterVolumeSpecName: "util") pod "7397b62e-3e22-4005-ad71-69c3f962cc45" (UID: "7397b62e-3e22-4005-ad71-69c3f962cc45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:58.835038 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.835013    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util" (OuterVolumeSpecName: "util") pod "d2c344b5-34f6-4b06-bc25-c2fceedbd29a" (UID: "d2c344b5-34f6-4b06-bc25-c2fceedbd29a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:58.926471 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926432    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdxrx\" (UniqueName: \"kubernetes.io/projected/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-kube-api-access-rdxrx\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.926471 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926466    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.926471 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926478    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.926688 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926486    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqckj\" (UniqueName: \"kubernetes.io/projected/7397b62e-3e22-4005-ad71-69c3f962cc45-kube-api-access-jqckj\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.926688 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926495    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7397b62e-3e22-4005-ad71-69c3f962cc45-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:58.926688 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:58.926504    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c344b5-34f6-4b06-bc25-c2fceedbd29a-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:59.605217 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.605158    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64" event={"ID":"7397b62e-3e22-4005-ad71-69c3f962cc45","Type":"ContainerDied","Data":"6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea"}
May 21 18:28:59.605217 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.605202    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64"
May 21 18:28:59.605217 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.605216    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6be35c4b3cecad0b14479d2d039ce4fdafce1936e562a834ac041561615a12ea"
May 21 18:28:59.606820 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.606801    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r"
May 21 18:28:59.606940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.606829    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r" event={"ID":"d2c344b5-34f6-4b06-bc25-c2fceedbd29a","Type":"ContainerDied","Data":"6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338"}
May 21 18:28:59.606940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.606855    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6783c72dfba865f84811fd4c7894403136c379cea989c5f5a5ec927ce5d44338"
May 21 18:28:59.737270 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.737245    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:28:59.834394 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.834363    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util\") pod \"32c26120-7fa9-46a3-914c-5a589bd6e899\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") "
May 21 18:28:59.834566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.834432    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle\") pod \"32c26120-7fa9-46a3-914c-5a589bd6e899\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") "
May 21 18:28:59.834566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.834463    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9g26\" (UniqueName: \"kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26\") pod \"32c26120-7fa9-46a3-914c-5a589bd6e899\" (UID: \"32c26120-7fa9-46a3-914c-5a589bd6e899\") "
May 21 18:28:59.834899 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.834875    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle" (OuterVolumeSpecName: "bundle") pod "32c26120-7fa9-46a3-914c-5a589bd6e899" (UID: "32c26120-7fa9-46a3-914c-5a589bd6e899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:59.836627 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.836603    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26" (OuterVolumeSpecName: "kube-api-access-d9g26") pod "32c26120-7fa9-46a3-914c-5a589bd6e899" (UID: "32c26120-7fa9-46a3-914c-5a589bd6e899"). InnerVolumeSpecName "kube-api-access-d9g26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:28:59.842570 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.842542    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util" (OuterVolumeSpecName: "util") pod "32c26120-7fa9-46a3-914c-5a589bd6e899" (UID: "32c26120-7fa9-46a3-914c-5a589bd6e899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:28:59.935541 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.935430    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:59.935541 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.935504    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9g26\" (UniqueName: \"kubernetes.io/projected/32c26120-7fa9-46a3-914c-5a589bd6e899-kube-api-access-d9g26\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:28:59.935541 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:28:59.935517    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32c26120-7fa9-46a3-914c-5a589bd6e899-util\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:00.612235 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:00.612198    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5" event={"ID":"32c26120-7fa9-46a3-914c-5a589bd6e899","Type":"ContainerDied","Data":"3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775"}
May 21 18:29:00.612596 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:00.612239    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c840570601748667c24e051a7069933677bf8b51f13706a3a39e3c44e7e6775"
May 21 18:29:00.612596 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:00.612272    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5"
May 21 18:29:11.672747 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.672670    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"]
May 21 18:29:11.673091 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673062    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="extract"
May 21 18:29:11.673091 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673075    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="extract"
May 21 18:29:11.673091 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673086    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="util"
May 21 18:29:11.673091 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673091    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673100    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673105    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673112    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673117    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673124    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673129    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673141    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673147    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673154    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673160    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673180    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673185    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673195    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673199    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="extract"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673205    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673209    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="pull"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673216    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673222    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673230    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="util"
May 21 18:29:11.673262 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673234    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="util"
May 21 18:29:11.673855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673283    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e5738c0-9626-4a9e-9c57-eee5728aaf72" containerName="extract"
May 21 18:29:11.673855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673295    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2c344b5-34f6-4b06-bc25-c2fceedbd29a" containerName="extract"
May 21 18:29:11.673855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673304    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7397b62e-3e22-4005-ad71-69c3f962cc45" containerName="extract"
May 21 18:29:11.673855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.673313    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="32c26120-7fa9-46a3-914c-5a589bd6e899" containerName="extract"
May 21 18:29:11.676588 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.676567    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.679799 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.679779    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:29:11.679892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.679872    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cjk2z\""
May 21 18:29:11.692020 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.691991    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"]
May 21 18:29:11.703415 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.703386    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:29:11.847325 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.847290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjn9\" (UniqueName: \"kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.847509 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.847457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.948610 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.948522    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.948610 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.948572    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjn9\" (UniqueName: \"kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.948936 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.948913    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.962636 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.962610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjn9\" (UniqueName: \"kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:11.986563 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:11.986521    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:12.123096 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:12.123029    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"]
May 21 18:29:12.126283 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:29:12.126240    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd939f95_9cd4_4912_82db_d39b66db29e1.slice/crio-03299ca2a8512fa3d017b1ebeb28d10ce9413837d990405670d3702c9375516e WatchSource:0}: Error finding container 03299ca2a8512fa3d017b1ebeb28d10ce9413837d990405670d3702c9375516e: Status 404 returned error can't find the container with id 03299ca2a8512fa3d017b1ebeb28d10ce9413837d990405670d3702c9375516e
May 21 18:29:12.663534 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:12.663502    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x" event={"ID":"fd939f95-9cd4-4912-82db-d39b66db29e1","Type":"ContainerStarted","Data":"03299ca2a8512fa3d017b1ebeb28d10ce9413837d990405670d3702c9375516e"}
May 21 18:29:18.691133 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:18.691095    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x" event={"ID":"fd939f95-9cd4-4912-82db-d39b66db29e1","Type":"ContainerStarted","Data":"39a3d6a24e7aadcf15fee215f646de01320349ca2eb9da421e8968665a35f3e6"}
May 21 18:29:18.691569 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:18.691226    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:18.716006 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:18.715934    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x" podStartSLOduration=1.756415837 podStartE2EDuration="7.715914729s" podCreationTimestamp="2026-05-21 18:29:11 +0000 UTC" firstStartedPulling="2026-05-21 18:29:12.12856733 +0000 UTC m=+532.921415565" lastFinishedPulling="2026-05-21 18:29:18.088066218 +0000 UTC m=+538.880914457" observedRunningTime="2026-05-21 18:29:18.712880858 +0000 UTC m=+539.505729125" watchObservedRunningTime="2026-05-21 18:29:18.715914729 +0000 UTC m=+539.508762987"
May 21 18:29:20.680108 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.680065    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75ff655f9b-s28ff" podUID="a6d19131-9ddc-4ec0-83db-79b5adad4276" containerName="console" containerID="cri-o://3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888" gracePeriod=15
May 21 18:29:20.925299 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.925278    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75ff655f9b-s28ff_a6d19131-9ddc-4ec0-83db-79b5adad4276/console/0.log"
May 21 18:29:20.925433 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.925339    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:29:20.932447 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932392    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932518 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932458    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932553 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932514    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932656 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932633    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzjvh\" (UniqueName: \"kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932697 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932683    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932737 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932714    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932793 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932770    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:29:20.932854 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932802    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca\") pod \"a6d19131-9ddc-4ec0-83db-79b5adad4276\" (UID: \"a6d19131-9ddc-4ec0-83db-79b5adad4276\") "
May 21 18:29:20.932854 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.932844    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:29:20.933058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.933036    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:20.933159 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.933061    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:20.933280 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.933181    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config" (OuterVolumeSpecName: "console-config") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:29:20.933343 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.933304    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:29:20.934813 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.934770    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:29:20.934911 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.934850    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh" (OuterVolumeSpecName: "kube-api-access-nzjvh") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "kube-api-access-nzjvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:29:20.935148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:20.935124    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6d19131-9ddc-4ec0-83db-79b5adad4276" (UID: "a6d19131-9ddc-4ec0-83db-79b5adad4276"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:29:21.034070 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.034026    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:21.034070 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.034065    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzjvh\" (UniqueName: \"kubernetes.io/projected/a6d19131-9ddc-4ec0-83db-79b5adad4276-kube-api-access-nzjvh\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:21.034070 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.034075    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:21.034332 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.034085    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:21.034332 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.034096    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d19131-9ddc-4ec0-83db-79b5adad4276-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:21.704095 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704064    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75ff655f9b-s28ff_a6d19131-9ddc-4ec0-83db-79b5adad4276/console/0.log"
May 21 18:29:21.704522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704110    2557 generic.go:358] "Generic (PLEG): container finished" podID="a6d19131-9ddc-4ec0-83db-79b5adad4276" containerID="3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888" exitCode=2
May 21 18:29:21.704522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff655f9b-s28ff" event={"ID":"a6d19131-9ddc-4ec0-83db-79b5adad4276","Type":"ContainerDied","Data":"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"}
May 21 18:29:21.704522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704246    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff655f9b-s28ff" event={"ID":"a6d19131-9ddc-4ec0-83db-79b5adad4276","Type":"ContainerDied","Data":"cc107baf6d0057a16b83a0171398d7c61d52e93c64d0b67acab68d67e48f6a89"}
May 21 18:29:21.704522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704262    2557 scope.go:117] "RemoveContainer" containerID="3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"
May 21 18:29:21.704522 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.704209    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff655f9b-s28ff"
May 21 18:29:21.713931 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.713904    2557 scope.go:117] "RemoveContainer" containerID="3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"
May 21 18:29:21.714242 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:29:21.714223    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888\": container with ID starting with 3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888 not found: ID does not exist" containerID="3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"
May 21 18:29:21.714304 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.714252    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888"} err="failed to get container status \"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888\": rpc error: code = NotFound desc = could not find container \"3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888\": container with ID starting with 3fc1f4d2e608a7e9fe1d92d5cdb7a86db109259b998c1ca0818992ccc1d9a888 not found: ID does not exist"
May 21 18:29:21.731015 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.730978    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:29:21.738662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.738624    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75ff655f9b-s28ff"]
May 21 18:29:21.765980 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:21.765946    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d19131-9ddc-4ec0-83db-79b5adad4276" path="/var/lib/kubelet/pods/a6d19131-9ddc-4ec0-83db-79b5adad4276/volumes"
May 21 18:29:29.698194 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:29.698132    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:31.531724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.531683    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"]
May 21 18:29:31.532136 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.531899    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" containerName="manager" containerID="cri-o://39a3d6a24e7aadcf15fee215f646de01320349ca2eb9da421e8968665a35f3e6" gracePeriod=2
May 21 18:29:31.541996 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.541969    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"]
May 21 18:29:31.560550 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.560521    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:31.561007 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.560992    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d19131-9ddc-4ec0-83db-79b5adad4276" containerName="console"
May 21 18:29:31.561044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.561011    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d19131-9ddc-4ec0-83db-79b5adad4276" containerName="console"
May 21 18:29:31.561044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.561033    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" containerName="manager"
May 21 18:29:31.561044 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.561042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" containerName="manager"
May 21 18:29:31.561152 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.561128    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" containerName="manager"
May 21 18:29:31.561152 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.561141    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6d19131-9ddc-4ec0-83db-79b5adad4276" containerName="console"
May 21 18:29:31.564611 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.564591    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.567436 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.567400    2557 status_manager.go:895] "Failed to get status for pod" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-g2d9x\" is forbidden: User \"system:node:ip-10-0-138-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-250.ec2.internal' and this object"
May 21 18:29:31.579418 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.579390    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:31.630896 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.630864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.631053 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.630903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh56z\" (UniqueName: \"kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.731826 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.731794    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.731987 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.731836    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh56z\" (UniqueName: \"kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.732155 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.732133    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.746279 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.746250    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh56z\" (UniqueName: \"kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gptsk\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.746987 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.746964    2557 generic.go:358] "Generic (PLEG): container finished" podID="fd939f95-9cd4-4912-82db-d39b66db29e1" containerID="39a3d6a24e7aadcf15fee215f646de01320349ca2eb9da421e8968665a35f3e6" exitCode=0
May 21 18:29:31.770383 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.770359    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:31.832855 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.832768    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjjn9\" (UniqueName: \"kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9\") pod \"fd939f95-9cd4-4912-82db-d39b66db29e1\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") "
May 21 18:29:31.832986 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.832889    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume\") pod \"fd939f95-9cd4-4912-82db-d39b66db29e1\" (UID: \"fd939f95-9cd4-4912-82db-d39b66db29e1\") "
May 21 18:29:31.833285 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.833263    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd939f95-9cd4-4912-82db-d39b66db29e1" (UID: "fd939f95-9cd4-4912-82db-d39b66db29e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:29:31.834877 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.834848    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9" (OuterVolumeSpecName: "kube-api-access-bjjn9") pod "fd939f95-9cd4-4912-82db-d39b66db29e1" (UID: "fd939f95-9cd4-4912-82db-d39b66db29e1"). InnerVolumeSpecName "kube-api-access-bjjn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:29:31.917010 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.916971    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:31.934315 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.934278    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjjn9\" (UniqueName: \"kubernetes.io/projected/fd939f95-9cd4-4912-82db-d39b66db29e1-kube-api-access-bjjn9\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:31.934427 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:31.934323    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd939f95-9cd4-4912-82db-d39b66db29e1-extensions-socket-volume\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:32.063813 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.063783    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:32.064548 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:29:32.064513    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf315ff58_354b_475a_85a1_dd199a820cb8.slice/crio-ae76c265fdd31465c4cca30cd896e110d03fe52d901a7231d172c01d5d2ec095 WatchSource:0}: Error finding container ae76c265fdd31465c4cca30cd896e110d03fe52d901a7231d172c01d5d2ec095: Status 404 returned error can't find the container with id ae76c265fdd31465c4cca30cd896e110d03fe52d901a7231d172c01d5d2ec095
May 21 18:29:32.756225 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.756190    2557 scope.go:117] "RemoveContainer" containerID="39a3d6a24e7aadcf15fee215f646de01320349ca2eb9da421e8968665a35f3e6"
May 21 18:29:32.756680 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.756185    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g2d9x"
May 21 18:29:32.758625 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.758602    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:29:32.762083 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.762059    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" event={"ID":"f315ff58-354b-475a-85a1-dd199a820cb8","Type":"ContainerStarted","Data":"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"}
May 21 18:29:32.762197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.762085    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" event={"ID":"f315ff58-354b-475a-85a1-dd199a820cb8","Type":"ContainerStarted","Data":"ae76c265fdd31465c4cca30cd896e110d03fe52d901a7231d172c01d5d2ec095"}
May 21 18:29:32.762197 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.762106    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:32.762276 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.762217    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.799028 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.798994    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:29:32.802894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.802838    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" podStartSLOduration=1.8028193529999998 podStartE2EDuration="1.802819353s" podCreationTimestamp="2026-05-21 18:29:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:29:32.802500013 +0000 UTC m=+553.595348272" watchObservedRunningTime="2026-05-21 18:29:32.802819353 +0000 UTC m=+553.595667612"
May 21 18:29:32.843224 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.843147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.843406 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.843244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbn2\" (UniqueName: \"kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.944446 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.944410    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbn2\" (UniqueName: \"kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.944617 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.944539    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.944960 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.944942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:32.955685 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:32.955654    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbn2\" (UniqueName: \"kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nrxkz\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:33.074235 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.074125    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:33.243529 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.243496    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:29:33.244337 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:29:33.244313    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcebebee_4b50_482a_9e43_dc57018dd192.slice/crio-50f06c96aeea57c18d4d0582dad9e955ad4dc52846899395b66a4878db0f8bde WatchSource:0}: Error finding container 50f06c96aeea57c18d4d0582dad9e955ad4dc52846899395b66a4878db0f8bde: Status 404 returned error can't find the container with id 50f06c96aeea57c18d4d0582dad9e955ad4dc52846899395b66a4878db0f8bde
May 21 18:29:33.765556 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.765505    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd939f95-9cd4-4912-82db-d39b66db29e1" path="/var/lib/kubelet/pods/fd939f95-9cd4-4912-82db-d39b66db29e1/volumes"
May 21 18:29:33.765967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.765871    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" event={"ID":"dcebebee-4b50-482a-9e43-dc57018dd192","Type":"ContainerStarted","Data":"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"}
May 21 18:29:33.765967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.765900    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" event={"ID":"dcebebee-4b50-482a-9e43-dc57018dd192","Type":"ContainerStarted","Data":"50f06c96aeea57c18d4d0582dad9e955ad4dc52846899395b66a4878db0f8bde"}
May 21 18:29:33.798394 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:33.798338    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" podStartSLOduration=1.798321673 podStartE2EDuration="1.798321673s" podCreationTimestamp="2026-05-21 18:29:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:29:33.795411879 +0000 UTC m=+554.588260137" watchObservedRunningTime="2026-05-21 18:29:33.798321673 +0000 UTC m=+554.591169952"
May 21 18:29:34.769481 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:34.769450    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:43.768070 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:43.768039    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:45.776738 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:45.776706    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:29:45.831417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:45.831366    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:45.831905 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:45.831642    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" podUID="f315ff58-354b-475a-85a1-dd199a820cb8" containerName="manager" containerID="cri-o://3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737" gracePeriod=10
May 21 18:29:46.084751 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.084728    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:46.156810 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.156776    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume\") pod \"f315ff58-354b-475a-85a1-dd199a820cb8\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") "
May 21 18:29:46.156991 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.156831    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh56z\" (UniqueName: \"kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z\") pod \"f315ff58-354b-475a-85a1-dd199a820cb8\" (UID: \"f315ff58-354b-475a-85a1-dd199a820cb8\") "
May 21 18:29:46.157161 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.157137    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f315ff58-354b-475a-85a1-dd199a820cb8" (UID: "f315ff58-354b-475a-85a1-dd199a820cb8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:29:46.159013 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.158989    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z" (OuterVolumeSpecName: "kube-api-access-zh56z") pod "f315ff58-354b-475a-85a1-dd199a820cb8" (UID: "f315ff58-354b-475a-85a1-dd199a820cb8"). InnerVolumeSpecName "kube-api-access-zh56z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:29:46.258200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.258129    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f315ff58-354b-475a-85a1-dd199a820cb8-extensions-socket-volume\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:46.258200 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.258205    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh56z\" (UniqueName: \"kubernetes.io/projected/f315ff58-354b-475a-85a1-dd199a820cb8-kube-api-access-zh56z\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:29:46.816276 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.816238    2557 generic.go:358] "Generic (PLEG): container finished" podID="f315ff58-354b-475a-85a1-dd199a820cb8" containerID="3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737" exitCode=0
May 21 18:29:46.816715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.816310    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"
May 21 18:29:46.816715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.816328    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" event={"ID":"f315ff58-354b-475a-85a1-dd199a820cb8","Type":"ContainerDied","Data":"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"}
May 21 18:29:46.816715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.816369    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk" event={"ID":"f315ff58-354b-475a-85a1-dd199a820cb8","Type":"ContainerDied","Data":"ae76c265fdd31465c4cca30cd896e110d03fe52d901a7231d172c01d5d2ec095"}
May 21 18:29:46.816715 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.816385    2557 scope.go:117] "RemoveContainer" containerID="3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"
May 21 18:29:46.825205 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.825154    2557 scope.go:117] "RemoveContainer" containerID="3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"
May 21 18:29:46.825479 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:29:46.825456    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737\": container with ID starting with 3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737 not found: ID does not exist" containerID="3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"
May 21 18:29:46.825550 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.825487    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737"} err="failed to get container status \"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737\": rpc error: code = NotFound desc = could not find container \"3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737\": container with ID starting with 3354b716e6beeac1e4827cafb09b2fa3b358a41b2a5390c3d4861f98af8ad737 not found: ID does not exist"
May 21 18:29:46.844253 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.844219    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:46.850203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:46.850153    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gptsk"]
May 21 18:29:47.767077 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:29:47.767037    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f315ff58-354b-475a-85a1-dd199a820cb8" path="/var/lib/kubelet/pods/f315ff58-354b-475a-85a1-dd199a820cb8/volumes"
May 21 18:30:02.175275 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.175245    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"]
May 21 18:30:02.175801 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.175768    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f315ff58-354b-475a-85a1-dd199a820cb8" containerName="manager"
May 21 18:30:02.175801 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.175788    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f315ff58-354b-475a-85a1-dd199a820cb8" containerName="manager"
May 21 18:30:02.176016 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.175987    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f315ff58-354b-475a-85a1-dd199a820cb8" containerName="manager"
May 21 18:30:02.180689 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.180660    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.183767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.183739    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pr49j\""
May 21 18:30:02.195480 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.195449    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"]
May 21 18:30:02.298955 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.298911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578bdf51-dc08-4144-925f-219774e78950-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.298965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299120 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578bdf51-dc08-4144-925f-219774e78950-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6lwh\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-kube-api-access-w6lwh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299364 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.299364 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.299353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400686    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400728 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400731    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400755    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400778    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578bdf51-dc08-4144-925f-219774e78950-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400805    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6lwh\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-kube-api-access-w6lwh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400829    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.400983 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.400968    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401261 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401018    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578bdf51-dc08-4144-925f-219774e78950-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401261 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401044    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401261 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401157    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401429 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401481 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401453    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401558 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401537    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.401686 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.401667    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578bdf51-dc08-4144-925f-219774e78950-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.403497 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.403475    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578bdf51-dc08-4144-925f-219774e78950-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.403687 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.403669    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578bdf51-dc08-4144-925f-219774e78950-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.408830 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.408806    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.408971 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.408954    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6lwh\" (UniqueName: \"kubernetes.io/projected/578bdf51-dc08-4144-925f-219774e78950-kube-api-access-w6lwh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-v44fx\" (UID: \"578bdf51-dc08-4144-925f-219774e78950\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.496104 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.496003    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:02.644415 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.644335    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"]
May 21 18:30:02.646687 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:30:02.646659    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578bdf51_dc08_4144_925f_219774e78950.slice/crio-5bf8c0c627277a7380080074af5f0c451752817e969b751ba64ce4d6fe6eac5c WatchSource:0}: Error finding container 5bf8c0c627277a7380080074af5f0c451752817e969b751ba64ce4d6fe6eac5c: Status 404 returned error can't find the container with id 5bf8c0c627277a7380080074af5f0c451752817e969b751ba64ce4d6fe6eac5c
May 21 18:30:02.886177 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:02.886124    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx" event={"ID":"578bdf51-dc08-4144-925f-219774e78950","Type":"ContainerStarted","Data":"5bf8c0c627277a7380080074af5f0c451752817e969b751ba64ce4d6fe6eac5c"}
May 21 18:30:06.950261 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:06.950227    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:30:06.950540 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:06.950299    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:30:06.950540 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:06.950326    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:30:07.908122 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:07.908084    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx" event={"ID":"578bdf51-dc08-4144-925f-219774e78950","Type":"ContainerStarted","Data":"0d4009fdce5fe8db32e72d3a035d0207856255a616296dd781047b097c1c2d23"}
May 21 18:30:07.930578 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:07.930526    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx" podStartSLOduration=1.629852084 podStartE2EDuration="5.930511211s" podCreationTimestamp="2026-05-21 18:30:02 +0000 UTC" firstStartedPulling="2026-05-21 18:30:02.649319639 +0000 UTC m=+583.442167880" lastFinishedPulling="2026-05-21 18:30:06.949978768 +0000 UTC m=+587.742827007" observedRunningTime="2026-05-21 18:30:07.927914974 +0000 UTC m=+588.720763286" watchObservedRunningTime="2026-05-21 18:30:07.930511211 +0000 UTC m=+588.723359469"
May 21 18:30:08.362390 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.362353    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:08.366370 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.366348    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.368716 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.368686    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pcmr\""
May 21 18:30:08.368891 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.368859    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 18:30:08.376161 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.376120    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:08.461686 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.461644    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:08.496538 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.496506    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:08.501616 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.501590    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:08.561926 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.561895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.562110 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.561976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ndh6\" (UniqueName: \"kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.662743 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.662641    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ndh6\" (UniqueName: \"kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.662743 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.662704    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.663336 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.663319    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.671287 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.671257    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ndh6\" (UniqueName: \"kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6\") pod \"limitador-limitador-7d549b5b-qdrs9\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.683126 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.683100    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:08.829341 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.829311    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:08.830914 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:30:08.830887    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode750006d_f61f_4c4f_a90c_7920d418c60b.slice/crio-7b32127acbc44dae8954cbf1d00edef5ba4721b2b86b6bb29699e6a8189c2c2d WatchSource:0}: Error finding container 7b32127acbc44dae8954cbf1d00edef5ba4721b2b86b6bb29699e6a8189c2c2d: Status 404 returned error can't find the container with id 7b32127acbc44dae8954cbf1d00edef5ba4721b2b86b6bb29699e6a8189c2c2d
May 21 18:30:08.913618 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.913499    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" event={"ID":"e750006d-f61f-4c4f-a90c-7920d418c60b","Type":"ContainerStarted","Data":"7b32127acbc44dae8954cbf1d00edef5ba4721b2b86b6bb29699e6a8189c2c2d"}
May 21 18:30:08.913934 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.913915    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:08.914964 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:08.914944    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-v44fx"
May 21 18:30:11.930989 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:11.930950    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" event={"ID":"e750006d-f61f-4c4f-a90c-7920d418c60b","Type":"ContainerStarted","Data":"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"}
May 21 18:30:11.931512 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:11.931110    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:11.948995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:11.948936    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" podStartSLOduration=1.307707545 podStartE2EDuration="3.948920837s" podCreationTimestamp="2026-05-21 18:30:08 +0000 UTC" firstStartedPulling="2026-05-21 18:30:08.833093717 +0000 UTC m=+589.625941952" lastFinishedPulling="2026-05-21 18:30:11.474307006 +0000 UTC m=+592.267155244" observedRunningTime="2026-05-21 18:30:11.947764187 +0000 UTC m=+592.740612444" watchObservedRunningTime="2026-05-21 18:30:11.948920837 +0000 UTC m=+592.741769094"
May 21 18:30:19.696558 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:19.696087    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:30:19.696558 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:19.696373    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:30:19.701773 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:19.701756    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:30:19.701858 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:19.701772    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:30:22.802207 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:22.802155    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:22.804504 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:22.802420    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" podUID="e750006d-f61f-4c4f-a90c-7920d418c60b" containerName="limitador" containerID="cri-o://4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299" gracePeriod=30
May 21 18:30:22.804504 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:22.802975    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:23.349042 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.349019    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:23.398637 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.398544    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ndh6\" (UniqueName: \"kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6\") pod \"e750006d-f61f-4c4f-a90c-7920d418c60b\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") "
May 21 18:30:23.398637 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.398604    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file\") pod \"e750006d-f61f-4c4f-a90c-7920d418c60b\" (UID: \"e750006d-f61f-4c4f-a90c-7920d418c60b\") "
May 21 18:30:23.398967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.398943    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file" (OuterVolumeSpecName: "config-file") pod "e750006d-f61f-4c4f-a90c-7920d418c60b" (UID: "e750006d-f61f-4c4f-a90c-7920d418c60b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:30:23.400642 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.400621    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6" (OuterVolumeSpecName: "kube-api-access-5ndh6") pod "e750006d-f61f-4c4f-a90c-7920d418c60b" (UID: "e750006d-f61f-4c4f-a90c-7920d418c60b"). InnerVolumeSpecName "kube-api-access-5ndh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:30:23.500239 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.500195    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ndh6\" (UniqueName: \"kubernetes.io/projected/e750006d-f61f-4c4f-a90c-7920d418c60b-kube-api-access-5ndh6\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:30:23.500239 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.500230    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e750006d-f61f-4c4f-a90c-7920d418c60b-config-file\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:30:23.979363 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.979330    2557 generic.go:358] "Generic (PLEG): container finished" podID="e750006d-f61f-4c4f-a90c-7920d418c60b" containerID="4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299" exitCode=0
May 21 18:30:23.979767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.979416    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9"
May 21 18:30:23.979767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.979410    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" event={"ID":"e750006d-f61f-4c4f-a90c-7920d418c60b","Type":"ContainerDied","Data":"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"}
May 21 18:30:23.979767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.979518    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qdrs9" event={"ID":"e750006d-f61f-4c4f-a90c-7920d418c60b","Type":"ContainerDied","Data":"7b32127acbc44dae8954cbf1d00edef5ba4721b2b86b6bb29699e6a8189c2c2d"}
May 21 18:30:23.979767 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.979533    2557 scope.go:117] "RemoveContainer" containerID="4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"
May 21 18:30:23.987840 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.987816    2557 scope.go:117] "RemoveContainer" containerID="4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"
May 21 18:30:23.988118 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:30:23.988098    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299\": container with ID starting with 4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299 not found: ID does not exist" containerID="4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"
May 21 18:30:23.988191 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.988125    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299"} err="failed to get container status \"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299\": rpc error: code = NotFound desc = could not find container \"4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299\": container with ID starting with 4c91a1c3a1128fd04095c38de69640a084deb3876083f599608f79bb3673d299 not found: ID does not exist"
May 21 18:30:23.999202 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:23.999157    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:24.003043 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.003014    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qdrs9"]
May 21 18:30:24.578426 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.578392    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9jmhm"]
May 21 18:30:24.579373 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.579338    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e750006d-f61f-4c4f-a90c-7920d418c60b" containerName="limitador"
May 21 18:30:24.579373 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.579367    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e750006d-f61f-4c4f-a90c-7920d418c60b" containerName="limitador"
May 21 18:30:24.579590 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.579448    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e750006d-f61f-4c4f-a90c-7920d418c60b" containerName="limitador"
May 21 18:30:24.584068 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.584039    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.586477 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.586454    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 18:30:24.586477 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.586454    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7hqn8\""
May 21 18:30:24.590850 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.590826    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9jmhm"]
May 21 18:30:24.711562 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.711524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjw6f\" (UniqueName: \"kubernetes.io/projected/c09994ba-f4af-4321-b059-64fe8b4231aa-kube-api-access-bjw6f\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.711739 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.711651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c09994ba-f4af-4321-b059-64fe8b4231aa-data\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.813104 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.813070    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjw6f\" (UniqueName: \"kubernetes.io/projected/c09994ba-f4af-4321-b059-64fe8b4231aa-kube-api-access-bjw6f\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.813333 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.813139    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c09994ba-f4af-4321-b059-64fe8b4231aa-data\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.813478 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.813461    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c09994ba-f4af-4321-b059-64fe8b4231aa-data\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.822548 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.822519    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjw6f\" (UniqueName: \"kubernetes.io/projected/c09994ba-f4af-4321-b059-64fe8b4231aa-kube-api-access-bjw6f\") pod \"postgres-68c4fbbd6f-9jmhm\" (UID: \"c09994ba-f4af-4321-b059-64fe8b4231aa\") " pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:24.897193 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:24.897116    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:25.028825 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:25.028801    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9jmhm"]
May 21 18:30:25.030879 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:30:25.030848    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09994ba_f4af_4321_b059_64fe8b4231aa.slice/crio-9d1941160428a317cbd606e047db7c78d5e887a9b23388534342158f13986fd0 WatchSource:0}: Error finding container 9d1941160428a317cbd606e047db7c78d5e887a9b23388534342158f13986fd0: Status 404 returned error can't find the container with id 9d1941160428a317cbd606e047db7c78d5e887a9b23388534342158f13986fd0
May 21 18:30:25.765241 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:25.765204    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e750006d-f61f-4c4f-a90c-7920d418c60b" path="/var/lib/kubelet/pods/e750006d-f61f-4c4f-a90c-7920d418c60b/volumes"
May 21 18:30:25.993913 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:25.993878    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-9jmhm" event={"ID":"c09994ba-f4af-4321-b059-64fe8b4231aa","Type":"ContainerStarted","Data":"9d1941160428a317cbd606e047db7c78d5e887a9b23388534342158f13986fd0"}
May 21 18:30:31.017884 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:31.017843    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-9jmhm" event={"ID":"c09994ba-f4af-4321-b059-64fe8b4231aa","Type":"ContainerStarted","Data":"165330ba5ae6412aa481162208666ba8b5ad48f241bcf84350de710e9ab49964"}
May 21 18:30:31.018400 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:31.017952    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:31.038976 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:31.038899    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-9jmhm" podStartSLOduration=1.6905019289999998 podStartE2EDuration="7.038878395s" podCreationTimestamp="2026-05-21 18:30:24 +0000 UTC" firstStartedPulling="2026-05-21 18:30:25.032504734 +0000 UTC m=+605.825352969" lastFinishedPulling="2026-05-21 18:30:30.380881196 +0000 UTC m=+611.173729435" observedRunningTime="2026-05-21 18:30:31.034586412 +0000 UTC m=+611.827434682" watchObservedRunningTime="2026-05-21 18:30:31.038878395 +0000 UTC m=+611.831726653"
May 21 18:30:37.052945 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:37.052872    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-9jmhm"
May 21 18:30:43.292349 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.292309    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:30:43.479062 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.479023    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:30:43.479258 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.479192    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:43.481987 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.481966    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 18:30:43.482128 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.481969    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qxg7\""
May 21 18:30:43.584524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.584424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhkf\" (UniqueName: \"kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf\") pod \"maas-controller-644c588678-l8zmd\" (UID: \"baec5eb8-c7e5-4cc4-9543-655d91356124\") " pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:43.685546 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.685504    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhkf\" (UniqueName: \"kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf\") pod \"maas-controller-644c588678-l8zmd\" (UID: \"baec5eb8-c7e5-4cc4-9543-655d91356124\") " pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:43.695611 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.695580    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhkf\" (UniqueName: \"kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf\") pod \"maas-controller-644c588678-l8zmd\" (UID: \"baec5eb8-c7e5-4cc4-9543-655d91356124\") " pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:43.789944 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.789901    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:43.922459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:43.922434    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:30:43.924410 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:30:43.924376    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaec5eb8_c7e5_4cc4_9543_655d91356124.slice/crio-c9b54f52e44c784939d4ed14e7f65ce1013140098d8d1dfa92dc055855ed44f5 WatchSource:0}: Error finding container c9b54f52e44c784939d4ed14e7f65ce1013140098d8d1dfa92dc055855ed44f5: Status 404 returned error can't find the container with id c9b54f52e44c784939d4ed14e7f65ce1013140098d8d1dfa92dc055855ed44f5
May 21 18:30:44.072661 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:44.072628    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644c588678-l8zmd" event={"ID":"baec5eb8-c7e5-4cc4-9543-655d91356124","Type":"ContainerStarted","Data":"c9b54f52e44c784939d4ed14e7f65ce1013140098d8d1dfa92dc055855ed44f5"}
May 21 18:30:47.085417 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:47.085380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644c588678-l8zmd" event={"ID":"baec5eb8-c7e5-4cc4-9543-655d91356124","Type":"ContainerStarted","Data":"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"}
May 21 18:30:47.085894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:47.085433    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:30:47.115605 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:47.115551    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-644c588678-l8zmd" podStartSLOduration=1.9694120929999999 podStartE2EDuration="4.115533491s" podCreationTimestamp="2026-05-21 18:30:43 +0000 UTC" firstStartedPulling="2026-05-21 18:30:43.925829345 +0000 UTC m=+624.718677581" lastFinishedPulling="2026-05-21 18:30:46.071950736 +0000 UTC m=+626.864798979" observedRunningTime="2026-05-21 18:30:47.114580396 +0000 UTC m=+627.907428684" watchObservedRunningTime="2026-05-21 18:30:47.115533491 +0000 UTC m=+627.908381747"
May 21 18:30:58.097675 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:30:58.097645    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:31:10.626359 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:10.626311    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:31:10.626892 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:10.626548    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-644c588678-l8zmd" podUID="baec5eb8-c7e5-4cc4-9543-655d91356124" containerName="manager" containerID="cri-o://09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630" gracePeriod=30
May 21 18:31:10.870234 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:10.870205    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:31:10.933958 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:10.933869    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqhkf\" (UniqueName: \"kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf\") pod \"baec5eb8-c7e5-4cc4-9543-655d91356124\" (UID: \"baec5eb8-c7e5-4cc4-9543-655d91356124\") "
May 21 18:31:10.936221 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:10.936195    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf" (OuterVolumeSpecName: "kube-api-access-gqhkf") pod "baec5eb8-c7e5-4cc4-9543-655d91356124" (UID: "baec5eb8-c7e5-4cc4-9543-655d91356124"). InnerVolumeSpecName "kube-api-access-gqhkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:31:11.034832 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.034789    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqhkf\" (UniqueName: \"kubernetes.io/projected/baec5eb8-c7e5-4cc4-9543-655d91356124-kube-api-access-gqhkf\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:31:11.183597 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.183562    2557 generic.go:358] "Generic (PLEG): container finished" podID="baec5eb8-c7e5-4cc4-9543-655d91356124" containerID="09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630" exitCode=0
May 21 18:31:11.183765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.183636    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644c588678-l8zmd"
May 21 18:31:11.183765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.183651    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644c588678-l8zmd" event={"ID":"baec5eb8-c7e5-4cc4-9543-655d91356124","Type":"ContainerDied","Data":"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"}
May 21 18:31:11.183765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.183692    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644c588678-l8zmd" event={"ID":"baec5eb8-c7e5-4cc4-9543-655d91356124","Type":"ContainerDied","Data":"c9b54f52e44c784939d4ed14e7f65ce1013140098d8d1dfa92dc055855ed44f5"}
May 21 18:31:11.183765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.183711    2557 scope.go:117] "RemoveContainer" containerID="09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"
May 21 18:31:11.194004 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.193979    2557 scope.go:117] "RemoveContainer" containerID="09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"
May 21 18:31:11.194272 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:31:11.194255    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630\": container with ID starting with 09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630 not found: ID does not exist" containerID="09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"
May 21 18:31:11.194325 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.194280    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630"} err="failed to get container status \"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630\": rpc error: code = NotFound desc = could not find container \"09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630\": container with ID starting with 09e6f5d30c911cd7e1ee70e0ce6acd04035f9c97df4d848c3e2ae1fe7ccd4630 not found: ID does not exist"
May 21 18:31:11.229965 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.229933    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:31:11.232091 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.232069    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-644c588678-l8zmd"]
May 21 18:31:11.765821 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:11.765788    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baec5eb8-c7e5-4cc4-9543-655d91356124" path="/var/lib/kubelet/pods/baec5eb8-c7e5-4cc4-9543-655d91356124/volumes"
May 21 18:31:29.789121 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.789088    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6cf9d7cf4f-bh2wg"]
May 21 18:31:29.789613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.789460    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baec5eb8-c7e5-4cc4-9543-655d91356124" containerName="manager"
May 21 18:31:29.789613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.789472    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="baec5eb8-c7e5-4cc4-9543-655d91356124" containerName="manager"
May 21 18:31:29.789613 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.789531    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="baec5eb8-c7e5-4cc4-9543-655d91356124" containerName="manager"
May 21 18:31:29.794662 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.794645    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:29.799540 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.799516    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xc2mr\""
May 21 18:31:29.799758 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.799740    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 18:31:29.800056 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.800016    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 18:31:29.826797 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.826767    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cf9d7cf4f-bh2wg"]
May 21 18:31:29.910477 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.910445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-maas-api-tls\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:29.910477 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:29.910479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7tz\" (UniqueName: \"kubernetes.io/projected/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-kube-api-access-nb7tz\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.011058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.011008    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-maas-api-tls\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.011058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.011060    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7tz\" (UniqueName: \"kubernetes.io/projected/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-kube-api-access-nb7tz\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.013641 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.013607    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-maas-api-tls\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.022207 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.022153    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7tz\" (UniqueName: \"kubernetes.io/projected/39d0375e-f3cf-4fd8-ae89-3e4335adcbea-kube-api-access-nb7tz\") pod \"maas-api-6cf9d7cf4f-bh2wg\" (UID: \"39d0375e-f3cf-4fd8-ae89-3e4335adcbea\") " pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.105793 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.105766    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:30.266110 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.266076    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cf9d7cf4f-bh2wg"]
May 21 18:31:30.268241 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:31:30.268209    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d0375e_f3cf_4fd8_ae89_3e4335adcbea.slice/crio-6dcaa5fad33c9c5169a2bc1c0c19564bac1f759de0d69f8baa0b09f41e33c79c WatchSource:0}: Error finding container 6dcaa5fad33c9c5169a2bc1c0c19564bac1f759de0d69f8baa0b09f41e33c79c: Status 404 returned error can't find the container with id 6dcaa5fad33c9c5169a2bc1c0c19564bac1f759de0d69f8baa0b09f41e33c79c
May 21 18:31:30.269816 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.269797    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:31:30.317882 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.317838    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-phdgp"]
May 21 18:31:30.322404 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.322380    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:30.325624 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.325601    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 18:31:30.325883 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.325861    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vlv5w\""
May 21 18:31:30.340599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.340568    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-phdgp"]
May 21 18:31:30.414897 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.414809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcmv\" (UniqueName: \"kubernetes.io/projected/957ec8fd-e009-4eb2-9b04-4fb9530a8f16-kube-api-access-zqcmv\") pod \"payload-processing-58b6c8fdc7-phdgp\" (UID: \"957ec8fd-e009-4eb2-9b04-4fb9530a8f16\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:30.515871 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.515836    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcmv\" (UniqueName: \"kubernetes.io/projected/957ec8fd-e009-4eb2-9b04-4fb9530a8f16-kube-api-access-zqcmv\") pod \"payload-processing-58b6c8fdc7-phdgp\" (UID: \"957ec8fd-e009-4eb2-9b04-4fb9530a8f16\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:30.538444 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.538411    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcmv\" (UniqueName: \"kubernetes.io/projected/957ec8fd-e009-4eb2-9b04-4fb9530a8f16-kube-api-access-zqcmv\") pod \"payload-processing-58b6c8fdc7-phdgp\" (UID: \"957ec8fd-e009-4eb2-9b04-4fb9530a8f16\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:30.633550 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.633517    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:30.803248 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:30.803212    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-phdgp"]
May 21 18:31:30.805215 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:31:30.805157    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957ec8fd_e009_4eb2_9b04_4fb9530a8f16.slice/crio-b0a8ae2ae27e336672d61f1a10da8d02e2c56644f62f934f2cd513c20beb88e2 WatchSource:0}: Error finding container b0a8ae2ae27e336672d61f1a10da8d02e2c56644f62f934f2cd513c20beb88e2: Status 404 returned error can't find the container with id b0a8ae2ae27e336672d61f1a10da8d02e2c56644f62f934f2cd513c20beb88e2
May 21 18:31:31.278713 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:31.278673    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp" event={"ID":"957ec8fd-e009-4eb2-9b04-4fb9530a8f16","Type":"ContainerStarted","Data":"b0a8ae2ae27e336672d61f1a10da8d02e2c56644f62f934f2cd513c20beb88e2"}
May 21 18:31:31.280142 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:31.280117    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg" event={"ID":"39d0375e-f3cf-4fd8-ae89-3e4335adcbea","Type":"ContainerStarted","Data":"6dcaa5fad33c9c5169a2bc1c0c19564bac1f759de0d69f8baa0b09f41e33c79c"}
May 21 18:31:33.290761 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.290725    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp" event={"ID":"957ec8fd-e009-4eb2-9b04-4fb9530a8f16","Type":"ContainerStarted","Data":"820f2b92e1aefe26f9439918294cea4ef7b5b6c8bf6358cd2bcf1206a2329b14"}
May 21 18:31:33.291204 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.290800    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:31:33.292251 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.292220    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg" event={"ID":"39d0375e-f3cf-4fd8-ae89-3e4335adcbea","Type":"ContainerStarted","Data":"1b266f435f475f5fa82d17bed23c7be651c67083ee790971c2111ac8b7ece4cd"}
May 21 18:31:33.292357 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.292272    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:33.364651 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.364589    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp" podStartSLOduration=1.699153426 podStartE2EDuration="3.364575545s" podCreationTimestamp="2026-05-21 18:31:30 +0000 UTC" firstStartedPulling="2026-05-21 18:31:30.807066557 +0000 UTC m=+671.599914792" lastFinishedPulling="2026-05-21 18:31:32.472488661 +0000 UTC m=+673.265336911" observedRunningTime="2026-05-21 18:31:33.326951233 +0000 UTC m=+674.119799492" watchObservedRunningTime="2026-05-21 18:31:33.364575545 +0000 UTC m=+674.157423807"
May 21 18:31:33.365696 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:33.365656    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg" podStartSLOduration=2.165122962 podStartE2EDuration="4.365643617s" podCreationTimestamp="2026-05-21 18:31:29 +0000 UTC" firstStartedPulling="2026-05-21 18:31:30.269915867 +0000 UTC m=+671.062764103" lastFinishedPulling="2026-05-21 18:31:32.470436506 +0000 UTC m=+673.263284758" observedRunningTime="2026-05-21 18:31:33.356914063 +0000 UTC m=+674.149762322" watchObservedRunningTime="2026-05-21 18:31:33.365643617 +0000 UTC m=+674.158491875"
May 21 18:31:39.301902 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:39.301866    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6cf9d7cf4f-bh2wg"
May 21 18:31:44.298566 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:31:44.298534    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-phdgp"
May 21 18:32:17.781776 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.781672    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"]
May 21 18:32:17.785922 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.785885    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.788948 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.788919    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 18:32:17.789119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.788969    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 18:32:17.789119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.788919    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-884sp\""
May 21 18:32:17.789119 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.788919    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 18:32:17.798913 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.798880    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"]
May 21 18:32:17.939403 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.939403 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939398    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwgl\" (UniqueName: \"kubernetes.io/projected/692b1ba7-4b24-4fd0-9764-7075073655a5-kube-api-access-bkwgl\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.939706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939430    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.939706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.939706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/692b1ba7-4b24-4fd0-9764-7075073655a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:17.939706 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:17.939580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.040724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040629    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.040724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040671    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwgl\" (UniqueName: \"kubernetes.io/projected/692b1ba7-4b24-4fd0-9764-7075073655a5-kube-api-access-bkwgl\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.040724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040695    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.040724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040717    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.041054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040840    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/692b1ba7-4b24-4fd0-9764-7075073655a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.041054 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.040894    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.041136 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.041104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.041216 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.041162    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.041343 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.041319    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.044161 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.044038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/692b1ba7-4b24-4fd0-9764-7075073655a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.045486 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.044719    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/692b1ba7-4b24-4fd0-9764-7075073655a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.050537 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.050509    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwgl\" (UniqueName: \"kubernetes.io/projected/692b1ba7-4b24-4fd0-9764-7075073655a5-kube-api-access-bkwgl\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz\" (UID: \"692b1ba7-4b24-4fd0-9764-7075073655a5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.097578 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.097537    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:18.253963 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.253932    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"]
May 21 18:32:18.255842 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:32:18.255811    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692b1ba7_4b24_4fd0_9764_7075073655a5.slice/crio-0eac00e2bfc17747365e2a92a7f94c35e361d0e5bf78961e83b6035da2fdc225 WatchSource:0}: Error finding container 0eac00e2bfc17747365e2a92a7f94c35e361d0e5bf78961e83b6035da2fdc225: Status 404 returned error can't find the container with id 0eac00e2bfc17747365e2a92a7f94c35e361d0e5bf78961e83b6035da2fdc225
May 21 18:32:18.482769 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:18.482729    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz" event={"ID":"692b1ba7-4b24-4fd0-9764-7075073655a5","Type":"ContainerStarted","Data":"0eac00e2bfc17747365e2a92a7f94c35e361d0e5bf78961e83b6035da2fdc225"}
May 21 18:32:24.519254 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:24.519203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz" event={"ID":"692b1ba7-4b24-4fd0-9764-7075073655a5","Type":"ContainerStarted","Data":"6593bcd89c8674802a6435255eac5dd115f53bd43a79e419d30ee1706d23d6f3"}
May 21 18:32:30.550463 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:30.550420    2557 generic.go:358] "Generic (PLEG): container finished" podID="692b1ba7-4b24-4fd0-9764-7075073655a5" containerID="6593bcd89c8674802a6435255eac5dd115f53bd43a79e419d30ee1706d23d6f3" exitCode=0
May 21 18:32:30.551032 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:30.550501    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz" event={"ID":"692b1ba7-4b24-4fd0-9764-7075073655a5","Type":"ContainerDied","Data":"6593bcd89c8674802a6435255eac5dd115f53bd43a79e419d30ee1706d23d6f3"}
May 21 18:32:32.561151 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:32.561115    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz" event={"ID":"692b1ba7-4b24-4fd0-9764-7075073655a5","Type":"ContainerStarted","Data":"b7f50b37e0526a7f50550a6c4fd8300b0af8c777f3c36fb6fe43e261d4fadb93"}
May 21 18:32:32.561581 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:32.561359    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:32:32.596455 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:32.596399    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz" podStartSLOduration=2.111197831 podStartE2EDuration="15.596383201s" podCreationTimestamp="2026-05-21 18:32:17 +0000 UTC" firstStartedPulling="2026-05-21 18:32:18.257685032 +0000 UTC m=+719.050533271" lastFinishedPulling="2026-05-21 18:32:31.742870393 +0000 UTC m=+732.535718641" observedRunningTime="2026-05-21 18:32:32.593348808 +0000 UTC m=+733.386197065" watchObservedRunningTime="2026-05-21 18:32:32.596383201 +0000 UTC m=+733.389231460"
May 21 18:32:43.578993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:32:43.578953    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz"
May 21 18:33:04.784836 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.784797    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"]
May 21 18:33:04.820970 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.820903    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"]
May 21 18:33:04.821131 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.821028    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.825453 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.825421    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 18:33:04.995843 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.995803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.996036 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.995854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.996141 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.996061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2rb\" (UniqueName: \"kubernetes.io/projected/5ea71f08-abff-49b9-b837-d2d080f3dd85-kube-api-access-dv2rb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.996141 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.996099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.996279 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.996156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea71f08-abff-49b9-b837-d2d080f3dd85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:04.996333 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:04.996219    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.096971 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.096865    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.096971 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.096944    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2rb\" (UniqueName: \"kubernetes.io/projected/5ea71f08-abff-49b9-b837-d2d080f3dd85-kube-api-access-dv2rb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097081    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097125    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea71f08-abff-49b9-b837-d2d080f3dd85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097210 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097199    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097625 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097597    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097758 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097696    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.097758 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.097731    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.099298 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.099274    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea71f08-abff-49b9-b837-d2d080f3dd85-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.099716 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.099697    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea71f08-abff-49b9-b837-d2d080f3dd85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.109574 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.109546    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2rb\" (UniqueName: \"kubernetes.io/projected/5ea71f08-abff-49b9-b837-d2d080f3dd85-kube-api-access-dv2rb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s\" (UID: \"5ea71f08-abff-49b9-b837-d2d080f3dd85\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.130673 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.130632    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:05.290462 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.290432    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"]
May 21 18:33:05.292178 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:33:05.292140    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea71f08_abff_49b9_b837_d2d080f3dd85.slice/crio-cec507486a90bb4e6f32af35f59b4b2b6194024acc2511279fb9c15446523f58 WatchSource:0}: Error finding container cec507486a90bb4e6f32af35f59b4b2b6194024acc2511279fb9c15446523f58: Status 404 returned error can't find the container with id cec507486a90bb4e6f32af35f59b4b2b6194024acc2511279fb9c15446523f58
May 21 18:33:05.699098 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.699058    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s" event={"ID":"5ea71f08-abff-49b9-b837-d2d080f3dd85","Type":"ContainerStarted","Data":"2293a5de1099acfd028ddc4ca074cdcbbb05d36cfcefbc513b525a1358cf4685"}
May 21 18:33:05.699098 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:05.699101    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s" event={"ID":"5ea71f08-abff-49b9-b837-d2d080f3dd85","Type":"ContainerStarted","Data":"cec507486a90bb4e6f32af35f59b4b2b6194024acc2511279fb9c15446523f58"}
May 21 18:33:14.745917 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:14.745825    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ea71f08-abff-49b9-b837-d2d080f3dd85" containerID="2293a5de1099acfd028ddc4ca074cdcbbb05d36cfcefbc513b525a1358cf4685" exitCode=0
May 21 18:33:14.745917 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:14.745899    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s" event={"ID":"5ea71f08-abff-49b9-b837-d2d080f3dd85","Type":"ContainerDied","Data":"2293a5de1099acfd028ddc4ca074cdcbbb05d36cfcefbc513b525a1358cf4685"}
May 21 18:33:15.753445 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:15.753411    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s" event={"ID":"5ea71f08-abff-49b9-b837-d2d080f3dd85","Type":"ContainerStarted","Data":"79e77fe689984bc25c2006645e98094fe087418252a49f1f5aa239635214f59d"}
May 21 18:33:15.753882 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:15.753611    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:33:15.774982 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:15.774933    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s" podStartSLOduration=11.486849394 podStartE2EDuration="11.774919742s" podCreationTimestamp="2026-05-21 18:33:04 +0000 UTC" firstStartedPulling="2026-05-21 18:33:14.746599792 +0000 UTC m=+775.539448027" lastFinishedPulling="2026-05-21 18:33:15.034670139 +0000 UTC m=+775.827518375" observedRunningTime="2026-05-21 18:33:15.771899477 +0000 UTC m=+776.564747734" watchObservedRunningTime="2026-05-21 18:33:15.774919742 +0000 UTC m=+776.567768000"
May 21 18:33:26.770857 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:33:26.770820    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s"
May 21 18:34:57.183902 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.183866    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-768fd7d946-zp8md"]
May 21 18:34:57.186395 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.186374    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:57.190008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.189987    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qxg7\""
May 21 18:34:57.200007 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.199981    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768fd7d946-zp8md"]
May 21 18:34:57.260150 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.260110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cp2b\" (UniqueName: \"kubernetes.io/projected/84d74756-99f3-455a-9c47-b975e46d7414-kube-api-access-5cp2b\") pod \"maas-controller-768fd7d946-zp8md\" (UID: \"84d74756-99f3-455a-9c47-b975e46d7414\") " pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:57.360833 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.360786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cp2b\" (UniqueName: \"kubernetes.io/projected/84d74756-99f3-455a-9c47-b975e46d7414-kube-api-access-5cp2b\") pod \"maas-controller-768fd7d946-zp8md\" (UID: \"84d74756-99f3-455a-9c47-b975e46d7414\") " pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:57.369520 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.369482    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cp2b\" (UniqueName: \"kubernetes.io/projected/84d74756-99f3-455a-9c47-b975e46d7414-kube-api-access-5cp2b\") pod \"maas-controller-768fd7d946-zp8md\" (UID: \"84d74756-99f3-455a-9c47-b975e46d7414\") " pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:57.497517 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.497422    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:57.637037 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:57.637000    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768fd7d946-zp8md"]
May 21 18:34:57.637620 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:34:57.637595    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d74756_99f3_455a_9c47_b975e46d7414.slice/crio-9403bca8b1011eb3e31339a6f9b8bbb5f5e38c7ad29c8535bc5eb30f20f28274 WatchSource:0}: Error finding container 9403bca8b1011eb3e31339a6f9b8bbb5f5e38c7ad29c8535bc5eb30f20f28274: Status 404 returned error can't find the container with id 9403bca8b1011eb3e31339a6f9b8bbb5f5e38c7ad29c8535bc5eb30f20f28274
May 21 18:34:58.206724 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:58.206687    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-zp8md" event={"ID":"84d74756-99f3-455a-9c47-b975e46d7414","Type":"ContainerStarted","Data":"9403bca8b1011eb3e31339a6f9b8bbb5f5e38c7ad29c8535bc5eb30f20f28274"}
May 21 18:34:59.212587 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:59.212550    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-zp8md" event={"ID":"84d74756-99f3-455a-9c47-b975e46d7414","Type":"ContainerStarted","Data":"1988eb772ab5ac8c9786dbc3c1908c4f7aa10a12fa36199dc9e5368bbd828863"}
May 21 18:34:59.213097 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:59.212651    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:34:59.230037 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:34:59.229984    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-768fd7d946-zp8md" podStartSLOduration=1.718273138 podStartE2EDuration="2.229968715s" podCreationTimestamp="2026-05-21 18:34:57 +0000 UTC" firstStartedPulling="2026-05-21 18:34:57.639062748 +0000 UTC m=+878.431910986" lastFinishedPulling="2026-05-21 18:34:58.150758327 +0000 UTC m=+878.943606563" observedRunningTime="2026-05-21 18:34:59.227673881 +0000 UTC m=+880.020522138" watchObservedRunningTime="2026-05-21 18:34:59.229968715 +0000 UTC m=+880.022816974"
May 21 18:35:10.223378 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:35:10.223344    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-768fd7d946-zp8md"
May 21 18:35:19.731124 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:35:19.731096    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:35:19.732564 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:35:19.732538    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:35:19.736369 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:35:19.736329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:35:19.737601 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:35:19.737578    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:40:19.767275 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:40:19.767242    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:40:19.772524 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:40:19.772494    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:40:19.775185 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:40:19.775148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:40:19.777002 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:40:19.776978    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:45:18.060409 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.060364    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:45:18.061028 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.060695    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" podUID="dcebebee-4b50-482a-9e43-dc57018dd192" containerName="manager" containerID="cri-o://dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7" gracePeriod=10
May 21 18:45:18.313899 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.313832    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:45:18.379324 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.379290    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume\") pod \"dcebebee-4b50-482a-9e43-dc57018dd192\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") "
May 21 18:45:18.379517 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.379420    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjbn2\" (UniqueName: \"kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2\") pod \"dcebebee-4b50-482a-9e43-dc57018dd192\" (UID: \"dcebebee-4b50-482a-9e43-dc57018dd192\") "
May 21 18:45:18.379758 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.379719    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dcebebee-4b50-482a-9e43-dc57018dd192" (UID: "dcebebee-4b50-482a-9e43-dc57018dd192"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:45:18.381694 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.381660    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2" (OuterVolumeSpecName: "kube-api-access-fjbn2") pod "dcebebee-4b50-482a-9e43-dc57018dd192" (UID: "dcebebee-4b50-482a-9e43-dc57018dd192"). InnerVolumeSpecName "kube-api-access-fjbn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:45:18.480779 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.480744    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebebee-4b50-482a-9e43-dc57018dd192-extensions-socket-volume\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:45:18.480779 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.480775    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjbn2\" (UniqueName: \"kubernetes.io/projected/dcebebee-4b50-482a-9e43-dc57018dd192-kube-api-access-fjbn2\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\""
May 21 18:45:18.844216 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.844159    2557 generic.go:358] "Generic (PLEG): container finished" podID="dcebebee-4b50-482a-9e43-dc57018dd192" containerID="dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7" exitCode=0
May 21 18:45:18.844216 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.844199    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" event={"ID":"dcebebee-4b50-482a-9e43-dc57018dd192","Type":"ContainerDied","Data":"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"}
May 21 18:45:18.844478 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.844228    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"
May 21 18:45:18.844478 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.844242    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz" event={"ID":"dcebebee-4b50-482a-9e43-dc57018dd192","Type":"ContainerDied","Data":"50f06c96aeea57c18d4d0582dad9e955ad4dc52846899395b66a4878db0f8bde"}
May 21 18:45:18.844478 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.844259    2557 scope.go:117] "RemoveContainer" containerID="dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"
May 21 18:45:18.854046 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.854027    2557 scope.go:117] "RemoveContainer" containerID="dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"
May 21 18:45:18.854407 ip-10-0-138-250 kubenswrapper[2557]: E0521 18:45:18.854386    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7\": container with ID starting with dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7 not found: ID does not exist" containerID="dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"
May 21 18:45:18.854477 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.854420    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7"} err="failed to get container status \"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7\": rpc error: code = NotFound desc = could not find container \"dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7\": container with ID starting with dd3a79e2dff74396993b565ccfc1290620946177f143ddd0cda0f1c3ebdffdd7 not found: ID does not exist"
May 21 18:45:18.867143 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.867110    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:45:18.870990 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:18.870958    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nrxkz"]
May 21 18:45:19.766318 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:19.766289    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcebebee-4b50-482a-9e43-dc57018dd192" path="/var/lib/kubelet/pods/dcebebee-4b50-482a-9e43-dc57018dd192/volumes"
May 21 18:45:19.802409 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:19.802378    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:45:19.806252 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:19.806224    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:45:19.807505 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:19.807480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:45:19.811066 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:45:19.811049    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:46:24.147646 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.147597    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"]
May 21 18:46:24.148317 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.148215    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcebebee-4b50-482a-9e43-dc57018dd192" containerName="manager"
May 21 18:46:24.148317 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.148239    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcebebee-4b50-482a-9e43-dc57018dd192" containerName="manager"
May 21 18:46:24.148457 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.148332    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcebebee-4b50-482a-9e43-dc57018dd192" containerName="manager"
May 21 18:46:24.151400 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.151377    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.153804 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.153781    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:46:24.153906 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.153786    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cjk2z\""
May 21 18:46:24.153906 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.153820    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:46:24.164101 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.164074    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"]
May 21 18:46:24.288789 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.288752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzw4l\" (UniqueName: \"kubernetes.io/projected/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-kube-api-access-gzw4l\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.288979 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.288883    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.390278 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.390240    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.390472 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.390307    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzw4l\" (UniqueName: \"kubernetes.io/projected/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-kube-api-access-gzw4l\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.390640 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.390619    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.399809 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.399729    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzw4l\" (UniqueName: \"kubernetes.io/projected/1b0930fc-9edd-4549-bbf2-a38e1f2b4335-kube-api-access-gzw4l\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dllvj\" (UID: \"1b0930fc-9edd-4549-bbf2-a38e1f2b4335\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.462723 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.462687    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:24.620523 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.620490    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"]
May 21 18:46:24.620802 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:46:24.620777    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0930fc_9edd_4549_bbf2_a38e1f2b4335.slice/crio-8145da6d36e94e1299407881e7e6b4e825dc6079a1cc377b673d1e8c3ece2538 WatchSource:0}: Error finding container 8145da6d36e94e1299407881e7e6b4e825dc6079a1cc377b673d1e8c3ece2538: Status 404 returned error can't find the container with id 8145da6d36e94e1299407881e7e6b4e825dc6079a1cc377b673d1e8c3ece2538
May 21 18:46:24.623287 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:24.623269    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:46:25.119347 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:25.119302    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj" event={"ID":"1b0930fc-9edd-4549-bbf2-a38e1f2b4335","Type":"ContainerStarted","Data":"43c93f7c103f65aa3e1cd1752fbd6ee60370b8761855fe8569a096c4bf0dc954"}
May 21 18:46:25.119347 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:25.119341    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj" event={"ID":"1b0930fc-9edd-4549-bbf2-a38e1f2b4335","Type":"ContainerStarted","Data":"8145da6d36e94e1299407881e7e6b4e825dc6079a1cc377b673d1e8c3ece2538"}
May 21 18:46:25.119587 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:25.119466    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:46:25.142867 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:25.142799    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj" podStartSLOduration=1.142777509 podStartE2EDuration="1.142777509s" podCreationTimestamp="2026-05-21 18:46:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:46:25.139089536 +0000 UTC m=+1565.931937811" watchObservedRunningTime="2026-05-21 18:46:25.142777509 +0000 UTC m=+1565.935625767"
May 21 18:46:36.125880 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:46:36.125847    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dllvj"
May 21 18:50:19.838866 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:50:19.838831    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:50:19.843678 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:50:19.843653    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:50:19.843878 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:50:19.843857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:50:19.848459 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:50:19.848437    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:55:19.878057 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:55:19.878028    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:55:19.883058 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:55:19.883032    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:55:19.883446 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:55:19.883425    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:55:19.888266 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:55:19.888243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfjxx_9106c2d4-ddd2-454c-9324-e21483abe021/ovn-acl-logging/0.log"
May 21 18:56:12.239579 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:12.239491    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-kzzqm_d16bd277-dc3f-4cdf-b398-7d4151c5557f/manager/0.log"
May 21 18:56:12.358094 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:12.358064    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cf9d7cf4f-bh2wg_39d0375e-f3cf-4fd8-ae89-3e4335adcbea/maas-api/0.log"
May 21 18:56:12.484814 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:12.484770    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-768fd7d946-zp8md_84d74756-99f3-455a-9c47-b975e46d7414/manager/0.log"
May 21 18:56:12.602811 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:12.602785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fcn58_ede0a427-21d5-4956-a80e-04a908fb9112/manager/2.log"
May 21 18:56:12.966940 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:12.966857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-td927_ebf15ef1-cbf0-4cc9-8e57-abe139af0940/manager/0.log"
May 21 18:56:13.072249 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.072214    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-9jmhm_c09994ba-f4af-4321-b059-64fe8b4231aa/postgres/0.log"
May 21 18:56:13.810131 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.810098    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/pull/0.log"
May 21 18:56:13.816114 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.816089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/extract/0.log"
May 21 18:56:13.821717 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.821693    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/util/0.log"
May 21 18:56:13.925069 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.925033    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/util/0.log"
May 21 18:56:13.930992 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.930970    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/pull/0.log"
May 21 18:56:13.937180 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:13.937148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/extract/0.log"
May 21 18:56:14.050066 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.050033    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/pull/0.log"
May 21 18:56:14.056533 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.056509    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/extract/0.log"
May 21 18:56:14.062825 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.062756    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/util/0.log"
May 21 18:56:14.175403 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.175376    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/util/0.log"
May 21 18:56:14.181919 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.181892    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/pull/0.log"
May 21 18:56:14.188013 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.187985    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/extract/0.log"
May 21 18:56:14.891995 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:14.891958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-dllvj_1b0930fc-9edd-4549-bbf2-a38e1f2b4335/manager/0.log"
May 21 18:56:15.592185 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:15.592142    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zm687_f5a11921-3f2b-451e-beb3-bb0b78208822/discovery/0.log"
May 21 18:56:15.821141 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:15.821109    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d887b4ccb-mxn89_b8b361eb-f8aa-4ade-a082-8a9483a6a3cf/kube-auth-proxy/0.log"
May 21 18:56:15.938363 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:15.938331    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-v44fx_578bdf51-dc08-4144-925f-219774e78950/istio-proxy/0.log"
May 21 18:56:16.051990 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:16.051958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-phdgp_957ec8fd-e009-4eb2-9b04-4fb9530a8f16/payload-processing/0.log"
May 21 18:56:16.498072 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:16.498026    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz_692b1ba7-4b24-4fd0-9764-7075073655a5/storage-initializer/0.log"
May 21 18:56:16.506366 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:16.506339    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-hpwxz_692b1ba7-4b24-4fd0-9764-7075073655a5/main/0.log"
May 21 18:56:17.094327 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:17.094288    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s_5ea71f08-abff-49b9-b837-d2d080f3dd85/storage-initializer/0.log"
May 21 18:56:17.106486 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:17.106460    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-lmp8s_5ea71f08-abff-49b9-b837-d2d080f3dd85/main/0.log"
May 21 18:56:24.873111 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:24.873058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tvz85_b04bbd4b-eb0e-4acb-a58c-f12dc0420e26/global-pull-secret-syncer/0.log"
May 21 18:56:25.043703 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:25.043667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qbglv_2dd942c0-9985-4308-a628-4a8e6581bda2/konnectivity-agent/0.log"
May 21 18:56:25.136853 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:25.136731    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-250.ec2.internal_2f89645f16c3c592f4f40ac03de31cc6/haproxy/0.log"
May 21 18:56:28.667388 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:28.667358    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/extract/0.log"
May 21 18:56:28.750474 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:28.750445    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/util/0.log"
May 21 18:56:28.801523 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:28.801475    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l2t5_32c26120-7fa9-46a3-914c-5a589bd6e899/pull/0.log"
May 21 18:56:28.881818 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:28.881785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/extract/0.log"
May 21 18:56:28.943762 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:28.943680    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/util/0.log"
May 21 18:56:29.014536 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.014503    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04zj64_7397b62e-3e22-4005-ad71-69c3f962cc45/pull/0.log"
May 21 18:56:29.068406 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.068375    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/extract/0.log"
May 21 18:56:29.169589 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.169555    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/util/0.log"
May 21 18:56:29.277950 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.277871    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bhs7r_d2c344b5-34f6-4b06-bc25-c2fceedbd29a/pull/0.log"
May 21 18:56:29.350422 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.350392    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/extract/0.log"
May 21 18:56:29.388205 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.388162    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/util/0.log"
May 21 18:56:29.435506 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:29.435477    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m5k8c_7e5738c0-9626-4a9e-9c57-eee5728aaf72/pull/0.log"
May 21 18:56:30.045823 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:30.045785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-dllvj_1b0930fc-9edd-4549-bbf2-a38e1f2b4335/manager/0.log"
May 21 18:56:31.712320 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.712282    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s96qk_63276d39-db6b-4b7a-a821-8838de70f320/kube-state-metrics/0.log"
May 21 18:56:31.741688 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.741654    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s96qk_63276d39-db6b-4b7a-a821-8838de70f320/kube-rbac-proxy-main/0.log"
May 21 18:56:31.780203 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.780157    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s96qk_63276d39-db6b-4b7a-a821-8838de70f320/kube-rbac-proxy-self/0.log"
May 21 18:56:31.908687 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.908658    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2f5z_4bc54888-5c6b-45f7-b960-961344d37982/node-exporter/0.log"
May 21 18:56:31.941361 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.941328    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2f5z_4bc54888-5c6b-45f7-b960-961344d37982/kube-rbac-proxy/0.log"
May 21 18:56:31.973922 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:31.973833    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2f5z_4bc54888-5c6b-45f7-b960-961344d37982/init-textfile/0.log"
May 21 18:56:32.500950 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.500922    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4j7px_46fc62b5-c778-45c4-b41a-dd8f51ebf103/prometheus-operator/0.log"
May 21 18:56:32.521111 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.521085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4j7px_46fc62b5-c778-45c4-b41a-dd8f51ebf103/kube-rbac-proxy/0.log"
May 21 18:56:32.915729 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.915690    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"]
May 21 18:56:32.919482 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.919455    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:32.923148 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.923125    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kg6zt\"/\"default-dockercfg-qjd9n\""
May 21 18:56:32.923540 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.923524    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"openshift-service-ca.crt\""
May 21 18:56:32.924301 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.924283    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"kube-root-ca.crt\""
May 21 18:56:32.941881 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:32.937226    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"]
May 21 18:56:33.046395 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.046358    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-sys\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.046395 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.046408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-lib-modules\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.046631 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.046438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-proc\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.046631 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.046466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-podres\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.046631 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.046509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5w8f\" (UniqueName: \"kubernetes.io/projected/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-kube-api-access-g5w8f\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148025 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.147982    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-sys\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148025 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148030    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-lib-modules\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148062    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-proc\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148084    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-podres\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-sys\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148120    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w8f\" (UniqueName: \"kubernetes.io/projected/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-kube-api-access-g5w8f\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148218    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-proc\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-podres\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.148309 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.148283    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-lib-modules\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.158732 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.158707    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5w8f\" (UniqueName: \"kubernetes.io/projected/9f72f0b7-c63e-4907-a87a-e0e527af0c2a-kube-api-access-g5w8f\") pod \"perf-node-gather-daemonset-v9b5s\" (UID: \"9f72f0b7-c63e-4907-a87a-e0e527af0c2a\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.230733 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.230642    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.383073 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.383037    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"]
May 21 18:56:33.386501 ip-10-0-138-250 kubenswrapper[2557]: W0521 18:56:33.386469    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f72f0b7_c63e_4907_a87a_e0e527af0c2a.slice/crio-1d42eabe68cd2bfe43c0f9f48793edd480d2675053506dd0ee82fcdcbd9e7e4b WatchSource:0}: Error finding container 1d42eabe68cd2bfe43c0f9f48793edd480d2675053506dd0ee82fcdcbd9e7e4b: Status 404 returned error can't find the container with id 1d42eabe68cd2bfe43c0f9f48793edd480d2675053506dd0ee82fcdcbd9e7e4b
May 21 18:56:33.388456 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.388433    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:56:33.656584 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.656540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s" event={"ID":"9f72f0b7-c63e-4907-a87a-e0e527af0c2a","Type":"ContainerStarted","Data":"5e41a8bd5e3766e5da7314f7c66110aaf6792429e941a2c1ae786d72da61894a"}
May 21 18:56:33.656584 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.656576    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s" event={"ID":"9f72f0b7-c63e-4907-a87a-e0e527af0c2a","Type":"ContainerStarted","Data":"1d42eabe68cd2bfe43c0f9f48793edd480d2675053506dd0ee82fcdcbd9e7e4b"}
May 21 18:56:33.656871 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.656666    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:33.683648 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:33.683595    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s" podStartSLOduration=1.6835801030000002 podStartE2EDuration="1.683580103s" podCreationTimestamp="2026-05-21 18:56:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:56:33.681011652 +0000 UTC m=+2174.473859910" watchObservedRunningTime="2026-05-21 18:56:33.683580103 +0000 UTC m=+2174.476428361"
May 21 18:56:34.610962 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:34.610928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/2.log"
May 21 18:56:34.615967 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:34.615938    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rxjnb_db4cf268-984e-490b-97a0-bc6f7448c45a/console-operator/3.log"
May 21 18:56:35.114380 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:35.114353    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-764854694f-hsjgt_91e89fae-7b75-42f3-a46e-361c70f9d7b0/console/0.log"
May 21 18:56:35.156225 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:35.156196    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-622jn_5e386e7f-3ca9-429a-9029-b186ca977520/download-server/0.log"
May 21 18:56:36.688771 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:36.688726    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8dc7_b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1/dns/0.log"
May 21 18:56:36.710762 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:36.710728    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8dc7_b50e19e7-b6c7-44a6-ad1e-4e88be6b92c1/kube-rbac-proxy/0.log"
May 21 18:56:36.863008 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:36.862984    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5r6h_40b2e50c-f0bb-4771-806f-46de4e22fda0/dns-node-resolver/0.log"
May 21 18:56:37.489599 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:37.489558    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b667c559b-48nm7_c10f166f-0bd0-4970-873b-f15831abf664/registry/0.log"
May 21 18:56:37.603928 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:37.603894    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kn4wt_713b4e2f-d823-47c5-9569-590331d77c51/node-ca/0.log"
May 21 18:56:38.896993 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:38.896958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zm687_f5a11921-3f2b-451e-beb3-bb0b78208822/discovery/0.log"
May 21 18:56:38.982793 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:38.982762    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d887b4ccb-mxn89_b8b361eb-f8aa-4ade-a082-8a9483a6a3cf/kube-auth-proxy/0.log"
May 21 18:56:39.051390 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:39.051354    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-v44fx_578bdf51-dc08-4144-925f-219774e78950/istio-proxy/0.log"
May 21 18:56:39.116640 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:39.116603    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-phdgp_957ec8fd-e009-4eb2-9b04-4fb9530a8f16/payload-processing/0.log"
May 21 18:56:39.671844 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:39.671811    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-v9b5s"
May 21 18:56:39.802725 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:39.802691    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-22vmf_d3bd2d2b-02c4-4a27-a1cc-7e45e2f783ea/serve-healthcheck-canary/0.log"
May 21 18:56:40.954960 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:40.954930    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mntgl_6d5cb3af-ba41-475c-b5bb-d9ba273f18c7/kube-rbac-proxy/0.log"
May 21 18:56:40.997302 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:40.997267    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mntgl_6d5cb3af-ba41-475c-b5bb-d9ba273f18c7/exporter/0.log"
May 21 18:56:41.077094 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:41.077063    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mntgl_6d5cb3af-ba41-475c-b5bb-d9ba273f18c7/extractor/0.log"
May 21 18:56:43.797328 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:43.797231    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-kzzqm_d16bd277-dc3f-4cdf-b398-7d4151c5557f/manager/0.log"
May 21 18:56:43.893358 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:43.893322    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cf9d7cf4f-bh2wg_39d0375e-f3cf-4fd8-ae89-3e4335adcbea/maas-api/0.log"
May 21 18:56:44.002014 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:44.001981    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-768fd7d946-zp8md_84d74756-99f3-455a-9c47-b975e46d7414/manager/0.log"
May 21 18:56:44.071670 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:44.071585    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fcn58_ede0a427-21d5-4956-a80e-04a908fb9112/manager/1.log"
May 21 18:56:44.082765 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:44.082734    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fcn58_ede0a427-21d5-4956-a80e-04a908fb9112/manager/2.log"
May 21 18:56:44.243520 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:44.243490    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-td927_ebf15ef1-cbf0-4cc9-8e57-abe139af0940/manager/0.log"
May 21 18:56:44.293283 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:44.293252    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-9jmhm_c09994ba-f4af-4321-b059-64fe8b4231aa/postgres/0.log"
May 21 18:56:45.812894 ip-10-0-138-250 kubenswrapper[2557]: I0521 18:56:45.812856    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-p24zn_aa14edad-5c43-48c4-b333-2e03ead7dc6a/openshift-lws-operator/0.log"