May 28 17:15:06.144893 ip-10-0-138-128 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 17:15:06.144905 ip-10-0-138-128 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 17:15:06.144911 ip-10-0-138-128 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 17:15:06.145232 ip-10-0-138-128 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 17:15:16.331722 ip-10-0-138-128 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 17:15:16.331739 ip-10-0-138-128 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 07e1dec3a9dc4dcdae167b3c61f11940 --
May 28 17:17:24.808647 ip-10-0-138-128 systemd[1]: Starting Kubernetes Kubelet...
May 28 17:17:25.263932 ip-10-0-138-128 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:25.263932 ip-10-0-138-128 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 17:17:25.263932 ip-10-0-138-128 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:25.263932 ip-10-0-138-128 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 17:17:25.263932 ip-10-0-138-128 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:25.265172 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.264784    2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 17:17:25.269819 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269803    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:25.269819 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269818    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:25.269819 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269822    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269825    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269828    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269832    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269835    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269839    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269843    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269846    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269851    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269855    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269858    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269860    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269863    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269865    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269868    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269871    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269873    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269876    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269879    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269881    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:25.269921 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269884    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269886    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269898    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269902    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269904    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269907    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269909    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269912    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269915    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269918    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269920    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269923    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269926    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269929    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269932    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269934    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269937    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269941    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269945    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:25.270426 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269948    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269951    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269954    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269956    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269959    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269962    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269964    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269967    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269970    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269972    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269975    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269977    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269980    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269983    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269986    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269989    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269991    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269994    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269996    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.269999    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:25.270965 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270002    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270005    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270008    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270010    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270015    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270017    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270020    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270023    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270025    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270027    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270030    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270033    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270035    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270038    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270041    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270044    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270047    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270050    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270052    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270055    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:25.271471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270057    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270060    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270062    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270065    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270067    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270481    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270487    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270490    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270494    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270497    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270500    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270502    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270505    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270508    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270511    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270514    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270516    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270519    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270521    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270524    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:25.271959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270526    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270529    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270531    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270534    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270537    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270539    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270543    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270545    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270548    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270551    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270553    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270555    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270558    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270560    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270563    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270565    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270568    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270570    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270574    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270576    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:25.272441 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270579    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270581    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270584    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270586    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270589    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270593    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270598    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270603    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270606    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270609    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270612    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270615    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270618    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270620    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270623    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270625    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270628    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270630    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270633    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:25.272940 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270636    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270639    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270641    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270644    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270646    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270649    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270651    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270653    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270656    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270659    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270663    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270666    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270669    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270671    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270673    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270676    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270678    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270681    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270684    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270686    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:25.273412 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270689    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270691    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270694    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270696    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270699    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270701    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270704    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270706    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270709    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270711    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270714    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.270716    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270791    2566 flags.go:64] FLAG: --address="0.0.0.0"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270799    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270807    2566 flags.go:64] FLAG: --anonymous-auth="true"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270812    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270817    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270820    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270825    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270829    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270832    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 17:17:25.273888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270836    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270840    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270843    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270847    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270849    2566 flags.go:64] FLAG: --cgroup-root=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270852    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270855    2566 flags.go:64] FLAG: --client-ca-file=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270858    2566 flags.go:64] FLAG: --cloud-config=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270861    2566 flags.go:64] FLAG: --cloud-provider="external"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270864    2566 flags.go:64] FLAG: --cluster-dns="[]"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270869    2566 flags.go:64] FLAG: --cluster-domain=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270871    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270875    2566 flags.go:64] FLAG: --config-dir=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270878    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270881    2566 flags.go:64] FLAG: --container-log-max-files="5"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270885    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270888    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270891    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270894    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270898    2566 flags.go:64] FLAG: --contention-profiling="false"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270901    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270903    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270906    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270909    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270913    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 17:17:25.274434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270917    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270920    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270924    2566 flags.go:64] FLAG: --enable-load-reader="false"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270927    2566 flags.go:64] FLAG: --enable-server="true"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270930    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270935    2566 flags.go:64] FLAG: --event-burst="100"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270938    2566 flags.go:64] FLAG: --event-qps="50"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270944    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270947    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270950    2566 flags.go:64] FLAG: --eviction-hard=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270954    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270957    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270960    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270963    2566 flags.go:64] FLAG: --eviction-soft=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270966    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270969    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270972    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270975    2566 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270978    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270981    2566 flags.go:64] FLAG: --fail-swap-on="true"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270984    2566 flags.go:64] FLAG: --feature-gates=""
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270988    2566 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270991    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270994    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.270997    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271000    2566 flags.go:64] FLAG: --healthz-port="10248"
May 28 17:17:25.275056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271003    2566 flags.go:64] FLAG: --help="false"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271006    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-128.ec2.internal"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271009    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271012    2566 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271015    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271018    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271021    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271027    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271030    2566 flags.go:64] FLAG: --image-service-endpoint=""
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271033    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271036    2566 flags.go:64] FLAG: --kube-api-burst="100"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271039    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271042    2566 flags.go:64] FLAG: --kube-api-qps="50"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271046    2566 flags.go:64] FLAG: --kube-reserved=""
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271049    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271051    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271054    2566 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271057    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271060    2566 flags.go:64] FLAG: --lock-file=""
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271063    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271066    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271069    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271074    2566 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 17:17:25.275688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271077    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271080    2566 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271083    2566 flags.go:64] FLAG: --logging-format="text"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271086    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271089    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271092    2566 flags.go:64] FLAG: --manifest-url=""
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271095    2566 flags.go:64] FLAG: --manifest-url-header=""
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271099    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271102    2566 flags.go:64] FLAG: --max-open-files="1000000"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271106    2566 flags.go:64] FLAG: --max-pods="110"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271109    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271112    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271115    2566 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271117    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271120    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271123    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271128    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271135    2566 flags.go:64] FLAG: --node-status-max-images="50"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271139    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271142    2566 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271144    2566 flags.go:64] FLAG: --pod-cidr=""
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271147    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271153    2566 flags.go:64] FLAG: --pod-manifest-path=""
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271158    2566 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 17:17:25.276280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271161    2566 flags.go:64] FLAG: --pods-per-core="0"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271165    2566 flags.go:64] FLAG: --port="10250"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271168    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271171    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f301ec524896a4b"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271174    2566 flags.go:64] FLAG: --qos-reserved=""
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271177    2566 flags.go:64] FLAG: --read-only-port="10255"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271179    2566 flags.go:64] FLAG: --register-node="true"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271182    2566 flags.go:64] FLAG: --register-schedulable="true"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271185    2566 flags.go:64] FLAG: --register-with-taints=""
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271189    2566 flags.go:64] FLAG: --registry-burst="10"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271192    2566 flags.go:64] FLAG: --registry-qps="5"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271194    2566 flags.go:64] FLAG: --reserved-cpus=""
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271197    2566 flags.go:64] FLAG: --reserved-memory=""
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271201    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271204    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271207    2566 flags.go:64] FLAG: --rotate-certificates="false"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271210    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271213    2566 flags.go:64] FLAG: --runonce="false"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271216    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271219    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271222    2566 flags.go:64] FLAG: --seccomp-default="false"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271225    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271228    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271231    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271235    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271238    2566 flags.go:64] FLAG: --storage-driver-password="root"
May 28 17:17:25.276885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271242    2566 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271245    2566 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271248    2566 flags.go:64] FLAG: --storage-driver-user="root"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271251    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271254    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271258    2566 flags.go:64] FLAG: --system-cgroups=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271261    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271266    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271269    2566 flags.go:64] FLAG: --tls-cert-file=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271272    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271276    2566 flags.go:64] FLAG: --tls-min-version=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271279    2566 flags.go:64] FLAG: --tls-private-key-file=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271282    2566 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271285    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271288    2566 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271291    2566 flags.go:64] FLAG: --v="2"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271295    2566 flags.go:64] FLAG: --version="false"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271299    2566 flags.go:64] FLAG: --vmodule=""
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271303    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.271307    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271408    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271411    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271414    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271417    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:25.277520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271420    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271423    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271425    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271428    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271431    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271433    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271440    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271443    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271446    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271449    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271451    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271454    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271456    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271460    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271463    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271465    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271468    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271470    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271473    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271476    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:25.278134 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271478    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271481    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271484    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271486    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271489    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271491    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271494    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271496    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271499    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271501    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271504    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271507    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271509    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271511    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271514    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271517    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271519    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271522    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271526    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271528    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:25.278660 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271531    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271533    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271537    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271539    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271542    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271546    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271548    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271551    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271553    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271556    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271558    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271561    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271564    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271566    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271569    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271572    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271574    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271577    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271579    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271582    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:25.279161 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271584    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271587    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271590    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271592    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271595    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271597    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271600    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271602    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271605    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271607    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271611    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271613    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271616    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271620    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271623    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271627    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271629    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271633    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271637    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:25.279692 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271640    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:25.280148 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271643    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:25.280148 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.271646    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:25.280148 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.273395    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:25.281377 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.281359    2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 17:17:25.281413 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.281378    2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 17:17:25.281444 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281434    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:25.281444 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281440    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:25.281444 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281443    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281446    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281450    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281453    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281456    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281460    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281463    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281467    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281471    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281476    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281480    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281483    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281485    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281488    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281491    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281493    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281496    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281498    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281501    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281504    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:25.281519 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281508    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281511    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281513    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281516    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281519    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281521    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281524    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281527    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281530    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281533    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281535    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281538    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281541    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281545    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281549    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281553    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281557    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281560    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281563    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281565    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:25.282004 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281568    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281571    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281573    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281576    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281578    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281581    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281583    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281585    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281588    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281591    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281594    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281596    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281598    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281602    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281605    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281608    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281610    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281612    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281615    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281617    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:25.282559 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281620    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281624    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281628    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281633    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281637    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281639    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281642    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281645    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281647    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281650    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281652    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281655    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281658    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281660    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281663    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281665    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281669    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281672    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281675    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:25.283050 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281678    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281680    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281683    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281687    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281691    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.281696    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281805    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281811    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281815    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281817    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281820    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281822    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281825    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281827    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281829    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:25.283586 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281832    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281834    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281837    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281839    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281842    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281844    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281847    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281851    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281854    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281858    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281863    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281867    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281872    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281875    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281878    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281880    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281883    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281885    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281888    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:25.283955 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281891    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281894    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281896    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281899    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281901    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281905    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281908    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281910    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281913    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281915    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281918    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281920    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281923    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281925    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281927    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281930    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281933    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281936    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281941    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281945    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:25.284425 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281950    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281953    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281956    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281959    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281961    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281964    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281966    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281969    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281972    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281974    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281977    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281979    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281982    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281984    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281987    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281989    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281991    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281994    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.281997    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282000    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:25.284901 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282002    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282005    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282007    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282010    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282013    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282016    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282021    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282025    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282029    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282033    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282035    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282038    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282040    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282043    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282045    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282048    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282050    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:25.285392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:25.282053    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:25.285829 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.282057    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:25.285829 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.282786    2566 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 17:17:25.286506 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.286493    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 17:17:25.287582 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.287571    2566 server.go:1019] "Starting client certificate rotation"
May 28 17:17:25.287689 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.287673    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:17:25.287724 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.287715    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:17:25.316076 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.316059    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:17:25.320146 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.320119    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:17:25.333170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.333150    2566 log.go:25] "Validated CRI v1 runtime API"
May 28 17:17:25.339218 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.339201    2566 log.go:25] "Validated CRI v1 image API"
May 28 17:17:25.344806 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.344791    2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 17:17:25.349725 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.349707    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:17:25.350411 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.350389    2566 fs.go:135] Filesystem UUIDs: map[325c8c63-3413-45ce-a55f-2e0af3f0960f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7ba1f515-b000-4cef-a70b-48de114ae837:/dev/nvme0n1p3]
May 28 17:17:25.350460 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.350412    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 17:17:25.354711 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.354602    2566 manager.go:217] Machine: {Timestamp:2026-05-28 17:17:25.354096373 +0000 UTC m=+0.428189741 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100426 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d4339b79793d32f42e3f092c000e SystemUUID:ec23d433-9b79-793d-32f4-2e3f092c000e BootID:07e1dec3-a9dc-4dcd-ae16-7b3c61f11940 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:e5:d0:56:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:e5:d0:56:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:81:ea:da:58:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 17:17:25.355443 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.355432    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 17:17:25.355529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.355518    2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 17:17:25.358302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.358277    2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 17:17:25.358451 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.358304    2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 17:17:25.358499 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.358460    2566 topology_manager.go:138] "Creating topology manager with none policy"
May 28 17:17:25.358499 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.358468    2566 container_manager_linux.go:306] "Creating device plugin manager"
May 28 17:17:25.358499 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.358479    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:17:25.359325 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.359315    2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:17:25.361602 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.361592    2566 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:17:25.361707 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.361699    2566 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 17:17:25.366374 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.366365    2566 kubelet.go:491] "Attempting to sync node with API server"
May 28 17:17:25.366408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.366378    2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 17:17:25.366408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.366390    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 17:17:25.366408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.366399    2566 kubelet.go:397] "Adding apiserver pod source"
May 28 17:17:25.366408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.366408    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 17:17:25.367563 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.367545    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2bq4"
May 28 17:17:25.367637 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.367626    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:17:25.367672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.367646    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:17:25.371388 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.371368    2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 17:17:25.373962 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.373946    2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 17:17:25.374124 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374110    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2bq4"
May 28 17:17:25.374945 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374932    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374950    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374957    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374968    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374977    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374983    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374989    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.374995    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.375003    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 17:17:25.375012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.375009    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 17:17:25.375240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.375017    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 17:17:25.377206 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.377188    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 17:17:25.377265 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.377237    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 17:17:25.377265 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.377246    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 17:17:25.380701 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.380687    2566 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 17:17:25.380786 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.380722    2566 server.go:1295] "Started kubelet"
May 28 17:17:25.380837 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.380795    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 17:17:25.381268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.380807    2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 17:17:25.381320 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.381284    2566 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 17:17:25.381514 ip-10-0-138-128 systemd[1]: Started Kubernetes Kubelet.
May 28 17:17:25.382066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.381755    2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:25.383406 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.383392    2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 17:17:25.384029 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.384013    2566 server.go:317] "Adding debug handlers to kubelet server"
May 28 17:17:25.384476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.384460    2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:25.387068 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.387046    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-128.ec2.internal" not found
May 28 17:17:25.390639 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390623    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 17:17:25.390717 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390638    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 17:17:25.390784 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390688    2566 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 17:17:25.390876 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390856    2566 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 17:17:25.390992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390840    2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 17:17:25.390992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390975    2566 reconstruct.go:97] "Volume reconstruction finished"
May 28 17:17:25.390992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.390984    2566 reconciler.go:26] "Reconciler: start to sync state"
May 28 17:17:25.391773 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391595    2566 factory.go:55] Registering systemd factory
May 28 17:17:25.391773 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391613    2566 factory.go:223] Registration of the systemd container factory successfully
May 28 17:17:25.391773 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.391672    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-128.ec2.internal\" not found"
May 28 17:17:25.391966 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391829    2566 factory.go:153] Registering CRI-O factory
May 28 17:17:25.391966 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391842    2566 factory.go:223] Registration of the crio container factory successfully
May 28 17:17:25.391966 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391892    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 17:17:25.391966 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391911    2566 factory.go:103] Registering Raw factory
May 28 17:17:25.391966 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.391930    2566 manager.go:1196] Started watching for new ooms in manager
May 28 17:17:25.392371 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.392338    2566 manager.go:319] Starting recovery of all containers
May 28 17:17:25.392569 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.392545    2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 17:17:25.393547 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.393523    2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:25.396601 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.396139    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-128.ec2.internal\" not found" node="ip-10-0-138-128.ec2.internal"
May 28 17:17:25.402223 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.402180    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 17:17:25.402777 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.402756    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-128.ec2.internal" not found
May 28 17:17:25.404237 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.404222    2566 manager.go:324] Recovery completed
May 28 17:17:25.409017 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.409003    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:25.411640 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.411626    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:25.411701 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.411652    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:25.411701 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.411662    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:25.412101 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.412088    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 17:17:25.412101 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.412100    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 17:17:25.412189 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.412116    2566 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:17:25.416049 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.416036    2566 policy_none.go:49] "None policy: Start"
May 28 17:17:25.416090 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.416054    2566 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 17:17:25.416090 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.416065    2566 state_mem.go:35] "Initializing new in-memory state store"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456396    2566 manager.go:341] "Starting Device Plugin manager"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.456444    2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456454    2566 server.go:85] "Starting device plugin registration server"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456687    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456700    2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456826    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456894    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.456903    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.457659    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.457693    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-128.ec2.internal\" not found"
May 28 17:17:25.481147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.461658    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-128.ec2.internal" not found
May 28 17:17:25.529994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.529924    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 17:17:25.529994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.529950    2566 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 17:17:25.529994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.529966    2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 17:17:25.529994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.529972    2566 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 17:17:25.530209 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:25.530057    2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 17:17:25.532473 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.532448    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:25.557546 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.557525    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:25.558576 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.558563    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:25.558629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.558591    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:25.558629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.558600    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:25.558698 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.558646    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-128.ec2.internal"
May 28 17:17:25.569364 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.569332    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-128.ec2.internal"
May 28 17:17:25.631032 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.631002    2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"]
May 28 17:17:25.633636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.633620    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.633721 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.633622    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.658892 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.658872    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.663091 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.663077    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.669748 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.669734    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:17:25.674850 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.674838    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:17:25.792125 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.792051    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.792125 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.792082    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.792125 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.792101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2544b04d8b83fb05baa4b5e8cc4db64e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-128.ec2.internal\" (UID: \"2544b04d8b83fb05baa4b5e8cc4db64e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892216    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892247    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2544b04d8b83fb05baa4b5e8cc4db64e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-128.ec2.internal\" (UID: \"2544b04d8b83fb05baa4b5e8cc4db64e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892269    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892324    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2544b04d8b83fb05baa4b5e8cc4db64e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-128.ec2.internal\" (UID: \"2544b04d8b83fb05baa4b5e8cc4db64e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892357    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.892414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.892321    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dfd6a66e353b5aa06eb4975d60d7cf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal\" (UID: \"6dfd6a66e353b5aa06eb4975d60d7cf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.973457 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.973428    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal"
May 28 17:17:25.977134 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:25.977113    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal"
May 28 17:17:26.287193 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.287154    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 17:17:26.287974 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.287315    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:17:26.287974 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.287335    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:17:26.287974 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.287355    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:17:26.367099 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.367069    2566 apiserver.go:52] "Watching apiserver"
May 28 17:17:26.372669 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.372641    2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 17:17:26.372963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.372941    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal","openshift-multus/network-metrics-daemon-t79nx","openshift-network-diagnostics/network-check-target-gw7ps","openshift-network-operator/iptables-alerter-jwcgx","openshift-ovn-kubernetes/ovnkube-node-mq42g","kube-system/konnectivity-agent-r8rtm","openshift-cluster-node-tuning-operator/tuned-f4bbm","openshift-dns/node-resolver-fb46x","openshift-multus/multus-additional-cni-plugins-56974","openshift-multus/multus-kpvk8","kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp","openshift-image-registry/node-ca-dhqfw"]
May 28 17:17:26.377642 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.377618    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:12:25 +0000 UTC" deadline="2027-12-22 16:32:13.629181477 +0000 UTC"
May 28 17:17:26.377642 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.377641    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13751h14m47.251543069s"
May 28 17:17:26.377759 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.377711    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.377792 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.377779    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:26.379560 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.379541    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:26.379630 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.379618    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.379758 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.379617    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:26.381085 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.381066    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 17:17:26.381180 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.381163    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 17:17:26.381236 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.381202    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wn2cg\""
May 28 17:17:26.381236 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.381224    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 17:17:26.382009 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.381995    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.383240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383221    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 17:17:26.383439 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383424    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 17:17:26.383575 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383564    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-59ppf\""
May 28 17:17:26.383838 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383821    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 17:17:26.383909 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383847    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 17:17:26.383909 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383852    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 17:17:26.384002 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.383930    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 17:17:26.384243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.384230    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.385541 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.385523    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 17:17:26.385627 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.385553    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v8gkt\""
May 28 17:17:26.385627 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.385577    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 17:17:26.386422 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.386406    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.387669 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.387649    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 17:17:26.387761 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.387688    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8knwf\""
May 28 17:17:26.387814 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.387786    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 17:17:26.391029 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.391015    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 17:17:26.391121 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.391080    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.391496 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.391205    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.392698 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.392681    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 17:17:26.393064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.393046    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 17:17:26.393193 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.393173    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.394235 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.393765    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 17:17:26.394235 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394035    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 17:17:26.394235 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394151    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 17:17:26.394446 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394335    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 17:17:26.394446 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394403    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 17:17:26.394721 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394702    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8zz5m\""
May 28 17:17:26.394899 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.394883    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hp2wb\""
May 28 17:17:26.395062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395042    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-system-cni-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.395127 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395096    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-os-release\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.395180 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpp7\" (UniqueName: \"kubernetes.io/projected/37f40b18-1e03-49b9-be25-0bbea41ded20-kube-api-access-mqpp7\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.395180 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysconfig\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.395268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-sys\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.395268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395212    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cz8hc\""
May 28 17:17:26.395268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-multus\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-kubelet\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395286    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395292    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395325    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npft\" (UniqueName: \"kubernetes.io/projected/e8753a0f-344d-4ff4-a7be-41985cef29aa-kube-api-access-5npft\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395375    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ad79674-5349-4825-8218-5daf5f1e31dc-konnectivity-ca\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.395430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fffkg\" (UniqueName: \"kubernetes.io/projected/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-kube-api-access-fffkg\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-kubernetes\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-systemd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-tuned\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-kubelet\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-log-socket\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395614    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-netd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ad79674-5349-4825-8218-5daf5f1e31dc-agent-certs\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.395682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tt85\" (UniqueName: \"kubernetes.io/projected/6cffb8bf-b894-4f0c-9b29-5ff297851e23-kube-api-access-2tt85\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395738    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-run\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-lib-modules\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395832    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-system-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-netns\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfnwl\" (UniqueName: \"kubernetes.io/projected/a5a56189-5660-45b6-bb3b-415e4d04468e-kube-api-access-nfnwl\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-var-lib-kubelet\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.396028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.395957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8753a0f-344d-4ff4-a7be-41985cef29aa-hosts-file\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-hostroot\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-multus-certs\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-var-lib-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396202    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxxd\" (UniqueName: \"kubernetes.io/projected/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-kube-api-access-mjxxd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-os-release\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396283    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-socket-dir-parent\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396335    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-conf-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396383    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.396818 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-systemd-units\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.396867 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396833    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-k8s-cni-cncf-io\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.396916 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396874    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-systemd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.396916 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396904    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-conf\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.397000 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cffb8bf-b894-4f0c-9b29-5ff297851e23-iptables-alerter-script\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.397000 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-netns\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397000 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.396995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-etc-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397137 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-config\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397137 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397102    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6133c0a4-4772-45fb-b258-54d47720a54c-ovn-node-metrics-cert\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397223 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-tmp\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.397271 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-cni-binary-copy\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.397271 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397255    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-ovn\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397298    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cffb8bf-b894-4f0c-9b29-5ff297851e23-host-slash\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.397408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397327    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8753a0f-344d-4ff4-a7be-41985cef29aa-tmp-dir\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.397526 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589wr\" (UniqueName: \"kubernetes.io/projected/6133c0a4-4772-45fb-b258-54d47720a54c-kube-api-access-589wr\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.397662 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-modprobe-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.397732 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.397695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.398045 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-script-lib\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398129 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-etc-kubernetes\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.398129 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398092    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-slash\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398129 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-bin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398138    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-node-log\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-env-overrides\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398172    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-binary-copy\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398213    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.398297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-host\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398303    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-daemon-config\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398387    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27bsv\""
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398450    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398462    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-cnibin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-cnibin\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398583 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-bin\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.398926 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398639    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 17:17:26.398960 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.398925    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.400177 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.400160    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 17:17:26.400267 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.400251    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 17:17:26.400748 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.400734    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 17:17:26.400848 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.400760    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-486d5\""
May 28 17:17:26.402058 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.402042    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:17:26.424887 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.424865    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gsff4"
May 28 17:17:26.434911 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.434889    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gsff4"
May 28 17:17:26.492298 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.492274    2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 17:17:26.498968 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.498940    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-system-cni-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.498982    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-os-release\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499004    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-system-cni-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499010    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpp7\" (UniqueName: \"kubernetes.io/projected/37f40b18-1e03-49b9-be25-0bbea41ded20-kube-api-access-mqpp7\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499036    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysconfig\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499062 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499059    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-sys\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499074    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-os-release\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499115    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-sys\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499127    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysconfig\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499170    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-multus\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499199    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-kubelet\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499226    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499237    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-multus\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499252    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-kubelet\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499258    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5npft\" (UniqueName: \"kubernetes.io/projected/e8753a0f-344d-4ff4-a7be-41985cef29aa-kube-api-access-5npft\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499275    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499296    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-device-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499317    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ad79674-5349-4825-8218-5daf5f1e31dc-konnectivity-ca\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499356    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fffkg\" (UniqueName: \"kubernetes.io/projected/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-kube-api-access-fffkg\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499382    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-kubernetes\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499408    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-systemd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499460    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-systemd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499456    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-kubernetes\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499481    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-tuned\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499508    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-kubelet\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499533    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-log-socket\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499557    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-netd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499570    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-kubelet\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499582    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ad79674-5349-4825-8218-5daf5f1e31dc-agent-certs\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-log-socket\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499608    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499669    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tt85\" (UniqueName: \"kubernetes.io/projected/6cffb8bf-b894-4f0c-9b29-5ff297851e23-kube-api-access-2tt85\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499694    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-run\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.499851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499718    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-lib-modules\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499742    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-system-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499752    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499765    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-netns\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499790    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfnwl\" (UniqueName: \"kubernetes.io/projected/a5a56189-5660-45b6-bb3b-415e4d04468e-kube-api-access-nfnwl\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499811    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-var-lib-kubelet\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499834    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8753a0f-344d-4ff4-a7be-41985cef29aa-hosts-file\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499857    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-hostroot\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499885    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-multus-certs\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499912    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-var-lib-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499938    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-registration-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499998    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxxd\" (UniqueName: \"kubernetes.io/projected/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-kube-api-access-mjxxd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500021    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-os-release\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500045    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-socket-dir-parent\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500071    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-conf-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500097    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-systemd-units\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500124    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-k8s-cni-cncf-io\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.500775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500161    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-systemd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500193    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82d34df2-3f34-44a8-8384-8de3380ff168-serviceca\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgdb\" (UniqueName: \"kubernetes.io/projected/82d34df2-3f34-44a8-8384-8de3380ff168-kube-api-access-flgdb\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500254    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-conf\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500300    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-run\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500310    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cffb8bf-b894-4f0c-9b29-5ff297851e23-iptables-alerter-script\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500365    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-netns\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500398    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-etc-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500429    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-config\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500456    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6133c0a4-4772-45fb-b258-54d47720a54c-ovn-node-metrics-cert\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500485    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-tmp\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500510    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-cni-binary-copy\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500537    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-ovn\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500563    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cffb8bf-b894-4f0c-9b29-5ff297851e23-host-slash\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500586    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8753a0f-344d-4ff4-a7be-41985cef29aa-tmp-dir\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500612    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-589wr\" (UniqueName: \"kubernetes.io/projected/6133c0a4-4772-45fb-b258-54d47720a54c-kube-api-access-589wr\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.501659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500670    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-modprobe-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500692    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500718    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-script-lib\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500744    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82d34df2-3f34-44a8-8384-8de3380ff168-host\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500769    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-etc-kubernetes\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500794    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-slash\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500819    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-bin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500845    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-node-log\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500847    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cffb8bf-b894-4f0c-9b29-5ff297851e23-iptables-alerter-script\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500871    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-env-overrides\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500903    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-sys-fs\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500932    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-binary-copy\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500959    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.500987    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501029    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501056    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-host\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.502423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501078    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ad79674-5349-4825-8218-5daf5f1e31dc-konnectivity-ca\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501091    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-daemon-config\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-socket-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501152    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501157    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-systemd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501183    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501190    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501210    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-cnibin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501215    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-os-release\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2ss\" (UniqueName: \"kubernetes.io/projected/e497098e-39a8-405d-bfda-3e7209e2ba1d-kube-api-access-xn2ss\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501269    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-cnibin\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501270    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-socket-dir-parent\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501304    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-conf-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.499628    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-netd\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501338    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-conf\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501370    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501401    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-lib-modules\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.503204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501407    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-systemd-units\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501401    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-bin\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501429    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-cni-bin\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501371    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-k8s-cni-cncf-io\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501453    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-etc-kubernetes\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501484    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-netns\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501504    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-system-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501541    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-run-multus-certs\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501545    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501559    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501584    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-var-lib-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501584    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-var-lib-kubelet\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501612    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-slash\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501622    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-etc-openvswitch\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501634    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-host-run-netns\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501645    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-host-var-lib-cni-bin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501682    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-hostroot\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501761    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-sysctl-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.504010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501809    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-host\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.501938    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-script-lib\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502082    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-binary-copy\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502144    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8753a0f-344d-4ff4-a7be-41985cef29aa-hosts-file\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502169    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-ovnkube-config\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502233    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502239    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-cnibin\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502248    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-cni-dir\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502288    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cffb8bf-b894-4f0c-9b29-5ff297851e23-host-slash\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502459    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-multus-daemon-config\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502508    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-run-ovn\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502541    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8753a0f-344d-4ff4-a7be-41985cef29aa-tmp-dir\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.502577    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.502643    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:27.002622935 +0000 UTC m=+2.076716327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502790    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-tuned\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502794    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-etc-modprobe-d\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502935    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6133c0a4-4772-45fb-b258-54d47720a54c-node-log\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502935    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5a56189-5660-45b6-bb3b-415e4d04468e-cni-binary-copy\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.504835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.502978    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37f40b18-1e03-49b9-be25-0bbea41ded20-cnibin\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.505476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.503056    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ad79674-5349-4825-8218-5daf5f1e31dc-agent-certs\") pod \"konnectivity-agent-r8rtm\" (UID: \"9ad79674-5349-4825-8218-5daf5f1e31dc\") " pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.505476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.503172    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37f40b18-1e03-49b9-be25-0bbea41ded20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.505476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.503337    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6133c0a4-4772-45fb-b258-54d47720a54c-env-overrides\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.505476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.504602    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-tmp\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.505476 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.504799    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6133c0a4-4772-45fb-b258-54d47720a54c-ovn-node-metrics-cert\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.506647 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.506625    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpp7\" (UniqueName: \"kubernetes.io/projected/37f40b18-1e03-49b9-be25-0bbea41ded20-kube-api-access-mqpp7\") pod \"multus-additional-cni-plugins-56974\" (UID: \"37f40b18-1e03-49b9-be25-0bbea41ded20\") " pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.506797 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.506718    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fffkg\" (UniqueName: \"kubernetes.io/projected/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-kube-api-access-fffkg\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:26.506913 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.506897    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npft\" (UniqueName: \"kubernetes.io/projected/e8753a0f-344d-4ff4-a7be-41985cef29aa-kube-api-access-5npft\") pod \"node-resolver-fb46x\" (UID: \"e8753a0f-344d-4ff4-a7be-41985cef29aa\") " pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.507046 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.507032    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tt85\" (UniqueName: \"kubernetes.io/projected/6cffb8bf-b894-4f0c-9b29-5ff297851e23-kube-api-access-2tt85\") pod \"iptables-alerter-jwcgx\" (UID: \"6cffb8bf-b894-4f0c-9b29-5ff297851e23\") " pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.507552 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.507528    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxxd\" (UniqueName: \"kubernetes.io/projected/80ba09bc-13d4-437e-a0ca-3f3677cd91a1-kube-api-access-mjxxd\") pod \"tuned-f4bbm\" (UID: \"80ba09bc-13d4-437e-a0ca-3f3677cd91a1\") " pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.507677 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.507660    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:26.507724 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.507683    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:26.507724 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.507697    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:26.507790 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:26.507773    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:27.00775193 +0000 UTC m=+2.081845300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:26.509282 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.509263    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfnwl\" (UniqueName: \"kubernetes.io/projected/a5a56189-5660-45b6-bb3b-415e4d04468e-kube-api-access-nfnwl\") pod \"multus-kpvk8\" (UID: \"a5a56189-5660-45b6-bb3b-415e4d04468e\") " pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.509512 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.509486    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-589wr\" (UniqueName: \"kubernetes.io/projected/6133c0a4-4772-45fb-b258-54d47720a54c-kube-api-access-589wr\") pod \"ovnkube-node-mq42g\" (UID: \"6133c0a4-4772-45fb-b258-54d47720a54c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.518471 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.518440    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfd6a66e353b5aa06eb4975d60d7cf4.slice/crio-0e7fdfb5ec6c86d89543ea0f3e502829ebacea6aa006b7dbded2cb41d3b0957f WatchSource:0}: Error finding container 0e7fdfb5ec6c86d89543ea0f3e502829ebacea6aa006b7dbded2cb41d3b0957f: Status 404 returned error can't find the container with id 0e7fdfb5ec6c86d89543ea0f3e502829ebacea6aa006b7dbded2cb41d3b0957f
May 28 17:17:26.518700 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.518683    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2544b04d8b83fb05baa4b5e8cc4db64e.slice/crio-c83c01db32b05f2b0a97790b7982eed0d5397850a333d0dcb773d35714214fd1 WatchSource:0}: Error finding container c83c01db32b05f2b0a97790b7982eed0d5397850a333d0dcb773d35714214fd1: Status 404 returned error can't find the container with id c83c01db32b05f2b0a97790b7982eed0d5397850a333d0dcb773d35714214fd1
May 28 17:17:26.524562 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.524543    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:17:26.529395 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.529376    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpvk8"
May 28 17:17:26.533087 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.533049    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal" event={"ID":"2544b04d8b83fb05baa4b5e8cc4db64e","Type":"ContainerStarted","Data":"c83c01db32b05f2b0a97790b7982eed0d5397850a333d0dcb773d35714214fd1"}
May 28 17:17:26.534142 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.534114    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal" event={"ID":"6dfd6a66e353b5aa06eb4975d60d7cf4","Type":"ContainerStarted","Data":"0e7fdfb5ec6c86d89543ea0f3e502829ebacea6aa006b7dbded2cb41d3b0957f"}
May 28 17:17:26.536121 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.536099    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a56189_5660_45b6_bb3b_415e4d04468e.slice/crio-1853fb9af86a603308b69ef36f6b051861952ae21693164d480a09b886bb1cb3 WatchSource:0}: Error finding container 1853fb9af86a603308b69ef36f6b051861952ae21693164d480a09b886bb1cb3: Status 404 returned error can't find the container with id 1853fb9af86a603308b69ef36f6b051861952ae21693164d480a09b886bb1cb3
May 28 17:17:26.602138 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602111    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82d34df2-3f34-44a8-8384-8de3380ff168-host\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.602138 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602143    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-sys-fs\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602317 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602223    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82d34df2-3f34-44a8-8384-8de3380ff168-host\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.602317 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602222    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-socket-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602317 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602254    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-sys-fs\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602311    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2ss\" (UniqueName: \"kubernetes.io/projected/e497098e-39a8-405d-bfda-3e7209e2ba1d-kube-api-access-xn2ss\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602359    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-socket-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602386    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-device-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602457    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-device-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602650 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602571    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-registration-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602650 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602592    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82d34df2-3f34-44a8-8384-8de3380ff168-serviceca\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.602650 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602616    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flgdb\" (UniqueName: \"kubernetes.io/projected/82d34df2-3f34-44a8-8384-8de3380ff168-kube-api-access-flgdb\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.602650 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602643    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602816 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602668    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-registration-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602816 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602691    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602816 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602715    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.602816 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602756    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e497098e-39a8-405d-bfda-3e7209e2ba1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.603009 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.602992    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82d34df2-3f34-44a8-8384-8de3380ff168-serviceca\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.609103 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.609079    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2ss\" (UniqueName: \"kubernetes.io/projected/e497098e-39a8-405d-bfda-3e7209e2ba1d-kube-api-access-xn2ss\") pod \"aws-ebs-csi-driver-node-82hzp\" (UID: \"e497098e-39a8-405d-bfda-3e7209e2ba1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.609192 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.609080    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgdb\" (UniqueName: \"kubernetes.io/projected/82d34df2-3f34-44a8-8384-8de3380ff168-kube-api-access-flgdb\") pod \"node-ca-dhqfw\" (UID: \"82d34df2-3f34-44a8-8384-8de3380ff168\") " pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.713249 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.713216    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwcgx"
May 28 17:17:26.718959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.718933    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cffb8bf_b894_4f0c_9b29_5ff297851e23.slice/crio-f510c2470b108d75def2bfcc7b3b3166448456587f651f28929931190c98b4a2 WatchSource:0}: Error finding container f510c2470b108d75def2bfcc7b3b3166448456587f651f28929931190c98b4a2: Status 404 returned error can't find the container with id f510c2470b108d75def2bfcc7b3b3166448456587f651f28929931190c98b4a2
May 28 17:17:26.732226 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.732200    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:26.733735 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.733719    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:26.738127 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.738105    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6133c0a4_4772_45fb_b258_54d47720a54c.slice/crio-ee7c10c4d817fe2434b234e2722d3c0df4b933406a30904603f1f98df8e7bd56 WatchSource:0}: Error finding container ee7c10c4d817fe2434b234e2722d3c0df4b933406a30904603f1f98df8e7bd56: Status 404 returned error can't find the container with id ee7c10c4d817fe2434b234e2722d3c0df4b933406a30904603f1f98df8e7bd56
May 28 17:17:26.739895 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.739873    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad79674_5349_4825_8218_5daf5f1e31dc.slice/crio-4baa9dbd1ebaf65136870b9753f5d69dedce0c0aebbefeab1d164504e72b1b60 WatchSource:0}: Error finding container 4baa9dbd1ebaf65136870b9753f5d69dedce0c0aebbefeab1d164504e72b1b60: Status 404 returned error can't find the container with id 4baa9dbd1ebaf65136870b9753f5d69dedce0c0aebbefeab1d164504e72b1b60
May 28 17:17:26.757857 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.757840    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4bbm"
May 28 17:17:26.764223 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.764202    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ba09bc_13d4_437e_a0ca_3f3677cd91a1.slice/crio-b6825390ce645a3293faab83bceb6dcb38ef8d73a6990cc96d1cddfc2be89b71 WatchSource:0}: Error finding container b6825390ce645a3293faab83bceb6dcb38ef8d73a6990cc96d1cddfc2be89b71: Status 404 returned error can't find the container with id b6825390ce645a3293faab83bceb6dcb38ef8d73a6990cc96d1cddfc2be89b71
May 28 17:17:26.782170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.782150    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fb46x"
May 28 17:17:26.787396 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.787373    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8753a0f_344d_4ff4_a7be_41985cef29aa.slice/crio-15e94807dfebca62d73f97552ed56bda1e2719679606e624435908b519160bd0 WatchSource:0}: Error finding container 15e94807dfebca62d73f97552ed56bda1e2719679606e624435908b519160bd0: Status 404 returned error can't find the container with id 15e94807dfebca62d73f97552ed56bda1e2719679606e624435908b519160bd0
May 28 17:17:26.796205 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.796187    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56974"
May 28 17:17:26.801765 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.801746    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f40b18_1e03_49b9_be25_0bbea41ded20.slice/crio-37a0067a8261a0b7bcde57aa1d41f93ab639ff7c3ab7208ec9e77855efeefae3 WatchSource:0}: Error finding container 37a0067a8261a0b7bcde57aa1d41f93ab639ff7c3ab7208ec9e77855efeefae3: Status 404 returned error can't find the container with id 37a0067a8261a0b7bcde57aa1d41f93ab639ff7c3ab7208ec9e77855efeefae3
May 28 17:17:26.846485 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.846456    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp"
May 28 17:17:26.847976 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:26.847954    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhqfw"
May 28 17:17:26.855665 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.855636    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode497098e_39a8_405d_bfda_3e7209e2ba1d.slice/crio-261326a23999daad5d1f97120bec5bdb3e81191a32f84b9f1a3e2111c0689794 WatchSource:0}: Error finding container 261326a23999daad5d1f97120bec5bdb3e81191a32f84b9f1a3e2111c0689794: Status 404 returned error can't find the container with id 261326a23999daad5d1f97120bec5bdb3e81191a32f84b9f1a3e2111c0689794
May 28 17:17:26.856576 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:17:26.856554    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d34df2_3f34_44a8_8384_8de3380ff168.slice/crio-20320e7fe420ef6b26593469c8b511d659c1953f5654d439b66cb9abcb87fa44 WatchSource:0}: Error finding container 20320e7fe420ef6b26593469c8b511d659c1953f5654d439b66cb9abcb87fa44: Status 404 returned error can't find the container with id 20320e7fe420ef6b26593469c8b511d659c1953f5654d439b66cb9abcb87fa44
May 28 17:17:27.006760 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.006711    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:27.006930 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.006902    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:27.006987 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.006973    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.006955258 +0000 UTC m=+3.081048617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:27.099128 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.099048    2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:27.108260 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.107675    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:27.108260 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.107830    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:27.108260 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.107847    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:27.108260 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.107885    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:27.108260 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:27.107939    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.10792171 +0000 UTC m=+3.182015079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:27.432994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.432920    2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:27.435742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.435712    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:26 +0000 UTC" deadline="2028-02-26 02:10:24.249361682 +0000 UTC"
May 28 17:17:27.435742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.435741    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15320h52m56.813623703s"
May 28 17:17:27.547171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.547096    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhqfw" event={"ID":"82d34df2-3f34-44a8-8384-8de3380ff168","Type":"ContainerStarted","Data":"20320e7fe420ef6b26593469c8b511d659c1953f5654d439b66cb9abcb87fa44"}
May 28 17:17:27.555685 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.555648    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp" event={"ID":"e497098e-39a8-405d-bfda-3e7209e2ba1d","Type":"ContainerStarted","Data":"261326a23999daad5d1f97120bec5bdb3e81191a32f84b9f1a3e2111c0689794"}
May 28 17:17:27.563459 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.563430    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fb46x" event={"ID":"e8753a0f-344d-4ff4-a7be-41985cef29aa","Type":"ContainerStarted","Data":"15e94807dfebca62d73f97552ed56bda1e2719679606e624435908b519160bd0"}
May 28 17:17:27.579023 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.578991    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4bbm" event={"ID":"80ba09bc-13d4-437e-a0ca-3f3677cd91a1","Type":"ContainerStarted","Data":"b6825390ce645a3293faab83bceb6dcb38ef8d73a6990cc96d1cddfc2be89b71"}
May 28 17:17:27.584954 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.584927    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"ee7c10c4d817fe2434b234e2722d3c0df4b933406a30904603f1f98df8e7bd56"}
May 28 17:17:27.608632 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.608600    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpvk8" event={"ID":"a5a56189-5660-45b6-bb3b-415e4d04468e","Type":"ContainerStarted","Data":"1853fb9af86a603308b69ef36f6b051861952ae21693164d480a09b886bb1cb3"}
May 28 17:17:27.614843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.614801    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerStarted","Data":"37a0067a8261a0b7bcde57aa1d41f93ab639ff7c3ab7208ec9e77855efeefae3"}
May 28 17:17:27.617275 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.617103    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8rtm" event={"ID":"9ad79674-5349-4825-8218-5daf5f1e31dc","Type":"ContainerStarted","Data":"4baa9dbd1ebaf65136870b9753f5d69dedce0c0aebbefeab1d164504e72b1b60"}
May 28 17:17:27.639838 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.639798    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwcgx" event={"ID":"6cffb8bf-b894-4f0c-9b29-5ff297851e23","Type":"ContainerStarted","Data":"f510c2470b108d75def2bfcc7b3b3166448456587f651f28929931190c98b4a2"}
May 28 17:17:27.762851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:27.762824    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:28.014046 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.013956    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:28.014217 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.014150    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:28.014281 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.014229    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:30.014211526 +0000 UTC m=+5.088304885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:28.114536 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.114485    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:28.114740 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.114662    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:28.114740 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.114681    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:28.114740 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.114694    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:28.114918 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.114750    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:30.114730432 +0000 UTC m=+5.188823792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:28.436114 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.436020    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:26 +0000 UTC" deadline="2027-12-15 04:52:13.160338759 +0000 UTC"
May 28 17:17:28.436114 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.436063    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13571h34m44.724279673s"
May 28 17:17:28.531171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.531138    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:28.531478 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.531264    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:28.531570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:28.531548    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:28.531723 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:28.531672    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:30.029410 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:30.029368    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:30.029873 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.029543    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:30.029873 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.029607    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:34.029589375 +0000 UTC m=+9.103682744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:30.129988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:30.129949    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:30.130189 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.130138    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:30.130189 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.130158    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:30.130189 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.130171    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:30.130392 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.130241    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:34.130222069 +0000 UTC m=+9.204315428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:30.531095 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:30.530883    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:30.531095 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.531034    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:30.531544 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:30.530882    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:30.531544 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:30.531483    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:32.530770 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:32.530519    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:32.530770 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:32.530571    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:32.530770 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:32.530683    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:32.531299 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:32.531143    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:34.062740 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:34.062699    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:34.063207 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.062850    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:34.063207 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.062920    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:42.062900151 +0000 UTC m=+17.136993513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:34.163610 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:34.163572    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:34.163870 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.163724    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:34.163870 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.163742    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:34.163870 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.163755    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:34.163870 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.163806    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:42.163788708 +0000 UTC m=+17.237882067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:34.531189 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:34.531156    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:34.531417 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:34.531163    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:34.531417 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.531301    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:34.531417 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:34.531386    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:36.530475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:36.530439    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:36.530909 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:36.530442    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:36.530909 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:36.530562    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:36.530909 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:36.530632    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:38.530427 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:38.530390    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:38.530859 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:38.530390    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:38.530859 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:38.530540    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:38.530859 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:38.530596    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:40.530530 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:40.530496    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:40.530980 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:40.530501    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:40.530980 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:40.530605    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:40.530980 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:40.530727    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:42.118100 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:42.118062    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:42.118607 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.118223    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:42.118607 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.118301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:58.118282172 +0000 UTC m=+33.192375528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:42.219107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:42.219076    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:42.219285 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.219217    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:42.219285 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.219231    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:42.219285 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.219241    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:42.219450 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.219296    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:58.219281833 +0000 UTC m=+33.293375209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:42.530418 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:42.530384    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:42.530598 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:42.530385    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:42.530598 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.530518    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:42.530680 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:42.530610    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:44.530255 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:44.530220    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:44.530727 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:44.530219    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:44.530727 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:44.530330    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:44.530727 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:44.530466    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:46.531317 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.531078    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:46.531918 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.531081    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:46.531918 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:46.531402    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:46.531918 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:46.531498    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:46.677259 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.677231    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4bbm" event={"ID":"80ba09bc-13d4-437e-a0ca-3f3677cd91a1","Type":"ContainerStarted","Data":"aa77654be74f5949615473bca5475b26807ff90dddf1572f7e33942d9d9763ca"}
May 28 17:17:46.678299 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.678272    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpvk8" event={"ID":"a5a56189-5660-45b6-bb3b-415e4d04468e","Type":"ContainerStarted","Data":"bf2a4d98dd3e9a3fa524b93fae8ded5009b27e4a94b7bde4eab731f3a8379cf3"}
May 28 17:17:46.679275 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.679256    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal" event={"ID":"2544b04d8b83fb05baa4b5e8cc4db64e","Type":"ContainerStarted","Data":"214ae388d28d31377261a2e098bbe8cadae7a1ff9f731de80bad6329e3c8fed6"}
May 28 17:17:46.691720 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.691681    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f4bbm" podStartSLOduration=2.7956697520000002 podStartE2EDuration="21.691670784s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.765595636 +0000 UTC m=+1.839688991" lastFinishedPulling="2026-05-28 17:17:45.661596669 +0000 UTC m=+20.735690023" observedRunningTime="2026-05-28 17:17:46.691184765 +0000 UTC m=+21.765278153" watchObservedRunningTime="2026-05-28 17:17:46.691670784 +0000 UTC m=+21.765764162"
May 28 17:17:46.703383 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.703328    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-128.ec2.internal" podStartSLOduration=21.703315236 podStartE2EDuration="21.703315236s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:46.702936604 +0000 UTC m=+21.777029985" watchObservedRunningTime="2026-05-28 17:17:46.703315236 +0000 UTC m=+21.777408612"
May 28 17:17:46.716105 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:46.716072    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kpvk8" podStartSLOduration=2.5929679979999998 podStartE2EDuration="21.716060627s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.537982501 +0000 UTC m=+1.612075857" lastFinishedPulling="2026-05-28 17:17:45.661075131 +0000 UTC m=+20.735168486" observedRunningTime="2026-05-28 17:17:46.716002771 +0000 UTC m=+21.790096149" watchObservedRunningTime="2026-05-28 17:17:46.716060627 +0000 UTC m=+21.790154004"
May 28 17:17:47.682565 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.682529    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8rtm" event={"ID":"9ad79674-5349-4825-8218-5daf5f1e31dc","Type":"ContainerStarted","Data":"55de16fe579c78bb773ffed65f6c00b3786325d902654f9cf13a4eb9de4ba365"}
May 28 17:17:47.684066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.684031    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwcgx" event={"ID":"6cffb8bf-b894-4f0c-9b29-5ff297851e23","Type":"ContainerStarted","Data":"1857645107dadb5457bd45e11d23664351609bfab11bd03ef3406a59eb62faf4"}
May 28 17:17:47.685522 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.685492    2566 generic.go:358] "Generic (PLEG): container finished" podID="6dfd6a66e353b5aa06eb4975d60d7cf4" containerID="7a7791c18fe66c7b6f9584b7d41444619f9b573e7e745fa299f4e5cb28af59c3" exitCode=0
May 28 17:17:47.685629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.685559    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal" event={"ID":"6dfd6a66e353b5aa06eb4975d60d7cf4","Type":"ContainerDied","Data":"7a7791c18fe66c7b6f9584b7d41444619f9b573e7e745fa299f4e5cb28af59c3"}
May 28 17:17:47.686890 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.686825    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhqfw" event={"ID":"82d34df2-3f34-44a8-8384-8de3380ff168","Type":"ContainerStarted","Data":"71b9e65cbf953fd4d085677ed27e62df084ed38fdaf0d4dd8c048a4be33cd532"}
May 28 17:17:47.688100 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.688080    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp" event={"ID":"e497098e-39a8-405d-bfda-3e7209e2ba1d","Type":"ContainerStarted","Data":"91f44a297c020261db8eccb86a6930a534a8ef7e36ddb564e8b34fdbe1d5d4a4"}
May 28 17:17:47.689303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.689279    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fb46x" event={"ID":"e8753a0f-344d-4ff4-a7be-41985cef29aa","Type":"ContainerStarted","Data":"b4c020be7f46ca5d53c27dda73c55c2ac2f851c3ead636feb73fd1e671d0fa14"}
May 28 17:17:47.691945 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.691926    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:17:47.692262 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692238    2566 generic.go:358] "Generic (PLEG): container finished" podID="6133c0a4-4772-45fb-b258-54d47720a54c" containerID="1eb8f94c4c39796b598c535625bc7e5c5333809eb6829ff604a8cf3f7ad7cc36" exitCode=1
May 28 17:17:47.692372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692302    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"5cffa2d1625d9274f9ea6d06c03b77567eaefef741fe516b72f5f1c9c429a5da"}
May 28 17:17:47.692372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692323    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"5b5a82f397ec7647bc5a60d6549c48da4ffdfc9b94e202c2d89ef2da05e8b4ea"}
May 28 17:17:47.692372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692355    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"53ebd92a4b54aa9ca84f7c518e2225a1ff121ba632c8a9f021db48ac9f5eeab7"}
May 28 17:17:47.692372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692370    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"3dda311f76dae6679c8b428bdd84a1620a3f20fd689de230677320c790e8d9c5"}
May 28 17:17:47.692537 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692381    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerDied","Data":"1eb8f94c4c39796b598c535625bc7e5c5333809eb6829ff604a8cf3f7ad7cc36"}
May 28 17:17:47.692537 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.692391    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"62df41a131210d81d03952df85b358362112dcb49f715abeee69f894cf0759c5"}
May 28 17:17:47.693678 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.693656    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="934c255dccd60d2df0714c1152de1cfd268dd0fd2a63dc1d71a20d2403bb4698" exitCode=0
May 28 17:17:47.693786 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.693774    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"934c255dccd60d2df0714c1152de1cfd268dd0fd2a63dc1d71a20d2403bb4698"}
May 28 17:17:47.695356 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.695276    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r8rtm" podStartSLOduration=3.81003949 podStartE2EDuration="22.695263013s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.741423672 +0000 UTC m=+1.815517031" lastFinishedPulling="2026-05-28 17:17:45.626647191 +0000 UTC m=+20.700740554" observedRunningTime="2026-05-28 17:17:47.694863869 +0000 UTC m=+22.768957247" watchObservedRunningTime="2026-05-28 17:17:47.695263013 +0000 UTC m=+22.769356391"
May 28 17:17:47.718012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.717959    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fb46x" podStartSLOduration=3.850070595 podStartE2EDuration="22.717939919s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.788698602 +0000 UTC m=+1.862791960" lastFinishedPulling="2026-05-28 17:17:45.656567913 +0000 UTC m=+20.730661284" observedRunningTime="2026-05-28 17:17:47.717741685 +0000 UTC m=+22.791835056" watchObservedRunningTime="2026-05-28 17:17:47.717939919 +0000 UTC m=+22.792033298"
May 28 17:17:47.718627 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:47.718587    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jwcgx" podStartSLOduration=3.774977859 podStartE2EDuration="22.718579995s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.720365087 +0000 UTC m=+1.794458443" lastFinishedPulling="2026-05-28 17:17:45.663967218 +0000 UTC m=+20.738060579" observedRunningTime="2026-05-28 17:17:47.706058952 +0000 UTC m=+22.780152329" watchObservedRunningTime="2026-05-28 17:17:47.718579995 +0000 UTC m=+22.792673377"
May 28 17:17:48.405084 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.404937    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 17:17:48.469318 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.469209    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:17:48.405078985Z","UUID":"02c2668c-f1ce-4167-8c1b-c87e3afefdc8","Handler":null,"Name":"","Endpoint":""}
May 28 17:17:48.471003 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.470982    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 17:17:48.471003 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.471007    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 17:17:48.531001 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.530923    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:48.531170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.530929    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:48.531170 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:48.531041    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:48.531170 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:48.531120    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:48.697240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.697202    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp" event={"ID":"e497098e-39a8-405d-bfda-3e7209e2ba1d","Type":"ContainerStarted","Data":"c9cf3428aa2a567a16d19a454d06d762fc7fb9528a537384d31e55fca94f90b1"}
May 28 17:17:48.709486 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:48.709441    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dhqfw" podStartSLOduration=4.941303219 podStartE2EDuration="23.709424784s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.858310321 +0000 UTC m=+1.932403679" lastFinishedPulling="2026-05-28 17:17:45.626431884 +0000 UTC m=+20.700525244" observedRunningTime="2026-05-28 17:17:47.748700309 +0000 UTC m=+22.822793691" watchObservedRunningTime="2026-05-28 17:17:48.709424784 +0000 UTC m=+23.783518218"
May 28 17:17:49.462433 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.462400    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bw65t"]
May 28 17:17:49.467311 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.467243    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.467439 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:49.467329    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:49.570646 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.570607    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-dbus\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.570799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.570749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-kubelet-config\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.570799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.570779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.671643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.671557    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-dbus\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.671643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.671618    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-kubelet-config\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.671643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.671637    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.671887 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:49.671740    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:49.671887 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.671755    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-kubelet-config\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.671887 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:49.671863    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret podName:984c363b-2852-4e12-b879-c18aa50487d6 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:50.171843546 +0000 UTC m=+25.245936928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret") pod "global-pull-secret-syncer-bw65t" (UID: "984c363b-2852-4e12-b879-c18aa50487d6") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:49.671887 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.671880    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/984c363b-2852-4e12-b879-c18aa50487d6-dbus\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:49.702505 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.702477    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:17:49.703319 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.702878    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"3bc10a35ba0dc3d3162038fdd26da924edbff9e7a8ea7224ce0c5f2e357e1b3f"}
May 28 17:17:49.704540 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.704510    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal" event={"ID":"6dfd6a66e353b5aa06eb4975d60d7cf4","Type":"ContainerStarted","Data":"47d48e8bf7aed1570190ba46198038e40a3374415b1b5870d6bc643588c3497c"}
May 28 17:17:49.706572 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.706547    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp" event={"ID":"e497098e-39a8-405d-bfda-3e7209e2ba1d","Type":"ContainerStarted","Data":"951793b43a59e878d86caed3c52c2bcfad2c6c13580c939497b7072387e0e421"}
May 28 17:17:49.718994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.718948    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-128.ec2.internal" podStartSLOduration=24.71893266 podStartE2EDuration="24.71893266s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:49.718540199 +0000 UTC m=+24.792633586" watchObservedRunningTime="2026-05-28 17:17:49.71893266 +0000 UTC m=+24.793026039"
May 28 17:17:49.732741 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:49.732698    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82hzp" podStartSLOduration=2.213976914 podStartE2EDuration="24.732685617s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.857683232 +0000 UTC m=+1.931776588" lastFinishedPulling="2026-05-28 17:17:49.376391936 +0000 UTC m=+24.450485291" observedRunningTime="2026-05-28 17:17:49.73222788 +0000 UTC m=+24.806321258" watchObservedRunningTime="2026-05-28 17:17:49.732685617 +0000 UTC m=+24.806778995"
May 28 17:17:50.176791 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:50.176752    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:50.176954 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:50.176887    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:50.177014 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:50.176969    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret podName:984c363b-2852-4e12-b879-c18aa50487d6 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:51.17694876 +0000 UTC m=+26.251042129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret") pod "global-pull-secret-syncer-bw65t" (UID: "984c363b-2852-4e12-b879-c18aa50487d6") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:50.530666 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:50.530630    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:50.530841 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:50.530635    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:50.530841 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:50.530771    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:50.530931 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:50.530859    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:50.961190 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:50.961100    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:50.962047 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:50.962027    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:51.183481 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:51.183230    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:51.183652 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:51.183391    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:51.183652 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:51.183564    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret podName:984c363b-2852-4e12-b879-c18aa50487d6 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:53.183546377 +0000 UTC m=+28.257639733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret") pod "global-pull-secret-syncer-bw65t" (UID: "984c363b-2852-4e12-b879-c18aa50487d6") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:51.530918 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:51.530881    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:51.531088 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:51.531022    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:51.624187 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:51.624158    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:51.624861 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:51.624839    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r8rtm"
May 28 17:17:52.530760 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.530724    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:52.531087 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.530724    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:52.531087 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:52.530835    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:52.531087 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:52.530906    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:52.715178 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.715150    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:17:52.715500 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.715468    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"a238dbc6649b21b881f554e4b26a03e4356ccfcdaf8ee218032aea713722d5ce"}
May 28 17:17:52.715805 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.715783    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:52.715874 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.715812    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:52.715972 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.715958    2566 scope.go:117] "RemoveContainer" containerID="1eb8f94c4c39796b598c535625bc7e5c5333809eb6829ff604a8cf3f7ad7cc36"
May 28 17:17:52.717225 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.717199    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="91e717eda0ba3427325e8881517bcdac2af02b405a71622215cad1420a44c981" exitCode=0
May 28 17:17:52.717305 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.717283    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"91e717eda0ba3427325e8881517bcdac2af02b405a71622215cad1420a44c981"}
May 28 17:17:52.732494 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:52.732471    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:53.200623 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.200387    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:53.200780 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:53.200568    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:53.200855 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:53.200791    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret podName:984c363b-2852-4e12-b879-c18aa50487d6 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:57.200765582 +0000 UTC m=+32.274858952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret") pod "global-pull-secret-syncer-bw65t" (UID: "984c363b-2852-4e12-b879-c18aa50487d6") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:53.530284 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.530256    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:53.530423 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:53.530395    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:53.722948 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.722923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:17:53.723429 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.723259    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" event={"ID":"6133c0a4-4772-45fb-b258-54d47720a54c","Type":"ContainerStarted","Data":"661f8c89914246738ae87b5b19898da833a4c496d3636ae1f87a549dd4476b9d"}
May 28 17:17:53.723643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.723589    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:53.725150 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.725123    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="d8b2122045536c4e63039883ba084db05ed379fdf9b5e531acab122eb6234774" exitCode=0
May 28 17:17:53.725250 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.725179    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"d8b2122045536c4e63039883ba084db05ed379fdf9b5e531acab122eb6234774"}
May 28 17:17:53.738963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.738939    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:17:53.748408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:53.748369    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g" podStartSLOduration=9.069456325 podStartE2EDuration="28.748338494s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.739669682 +0000 UTC m=+1.813763039" lastFinishedPulling="2026-05-28 17:17:46.418551836 +0000 UTC m=+21.492645208" observedRunningTime="2026-05-28 17:17:53.747868602 +0000 UTC m=+28.821962002" watchObservedRunningTime="2026-05-28 17:17:53.748338494 +0000 UTC m=+28.822431868"
May 28 17:17:54.248295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.248253    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gw7ps"]
May 28 17:17:54.248519 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.248419    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:54.248593 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:54.248539    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:54.251188 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.250936    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bw65t"]
May 28 17:17:54.251188 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.251052    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:54.251188 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:54.251140    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:54.251692 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.251672    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t79nx"]
May 28 17:17:54.251803 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.251781    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:54.251905 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:54.251883    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:54.728894 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.728811    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="d41d18b443fc24e6a9510ece7c635d829a3b08bebc104107d2c7751eed1a2691" exitCode=0
May 28 17:17:54.729566 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:54.728900    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"d41d18b443fc24e6a9510ece7c635d829a3b08bebc104107d2c7751eed1a2691"}
May 28 17:17:55.532246 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:55.532207    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:55.532431 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:55.532322    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:56.530509 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:56.530299    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:56.530900 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:56.530301    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:56.530900 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:56.530604    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:56.530900 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:56.530672    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:57.233799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:57.233760    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:57.233999 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:57.233936    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:57.234060 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:57.234018    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret podName:984c363b-2852-4e12-b879-c18aa50487d6 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:05.233996151 +0000 UTC m=+40.308089510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret") pod "global-pull-secret-syncer-bw65t" (UID: "984c363b-2852-4e12-b879-c18aa50487d6") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:57.531010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:57.530973    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:57.531447 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:57.531095    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:58.141184 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:58.141140    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:58.141360 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.141300    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:58.141408 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.141400    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs podName:75c6beb6-f10a-4b8d-9928-c0ea7ee8a523 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:30.141380458 +0000 UTC m=+65.215473814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs") pod "network-metrics-daemon-t79nx" (UID: "75c6beb6-f10a-4b8d-9928-c0ea7ee8a523") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:58.241700 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:58.241653    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:58.241879 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.241805    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:58.241879 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.241823    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:58.241879 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.241837    2566 projected.go:194] Error preparing data for projected volume kube-api-access-4965t for pod openshift-network-diagnostics/network-check-target-gw7ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:58.242012 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.241891    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t podName:51433d92-c37d-4282-985c-1543b2c88987 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:30.241876308 +0000 UTC m=+65.315969668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4965t" (UniqueName: "kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t") pod "network-check-target-gw7ps" (UID: "51433d92-c37d-4282-985c-1543b2c88987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:58.530253 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:58.530218    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:17:58.530435 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:58.530219    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:17:58.530435 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.530361    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw7ps" podUID="51433d92-c37d-4282-985c-1543b2c88987"
May 28 17:17:58.530556 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:58.530458    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t79nx" podUID="75c6beb6-f10a-4b8d-9928-c0ea7ee8a523"
May 28 17:17:59.530451 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.530412    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:17:59.530945 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:17:59.530532    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bw65t" podUID="984c363b-2852-4e12-b879-c18aa50487d6"
May 28 17:17:59.779613 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.779581    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-128.ec2.internal" event="NodeReady"
May 28 17:17:59.779827 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.779726    2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 17:17:59.808756 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.808672    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:17:59.832080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.832026    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmfbw"]
May 28 17:17:59.845829 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.845800    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bqmtt"]
May 28 17:17:59.846008 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.845936    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.846074 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.846017    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:17:59.847740 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.847717    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 17:17:59.847892 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.847869    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kckzw\""
May 28 17:17:59.847988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.847876    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 17:17:59.847988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.847876    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 17:17:59.848111 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.848090    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 17:17:59.848245 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.848188    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 17:17:59.848594 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.848576    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4rht\""
May 28 17:17:59.848687 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.848674    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 17:17:59.853154 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.853134    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 17:17:59.861970 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.861945    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:17:59.861970 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.861971    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmfbw"]
May 28 17:17:59.862114 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.861982    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqmtt"]
May 28 17:17:59.862114 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.862101    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqmtt"
May 28 17:17:59.863688 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.863664    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 17:17:59.863799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.863779    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs9nj\""
May 28 17:17:59.864058 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.863933    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 17:17:59.953095 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bstf\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953095 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953102    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d6291-e90a-49c3-bb5f-cfa1212b70b5-tmp-dir\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:17:59.953381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953230    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:17:59.953381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953367    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953564 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953564 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953499    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:17:59.953564 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/792d6291-e90a-49c3-bb5f-cfa1212b70b5-config-volume\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:17:59.953564 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953559    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vcg\" (UniqueName: \"kubernetes.io/projected/792d6291-e90a-49c3-bb5f-cfa1212b70b5-kube-api-access-m4vcg\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:17:59.953697 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:17:59.953697 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkr7\" (UniqueName: \"kubernetes.io/projected/8761fc9d-66e1-404c-b253-bb77be4d93fa-kube-api-access-vzkr7\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:17:59.953697 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:17:59.953666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055041 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055000    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055073    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055103    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055127    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055149    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055191    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055245    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/792d6291-e90a-49c3-bb5f-cfa1212b70b5-config-volume\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055266    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055276    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vcg\" (UniqueName: \"kubernetes.io/projected/792d6291-e90a-49c3-bb5f-cfa1212b70b5-kube-api-access-m4vcg\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.055303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055302    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055360    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls podName:792d6291-e90a-49c3-bb5f-cfa1212b70b5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.555318671 +0000 UTC m=+35.629412051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls") pod "dns-default-bqmtt" (UID: "792d6291-e90a-49c3-bb5f-cfa1212b70b5") : secret "dns-default-metrics-tls" not found
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055382    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkr7\" (UniqueName: \"kubernetes.io/projected/8761fc9d-66e1-404c-b253-bb77be4d93fa-kube-api-access-vzkr7\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055412    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055419    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055447    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bstf\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055479    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.555463032 +0000 UTC m=+35.629556407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055500    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.055849 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055532    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d6291-e90a-49c3-bb5f-cfa1212b70b5-tmp-dir\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055873    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.055923    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d6291-e90a-49c3-bb5f-cfa1212b70b5-tmp-dir\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055961    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.055982    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769c56569-kk4s8: secret "image-registry-tls" not found
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.056042    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls podName:82d375e5-133e-4469-9d81-8d1125898357 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.556024259 +0000 UTC m=+35.630117623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls") pod "image-registry-769c56569-kk4s8" (UID: "82d375e5-133e-4469-9d81-8d1125898357") : secret "image-registry-tls" not found
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.056156    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.056251 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.056203    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.056605 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.056512    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/792d6291-e90a-49c3-bb5f-cfa1212b70b5-config-volume\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.060985 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.060928    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.060985 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.060934    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.063810 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.063785    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vcg\" (UniqueName: \"kubernetes.io/projected/792d6291-e90a-49c3-bb5f-cfa1212b70b5-kube-api-access-m4vcg\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.063931 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.063852    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkr7\" (UniqueName: \"kubernetes.io/projected/8761fc9d-66e1-404c-b253-bb77be4d93fa-kube-api-access-vzkr7\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:00.064142 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.064122    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bstf\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.064523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.064494    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.531018 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.530985    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:18:00.531616 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.530987    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:18:00.532841 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.532815    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:18:00.533311 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.533293    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:18:00.533414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.533296    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5snq\""
May 28 17:18:00.533475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.533295    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:18:00.533475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.533300    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9td\""
May 28 17:18:00.560987 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.560964    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:00.561090 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.560998    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:00.561090 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:00.561063    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:00.561161 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561109    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:00.561161 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561155    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.561141637 +0000 UTC m=+36.635235001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:00.561241 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561166    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:00.561241 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561183    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769c56569-kk4s8: secret "image-registry-tls" not found
May 28 17:18:00.561241 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561213    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:00.561241 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561237    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls podName:82d375e5-133e-4469-9d81-8d1125898357 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.561224569 +0000 UTC m=+36.635317925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls") pod "image-registry-769c56569-kk4s8" (UID: "82d375e5-133e-4469-9d81-8d1125898357") : secret "image-registry-tls" not found
May 28 17:18:00.561392 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:00.561261    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls podName:792d6291-e90a-49c3-bb5f-cfa1212b70b5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.561249032 +0000 UTC m=+36.635342387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls") pod "dns-default-bqmtt" (UID: "792d6291-e90a-49c3-bb5f-cfa1212b70b5") : secret "dns-default-metrics-tls" not found
May 28 17:18:01.531186 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.531151    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:18:01.533055 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.533034    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 17:18:01.569002 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.568982    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:01.569122 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.569030    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:01.569122 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.569049    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:01.569191 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569141    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:01.569228 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569200    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:03.56918664 +0000 UTC m=+38.643279999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:01.569269 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569141    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:01.569298 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569272    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls podName:792d6291-e90a-49c3-bb5f-cfa1212b70b5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:03.569259044 +0000 UTC m=+38.643352420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls") pod "dns-default-bqmtt" (UID: "792d6291-e90a-49c3-bb5f-cfa1212b70b5") : secret "dns-default-metrics-tls" not found
May 28 17:18:01.569298 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569143    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:01.569381 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569298    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769c56569-kk4s8: secret "image-registry-tls" not found
May 28 17:18:01.569381 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:01.569373    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls podName:82d375e5-133e-4469-9d81-8d1125898357 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:03.569357505 +0000 UTC m=+38.643450874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls") pod "image-registry-769c56569-kk4s8" (UID: "82d375e5-133e-4469-9d81-8d1125898357") : secret "image-registry-tls" not found
May 28 17:18:01.744228 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.744193    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="1d62260049c772e02115dcc70900eaaa0d46783b69ee2e8eebe0581a3eabfd3e" exitCode=0
May 28 17:18:01.744414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:01.744247    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"1d62260049c772e02115dcc70900eaaa0d46783b69ee2e8eebe0581a3eabfd3e"}
May 28 17:18:02.748457 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:02.748237    2566 generic.go:358] "Generic (PLEG): container finished" podID="37f40b18-1e03-49b9-be25-0bbea41ded20" containerID="a6d48fb8b9cc3e18f82e7767558027afc2e68614c5f303fcedd7effc3b3c9fb2" exitCode=0
May 28 17:18:02.748813 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:02.748322    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerDied","Data":"a6d48fb8b9cc3e18f82e7767558027afc2e68614c5f303fcedd7effc3b3c9fb2"}
May 28 17:18:03.480120 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.480091    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"]
May 28 17:18:03.499299 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.499263    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"]
May 28 17:18:03.499490 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.499322    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"
May 28 17:18:03.501263 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.501244    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-twxgk\""
May 28 17:18:03.501385 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.501251    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 17:18:03.501575 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.501561    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 17:18:03.583306 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.583269    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.583326    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583429    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583440    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.583462    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583485    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:07.583472223 +0000 UTC m=+42.657565582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:03.583519 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583517    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls podName:792d6291-e90a-49c3-bb5f-cfa1212b70b5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:07.583500416 +0000 UTC m=+42.657593784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls") pod "dns-default-bqmtt" (UID: "792d6291-e90a-49c3-bb5f-cfa1212b70b5") : secret "dns-default-metrics-tls" not found
May 28 17:18:03.583755 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583527    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:03.583755 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583538    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769c56569-kk4s8: secret "image-registry-tls" not found
May 28 17:18:03.583755 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.583541    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6d9\" (UniqueName: \"kubernetes.io/projected/ef6ed60d-d4d9-4bad-ab97-8a20a10751f1-kube-api-access-cl6d9\") pod \"migrator-b985f5d89-2cwpz\" (UID: \"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"
May 28 17:18:03.583755 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:03.583579    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls podName:82d375e5-133e-4469-9d81-8d1125898357 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:07.583569274 +0000 UTC m=+42.657662663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls") pod "image-registry-769c56569-kk4s8" (UID: "82d375e5-133e-4469-9d81-8d1125898357") : secret "image-registry-tls" not found
May 28 17:18:03.684601 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.684562    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6d9\" (UniqueName: \"kubernetes.io/projected/ef6ed60d-d4d9-4bad-ab97-8a20a10751f1-kube-api-access-cl6d9\") pod \"migrator-b985f5d89-2cwpz\" (UID: \"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"
May 28 17:18:03.693512 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.693482    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6d9\" (UniqueName: \"kubernetes.io/projected/ef6ed60d-d4d9-4bad-ab97-8a20a10751f1-kube-api-access-cl6d9\") pod \"migrator-b985f5d89-2cwpz\" (UID: \"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"
May 28 17:18:03.754182 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.754135    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56974" event={"ID":"37f40b18-1e03-49b9-be25-0bbea41ded20","Type":"ContainerStarted","Data":"541eec37f5b173dc9b49e5f82aad8bca8a57408c8b293b16c8814898b4348f89"}
May 28 17:18:03.777098 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.777026    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-56974" podStartSLOduration=4.947110751 podStartE2EDuration="38.777010401s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:17:26.803098417 +0000 UTC m=+1.877191771" lastFinishedPulling="2026-05-28 17:18:00.632998062 +0000 UTC m=+35.707091421" observedRunningTime="2026-05-28 17:18:03.775703141 +0000 UTC m=+38.849796520" watchObservedRunningTime="2026-05-28 17:18:03.777010401 +0000 UTC m=+38.851103779"
May 28 17:18:03.807784 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.807762    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"
May 28 17:18:03.985938 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:03.985898    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz"]
May 28 17:18:03.990196 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:03.990162    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6ed60d_d4d9_4bad_ab97_8a20a10751f1.slice/crio-f8d7668daee5f7932784b91275a475cfbbc7b32055279818ca56a55fa84beaff WatchSource:0}: Error finding container f8d7668daee5f7932784b91275a475cfbbc7b32055279818ca56a55fa84beaff: Status 404 returned error can't find the container with id f8d7668daee5f7932784b91275a475cfbbc7b32055279818ca56a55fa84beaff
May 28 17:18:04.756516 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:04.756481    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz" event={"ID":"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1","Type":"ContainerStarted","Data":"f8d7668daee5f7932784b91275a475cfbbc7b32055279818ca56a55fa84beaff"}
May 28 17:18:05.299178 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.299137    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:18:05.301752 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.301728    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/984c363b-2852-4e12-b879-c18aa50487d6-original-pull-secret\") pod \"global-pull-secret-syncer-bw65t\" (UID: \"984c363b-2852-4e12-b879-c18aa50487d6\") " pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:18:05.440024 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.439986    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw65t"
May 28 17:18:05.747780 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.747751    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bw65t"]
May 28 17:18:05.750539 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:05.750513    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984c363b_2852_4e12_b879_c18aa50487d6.slice/crio-4938ed161c9f5123f984b4f37d3dc3fe21d08a78bb9b35d2944506a68894f964 WatchSource:0}: Error finding container 4938ed161c9f5123f984b4f37d3dc3fe21d08a78bb9b35d2944506a68894f964: Status 404 returned error can't find the container with id 4938ed161c9f5123f984b4f37d3dc3fe21d08a78bb9b35d2944506a68894f964
May 28 17:18:05.759037 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.759013    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bw65t" event={"ID":"984c363b-2852-4e12-b879-c18aa50487d6","Type":"ContainerStarted","Data":"4938ed161c9f5123f984b4f37d3dc3fe21d08a78bb9b35d2944506a68894f964"}
May 28 17:18:05.986112 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:05.986085    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fb46x_e8753a0f-344d-4ff4-a7be-41985cef29aa/dns-node-resolver/0.log"
May 28 17:18:06.192183 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.192104    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-djvfp"]
May 28 17:18:06.215332 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.215304    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-djvfp"]
May 28 17:18:06.215481 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.215434    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.217313 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.217287    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 17:18:06.217446 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.217319    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 17:18:06.217662 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.217456    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jkfvw\""
May 28 17:18:06.217740 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.217663    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 17:18:06.217795 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.217760    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 17:18:06.308973 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.308936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnjz8\" (UniqueName: \"kubernetes.io/projected/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-kube-api-access-lnjz8\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.309142 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.309101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-cabundle\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.309206 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.309179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-key\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.410575 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.410536    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-cabundle\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.410772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.410631    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-key\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.410772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.410663    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnjz8\" (UniqueName: \"kubernetes.io/projected/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-kube-api-access-lnjz8\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.411378 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.411330    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-cabundle\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.413246 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.413222    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-signing-key\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.419050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.419023    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnjz8\" (UniqueName: \"kubernetes.io/projected/42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5-kube-api-access-lnjz8\") pod \"service-ca-67d667c7d-djvfp\" (UID: \"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5\") " pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.524117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.524063    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-djvfp"
May 28 17:18:06.660638 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.660521    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-djvfp"]
May 28 17:18:06.663456 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:06.663424    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aab1f2_9ab2_45ed_9c45_5ce07d73c3a5.slice/crio-a192c925bd411cb97076ffad030e1d5f4d1fb20e832911518bdb1ca39f0c5fe7 WatchSource:0}: Error finding container a192c925bd411cb97076ffad030e1d5f4d1fb20e832911518bdb1ca39f0c5fe7: Status 404 returned error can't find the container with id a192c925bd411cb97076ffad030e1d5f4d1fb20e832911518bdb1ca39f0c5fe7
May 28 17:18:06.763370 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.763319    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz" event={"ID":"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1","Type":"ContainerStarted","Data":"feb5a9dc11bf30ecf6077ff39b9f4c68db5a5633e35f54bdefd48529dcc41e45"}
May 28 17:18:06.763833 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.763378    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz" event={"ID":"ef6ed60d-d4d9-4bad-ab97-8a20a10751f1","Type":"ContainerStarted","Data":"78905a1396a96f7c84fd0353249cdf31ab7b5d8df56d41b8ee80dae73aa18ea6"}
May 28 17:18:06.764565 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.764530    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-djvfp" event={"ID":"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5","Type":"ContainerStarted","Data":"a192c925bd411cb97076ffad030e1d5f4d1fb20e832911518bdb1ca39f0c5fe7"}
May 28 17:18:06.779730 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:06.779542    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-2cwpz" podStartSLOduration=2.1363910170000002 podStartE2EDuration="3.779525839s" podCreationTimestamp="2026-05-28 17:18:03 +0000 UTC" firstStartedPulling="2026-05-28 17:18:03.991843565 +0000 UTC m=+39.065936919" lastFinishedPulling="2026-05-28 17:18:05.634978385 +0000 UTC m=+40.709071741" observedRunningTime="2026-05-28 17:18:06.778974954 +0000 UTC m=+41.853068331" watchObservedRunningTime="2026-05-28 17:18:06.779525839 +0000 UTC m=+41.853619215"
May 28 17:18:07.187404 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:07.187302    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhqfw_82d34df2-3f34-44a8-8384-8de3380ff168/node-ca/0.log"
May 28 17:18:07.620433 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:07.620390    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:07.620638 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:07.620451    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:07.620638 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:07.620541    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:07.620638 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620587    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:07.620638 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620598    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:07.620638 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620623    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769c56569-kk4s8: secret "image-registry-tls" not found
May 28 17:18:07.620903 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620654    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:15.620634255 +0000 UTC m=+50.694727630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:07.620903 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620671    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:07.620903 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620680    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls podName:82d375e5-133e-4469-9d81-8d1125898357 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:15.62066144 +0000 UTC m=+50.694754812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls") pod "image-registry-769c56569-kk4s8" (UID: "82d375e5-133e-4469-9d81-8d1125898357") : secret "image-registry-tls" not found
May 28 17:18:07.620903 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:07.620704    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls podName:792d6291-e90a-49c3-bb5f-cfa1212b70b5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:15.620693694 +0000 UTC m=+50.694787063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls") pod "dns-default-bqmtt" (UID: "792d6291-e90a-49c3-bb5f-cfa1212b70b5") : secret "dns-default-metrics-tls" not found
May 28 17:18:08.187239 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:08.187203    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-2cwpz_ef6ed60d-d4d9-4bad-ab97-8a20a10751f1/migrator/0.log"
May 28 17:18:08.386772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:08.386739    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-2cwpz_ef6ed60d-d4d9-4bad-ab97-8a20a10751f1/graceful-termination/0.log"
May 28 17:18:10.774629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:10.774592    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bw65t" event={"ID":"984c363b-2852-4e12-b879-c18aa50487d6","Type":"ContainerStarted","Data":"cc0b1f56a75412574d9729e4b6512668d7170511bb89328a326755e2f40eb720"}
May 28 17:18:10.775811 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:10.775791    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-djvfp" event={"ID":"42aab1f2-9ab2-45ed-9c45-5ce07d73c3a5","Type":"ContainerStarted","Data":"5b3a7653320bda2ca4cca535806b0bc2b8df5a54fb914e47b9c344e882d1b6cc"}
May 28 17:18:10.787573 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:10.787501    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bw65t" podStartSLOduration=17.253894418 podStartE2EDuration="21.787485783s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:05.752251963 +0000 UTC m=+40.826345319" lastFinishedPulling="2026-05-28 17:18:10.285843329 +0000 UTC m=+45.359936684" observedRunningTime="2026-05-28 17:18:10.786319102 +0000 UTC m=+45.860412483" watchObservedRunningTime="2026-05-28 17:18:10.787485783 +0000 UTC m=+45.861579163"
May 28 17:18:10.799241 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:10.799196    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-djvfp" podStartSLOduration=1.189743595 podStartE2EDuration="4.79918481s" podCreationTimestamp="2026-05-28 17:18:06 +0000 UTC" firstStartedPulling="2026-05-28 17:18:06.665613049 +0000 UTC m=+41.739706408" lastFinishedPulling="2026-05-28 17:18:10.275054258 +0000 UTC m=+45.349147623" observedRunningTime="2026-05-28 17:18:10.798124315 +0000 UTC m=+45.872217690" watchObservedRunningTime="2026-05-28 17:18:10.79918481 +0000 UTC m=+45.873278192"
May 28 17:18:15.685064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.685026    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:15.685662 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.685091    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:15.685662 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:15.685203    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:15.685662 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.685217    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:15.685662 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:15.685285    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert podName:8761fc9d-66e1-404c-b253-bb77be4d93fa nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.685264956 +0000 UTC m=+66.759358318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert") pod "ingress-canary-pmfbw" (UID: "8761fc9d-66e1-404c-b253-bb77be4d93fa") : secret "canary-serving-cert" not found
May 28 17:18:15.687508 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.687476    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/792d6291-e90a-49c3-bb5f-cfa1212b70b5-metrics-tls\") pod \"dns-default-bqmtt\" (UID: \"792d6291-e90a-49c3-bb5f-cfa1212b70b5\") " pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:15.687828 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.687813    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"image-registry-769c56569-kk4s8\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") " pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:15.760994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.760953    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:15.773979 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.773937    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:15.905670 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.905638    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:18:15.909257 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:15.909230    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d375e5_133e_4469_9d81_8d1125898357.slice/crio-b0b371055200762f6b3ffbe759552030e8e320c2f998b9aa51222b3af4c3da3e WatchSource:0}: Error finding container b0b371055200762f6b3ffbe759552030e8e320c2f998b9aa51222b3af4c3da3e: Status 404 returned error can't find the container with id b0b371055200762f6b3ffbe759552030e8e320c2f998b9aa51222b3af4c3da3e
May 28 17:18:15.917618 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:15.917592    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqmtt"]
May 28 17:18:15.922001 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:15.921972    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792d6291_e90a_49c3_bb5f_cfa1212b70b5.slice/crio-a56d70b937844fe893156d3b18c9ae4f3771ef4171078255b2182d37108d2200 WatchSource:0}: Error finding container a56d70b937844fe893156d3b18c9ae4f3771ef4171078255b2182d37108d2200: Status 404 returned error can't find the container with id a56d70b937844fe893156d3b18c9ae4f3771ef4171078255b2182d37108d2200
May 28 17:18:16.789472 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:16.789436    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769c56569-kk4s8" event={"ID":"82d375e5-133e-4469-9d81-8d1125898357","Type":"ContainerStarted","Data":"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"}
May 28 17:18:16.789472 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:16.789477    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769c56569-kk4s8" event={"ID":"82d375e5-133e-4469-9d81-8d1125898357","Type":"ContainerStarted","Data":"b0b371055200762f6b3ffbe759552030e8e320c2f998b9aa51222b3af4c3da3e"}
May 28 17:18:16.790075 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:16.789565    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:16.790580 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:16.790558    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqmtt" event={"ID":"792d6291-e90a-49c3-bb5f-cfa1212b70b5","Type":"ContainerStarted","Data":"a56d70b937844fe893156d3b18c9ae4f3771ef4171078255b2182d37108d2200"}
May 28 17:18:16.806925 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:16.806705    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-769c56569-kk4s8" podStartSLOduration=45.806689385 podStartE2EDuration="45.806689385s" podCreationTimestamp="2026-05-28 17:17:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:16.806232676 +0000 UTC m=+51.880326053" watchObservedRunningTime="2026-05-28 17:18:16.806689385 +0000 UTC m=+51.880782763"
May 28 17:18:18.798764 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:18.798729    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqmtt" event={"ID":"792d6291-e90a-49c3-bb5f-cfa1212b70b5","Type":"ContainerStarted","Data":"46ba5a02a537f13a6acd9ad6b624dbafa90e422e0c001a1c7ca238dbeb927e49"}
May 28 17:18:18.798764 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:18.798768    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqmtt" event={"ID":"792d6291-e90a-49c3-bb5f-cfa1212b70b5","Type":"ContainerStarted","Data":"5f7e9cf8c518e3b923e431b7a5414b3b7e7bc65f379d341e433b8f6c15cee867"}
May 28 17:18:18.799200 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:18.798844    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:18.813838 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:18.813773    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bqmtt" podStartSLOduration=18.005886846 podStartE2EDuration="19.813756648s" podCreationTimestamp="2026-05-28 17:17:59 +0000 UTC" firstStartedPulling="2026-05-28 17:18:15.923703796 +0000 UTC m=+50.997797150" lastFinishedPulling="2026-05-28 17:18:17.731573593 +0000 UTC m=+52.805666952" observedRunningTime="2026-05-28 17:18:18.812970974 +0000 UTC m=+53.887064352" watchObservedRunningTime="2026-05-28 17:18:18.813756648 +0000 UTC m=+53.887850026"
May 28 17:18:25.742057 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:25.742030    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mq42g"
May 28 17:18:28.803462 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:28.803427    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bqmtt"
May 28 17:18:29.563136 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.563102    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"]
May 28 17:18:29.566325 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.566303    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"]
May 28 17:18:29.566470 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.566456    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.568867 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.568840    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bbhbf\""
May 28 17:18:29.569557 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.569538    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 17:18:29.570496 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.570473    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 17:18:29.571270 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.571000    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.571270 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.571011    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 17:18:29.571454 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.571357    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 17:18:29.572889 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.572873    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 17:18:29.584570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.584549    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9573be04-92ec-4298-88a6-654a317b587d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.584570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.584576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f6a74e3-71b6-4a95-8517-580f94cd0336-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.584742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.584596    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9573be04-92ec-4298-88a6-654a317b587d-tmp\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.584742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.584622    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r49k6\" (UniqueName: \"kubernetes.io/projected/9573be04-92ec-4298-88a6-654a317b587d-kube-api-access-r49k6\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.584841 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.584750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djzk\" (UniqueName: \"kubernetes.io/projected/5f6a74e3-71b6-4a95-8517-580f94cd0336-kube-api-access-6djzk\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.585470 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.585439    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"]
May 28 17:18:29.586072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.586052    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"]
May 28 17:18:29.617521 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.617480    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:18:29.685523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685492    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9573be04-92ec-4298-88a6-654a317b587d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.685690 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685526    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f6a74e3-71b6-4a95-8517-580f94cd0336-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.685690 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685558    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9573be04-92ec-4298-88a6-654a317b587d-tmp\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.685690 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685596    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r49k6\" (UniqueName: \"kubernetes.io/projected/9573be04-92ec-4298-88a6-654a317b587d-kube-api-access-r49k6\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.685690 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685650    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6djzk\" (UniqueName: \"kubernetes.io/projected/5f6a74e3-71b6-4a95-8517-580f94cd0336-kube-api-access-6djzk\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.686002 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.685978    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9573be04-92ec-4298-88a6-654a317b587d-tmp\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.688053 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.688030    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f6a74e3-71b6-4a95-8517-580f94cd0336-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.688153 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.688135    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9573be04-92ec-4298-88a6-654a317b587d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.703235 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.703211    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djzk\" (UniqueName: \"kubernetes.io/projected/5f6a74e3-71b6-4a95-8517-580f94cd0336-kube-api-access-6djzk\") pod \"managed-serviceaccount-addon-agent-8447f9cbb-ddckj\" (UID: \"5f6a74e3-71b6-4a95-8517-580f94cd0336\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.705362 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.705328    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r49k6\" (UniqueName: \"kubernetes.io/projected/9573be04-92ec-4298-88a6-654a317b587d-kube-api-access-r49k6\") pod \"klusterlet-addon-workmgr-5799fdff88-px9fz\" (UID: \"9573be04-92ec-4298-88a6-654a317b587d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:29.718772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.718744    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"]
May 28 17:18:29.720820 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.720803    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8tpt5"]
May 28 17:18:29.720968 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.720952    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.722795 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.722783    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.724454 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.724424    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qmhp7\""
May 28 17:18:29.724559 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.724463    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 17:18:29.724559 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.724534    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 17:18:29.724648 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.724537    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 17:18:29.726884 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.726865    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 17:18:29.731377 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.731339    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tpt5"]
May 28 17:18:29.734738 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.734720    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"]
May 28 17:18:29.785935 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.785910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-registry-certificates\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.785941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-bound-sa-token\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.785964    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-image-registry-private-configuration\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dkv\" (UniqueName: \"kubernetes.io/projected/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-api-access-j6dkv\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.786197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xf8g\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-kube-api-access-9xf8g\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-trusted-ca\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786140    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6ea918-d083-4d73-ae44-428bcfcac67e-data-volume\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.786197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6ea918-d083-4d73-ae44-428bcfcac67e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.786197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786184    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6ea918-d083-4d73-ae44-428bcfcac67e-crio-socket\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.786401 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-installation-pull-secrets\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786401 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-registry-tls\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786401 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9223010-421c-4685-92b9-7f6de5318dd8-ca-trust-extracted\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.786401 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.786328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.887030 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.886944    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-registry-certificates\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887030 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.886978    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-bound-sa-token\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887030 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887000    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-image-registry-private-configuration\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887128    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dkv\" (UniqueName: \"kubernetes.io/projected/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-api-access-j6dkv\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887162    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xf8g\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-kube-api-access-9xf8g\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887188    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-trusted-ca\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887211    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6ea918-d083-4d73-ae44-428bcfcac67e-data-volume\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887255    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6ea918-d083-4d73-ae44-428bcfcac67e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887288    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6ea918-d083-4d73-ae44-428bcfcac67e-crio-socket\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887340    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-installation-pull-secrets\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887391    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-registry-tls\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887425    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9223010-421c-4685-92b9-7f6de5318dd8-ca-trust-extracted\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.887595 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887460    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.888084 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887703    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6ea918-d083-4d73-ae44-428bcfcac67e-crio-socket\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.888084 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887704    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6ea918-d083-4d73-ae44-428bcfcac67e-data-volume\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.888084 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.887975    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-registry-certificates\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.888084 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.888038    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9223010-421c-4685-92b9-7f6de5318dd8-ca-trust-extracted\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.888291 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.888254    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.888364 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.888302    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9223010-421c-4685-92b9-7f6de5318dd8-trusted-ca\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.889818 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.889796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6ea918-d083-4d73-ae44-428bcfcac67e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.889924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.889844    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-image-registry-private-configuration\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.890367 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.890327    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-registry-tls\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.890367 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.890362    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9223010-421c-4685-92b9-7f6de5318dd8-installation-pull-secrets\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.893266 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.893248    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"
May 28 17:18:29.895243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.895210    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dkv\" (UniqueName: \"kubernetes.io/projected/fc6ea918-d083-4d73-ae44-428bcfcac67e-kube-api-access-j6dkv\") pod \"insights-runtime-extractor-8tpt5\" (UID: \"fc6ea918-d083-4d73-ae44-428bcfcac67e\") " pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:29.895411 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.895364    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-bound-sa-token\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.895586 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.895569    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xf8g\" (UniqueName: \"kubernetes.io/projected/e9223010-421c-4685-92b9-7f6de5318dd8-kube-api-access-9xf8g\") pod \"image-registry-7f67b9fd9b-pw6cc\" (UID: \"e9223010-421c-4685-92b9-7f6de5318dd8\") " pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:29.899274 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:29.899255    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:30.031485 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.031454    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:30.036483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.036425    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tpt5"
May 28 17:18:30.037660 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.037637    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj"]
May 28 17:18:30.043764 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.043728    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f6a74e3_71b6_4a95_8517_580f94cd0336.slice/crio-45ec4f7f4242bd94dffff2ef25c6b72e652570a370f0aebe45b812614d29bf5f WatchSource:0}: Error finding container 45ec4f7f4242bd94dffff2ef25c6b72e652570a370f0aebe45b812614d29bf5f: Status 404 returned error can't find the container with id 45ec4f7f4242bd94dffff2ef25c6b72e652570a370f0aebe45b812614d29bf5f
May 28 17:18:30.055987 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.055930    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"]
May 28 17:18:30.060084 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.060050    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9573be04_92ec_4298_88a6_654a317b587d.slice/crio-d0b2ea09b1568b62ccac3bed6831a9695fe66fbd534190724f20e3ad6d9d07c0 WatchSource:0}: Error finding container d0b2ea09b1568b62ccac3bed6831a9695fe66fbd534190724f20e3ad6d9d07c0: Status 404 returned error can't find the container with id d0b2ea09b1568b62ccac3bed6831a9695fe66fbd534190724f20e3ad6d9d07c0
May 28 17:18:30.158433 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.158223    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"]
May 28 17:18:30.160747 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.160708    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9223010_421c_4685_92b9_7f6de5318dd8.slice/crio-548547c316807311dc9fe12aea033afb3fe6077aeec6b503e5671627f28bf1f7 WatchSource:0}: Error finding container 548547c316807311dc9fe12aea033afb3fe6077aeec6b503e5671627f28bf1f7: Status 404 returned error can't find the container with id 548547c316807311dc9fe12aea033afb3fe6077aeec6b503e5671627f28bf1f7
May 28 17:18:30.173660 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.173637    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tpt5"]
May 28 17:18:30.176827 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.176800    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6ea918_d083_4d73_ae44_428bcfcac67e.slice/crio-83def6349582fe58592da0e246b69bcefc33a1b85cdcc43dac72c10c18fee671 WatchSource:0}: Error finding container 83def6349582fe58592da0e246b69bcefc33a1b85cdcc43dac72c10c18fee671: Status 404 returned error can't find the container with id 83def6349582fe58592da0e246b69bcefc33a1b85cdcc43dac72c10c18fee671
May 28 17:18:30.190221 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.190182    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:18:30.191771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.191752    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:18:30.202538 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.202518    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c6beb6-f10a-4b8d-9928-c0ea7ee8a523-metrics-certs\") pod \"network-metrics-daemon-t79nx\" (UID: \"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523\") " pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:18:30.247153 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.247118    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5snq\""
May 28 17:18:30.256374 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.256328    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t79nx"
May 28 17:18:30.291249 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.290735    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:18:30.292477 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.292454    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:18:30.303932 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.303647    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:18:30.315665 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.315640    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4965t\" (UniqueName: \"kubernetes.io/projected/51433d92-c37d-4282-985c-1543b2c88987-kube-api-access-4965t\") pod \"network-check-target-gw7ps\" (UID: \"51433d92-c37d-4282-985c-1543b2c88987\") " pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:18:30.376278 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.376247    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t79nx"]
May 28 17:18:30.380081 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.380057    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c6beb6_f10a_4b8d_9928_c0ea7ee8a523.slice/crio-f8aede4e100c54415c51bbabdf7fc7ec54f2ff4d515b4c68dde3035859fc2e03 WatchSource:0}: Error finding container f8aede4e100c54415c51bbabdf7fc7ec54f2ff4d515b4c68dde3035859fc2e03: Status 404 returned error can't find the container with id f8aede4e100c54415c51bbabdf7fc7ec54f2ff4d515b4c68dde3035859fc2e03
May 28 17:18:30.543089 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.543054    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9td\""
May 28 17:18:30.552277 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.552247    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:18:30.708597 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.708510    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gw7ps"]
May 28 17:18:30.834624 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.834521    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz" event={"ID":"9573be04-92ec-4298-88a6-654a317b587d","Type":"ContainerStarted","Data":"d0b2ea09b1568b62ccac3bed6831a9695fe66fbd534190724f20e3ad6d9d07c0"}
May 28 17:18:30.835788 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.835730    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t79nx" event={"ID":"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523","Type":"ContainerStarted","Data":"f8aede4e100c54415c51bbabdf7fc7ec54f2ff4d515b4c68dde3035859fc2e03"}
May 28 17:18:30.837501 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.837471    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tpt5" event={"ID":"fc6ea918-d083-4d73-ae44-428bcfcac67e","Type":"ContainerStarted","Data":"6843dbbf34785e62dd93645d7ceecf0fccce6a7a2d5948944bf5bca66e1aefe7"}
May 28 17:18:30.837613 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.837502    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tpt5" event={"ID":"fc6ea918-d083-4d73-ae44-428bcfcac67e","Type":"ContainerStarted","Data":"83def6349582fe58592da0e246b69bcefc33a1b85cdcc43dac72c10c18fee671"}
May 28 17:18:30.838768 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.838745    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj" event={"ID":"5f6a74e3-71b6-4a95-8517-580f94cd0336","Type":"ContainerStarted","Data":"45ec4f7f4242bd94dffff2ef25c6b72e652570a370f0aebe45b812614d29bf5f"}
May 28 17:18:30.846143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.840299    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc" event={"ID":"e9223010-421c-4685-92b9-7f6de5318dd8","Type":"ContainerStarted","Data":"f9e10333fc058500cf612d04243f2e5e187742c9b3eb125d28269a446920b284"}
May 28 17:18:30.846143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.840327    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc" event={"ID":"e9223010-421c-4685-92b9-7f6de5318dd8","Type":"ContainerStarted","Data":"548547c316807311dc9fe12aea033afb3fe6077aeec6b503e5671627f28bf1f7"}
May 28 17:18:30.846143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.841127    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:30.846143 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:30.842408    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51433d92_c37d_4282_985c_1543b2c88987.slice/crio-4f8b782e43035a1b3f13b2dadc496a742b86c33c730eec9f04064c4a1104ebb8 WatchSource:0}: Error finding container 4f8b782e43035a1b3f13b2dadc496a742b86c33c730eec9f04064c4a1104ebb8: Status 404 returned error can't find the container with id 4f8b782e43035a1b3f13b2dadc496a742b86c33c730eec9f04064c4a1104ebb8
May 28 17:18:30.858804 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:30.858749    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc" podStartSLOduration=1.858731635 podStartE2EDuration="1.858731635s" podCreationTimestamp="2026-05-28 17:18:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:30.857852525 +0000 UTC m=+65.931945903" watchObservedRunningTime="2026-05-28 17:18:30.858731635 +0000 UTC m=+65.932825013"
May 28 17:18:31.233753 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.232983    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"]
May 28 17:18:31.239389 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.238874    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:31.241392 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.241190    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 17:18:31.241549 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.241449    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mhd9t\""
May 28 17:18:31.243945 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.243838    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"]
May 28 17:18:31.300164 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.300023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xjj58\" (UID: \"97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:31.400668 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.400570    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xjj58\" (UID: \"97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:31.405059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.404999    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xjj58\" (UID: \"97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:31.554374 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.554328    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:31.704695 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.704060    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:31.717210 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.717147    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8761fc9d-66e1-404c-b253-bb77be4d93fa-cert\") pod \"ingress-canary-pmfbw\" (UID: \"8761fc9d-66e1-404c-b253-bb77be4d93fa\") " pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:31.851603 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.851443    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tpt5" event={"ID":"fc6ea918-d083-4d73-ae44-428bcfcac67e","Type":"ContainerStarted","Data":"b8cca671afc24152ec126591750c2c177f2034064d0e0a7e8a877bb0dff7b667"}
May 28 17:18:31.856441 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.856374    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gw7ps" event={"ID":"51433d92-c37d-4282-985c-1543b2c88987","Type":"ContainerStarted","Data":"4f8b782e43035a1b3f13b2dadc496a742b86c33c730eec9f04064c4a1104ebb8"}
May 28 17:18:31.970321 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.970152    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4rht\""
May 28 17:18:31.979659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:31.979623    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmfbw"
May 28 17:18:35.753029 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:35.752999    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"]
May 28 17:18:36.938600 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:36.938549    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97efe349_7f23_40cc_8fa3_3f7ca9ff6d7c.slice/crio-f33a263cf4340f93c3bf3c6872d41b6266fd49bc01f5f7400ca2c7e8f29434ac WatchSource:0}: Error finding container f33a263cf4340f93c3bf3c6872d41b6266fd49bc01f5f7400ca2c7e8f29434ac: Status 404 returned error can't find the container with id f33a263cf4340f93c3bf3c6872d41b6266fd49bc01f5f7400ca2c7e8f29434ac
May 28 17:18:37.101659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.101624    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmfbw"]
May 28 17:18:37.107638 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:37.107576    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8761fc9d_66e1_404c_b253_bb77be4d93fa.slice/crio-589cad0a09de9e86e3adf67aba77e3176769e62e28d0395a333d32116ec55d31 WatchSource:0}: Error finding container 589cad0a09de9e86e3adf67aba77e3176769e62e28d0395a333d32116ec55d31: Status 404 returned error can't find the container with id 589cad0a09de9e86e3adf67aba77e3176769e62e28d0395a333d32116ec55d31
May 28 17:18:37.883784 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.883731    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58" event={"ID":"97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c","Type":"ContainerStarted","Data":"f33a263cf4340f93c3bf3c6872d41b6266fd49bc01f5f7400ca2c7e8f29434ac"}
May 28 17:18:37.885376 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.885319    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz" event={"ID":"9573be04-92ec-4298-88a6-654a317b587d","Type":"ContainerStarted","Data":"8e04a357a595a9eb685fbb4af1c5dff9353e5fec7a78d9d602af77d841a9266f"}
May 28 17:18:37.885591 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.885532    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:37.887307 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.887272    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gw7ps" event={"ID":"51433d92-c37d-4282-985c-1543b2c88987","Type":"ContainerStarted","Data":"91dcbf54518595ffab5b71e2e13f4165110ddde0b79195b345e575f0f74060f8"}
May 28 17:18:37.887448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.887414    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz"
May 28 17:18:37.887448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.887435    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:18:37.889237 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.889178    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t79nx" event={"ID":"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523","Type":"ContainerStarted","Data":"511233648e5a1c2527c466a6b27d6052e94773cdf0b353dc0cf65fc9f2212066"}
May 28 17:18:37.889237 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.889206    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t79nx" event={"ID":"75c6beb6-f10a-4b8d-9928-c0ea7ee8a523","Type":"ContainerStarted","Data":"221995b7793896d4578787d5652d238a78ec73fad90e634164378dbc50175c0c"}
May 28 17:18:37.891589 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.891563    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tpt5" event={"ID":"fc6ea918-d083-4d73-ae44-428bcfcac67e","Type":"ContainerStarted","Data":"8cca3c8b20dc54a80f74aa4ccd913a4d11bc6f4df0755817247169b7c6030087"}
May 28 17:18:37.892912 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.892888    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj" event={"ID":"5f6a74e3-71b6-4a95-8517-580f94cd0336","Type":"ContainerStarted","Data":"9ce280a62cc47bde2008934ec83bc6980e34f4a7359d9f27e5cc15ddb3eea931"}
May 28 17:18:37.894183 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.894166    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmfbw" event={"ID":"8761fc9d-66e1-404c-b253-bb77be4d93fa","Type":"ContainerStarted","Data":"589cad0a09de9e86e3adf67aba77e3176769e62e28d0395a333d32116ec55d31"}
May 28 17:18:37.900030 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.899980    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5799fdff88-px9fz" podStartSLOduration=1.98002934 podStartE2EDuration="8.899966869s" podCreationTimestamp="2026-05-28 17:18:29 +0000 UTC" firstStartedPulling="2026-05-28 17:18:30.061677848 +0000 UTC m=+65.135771203" lastFinishedPulling="2026-05-28 17:18:36.981615372 +0000 UTC m=+72.055708732" observedRunningTime="2026-05-28 17:18:37.899510943 +0000 UTC m=+72.973604337" watchObservedRunningTime="2026-05-28 17:18:37.899966869 +0000 UTC m=+72.974060246"
May 28 17:18:37.915366 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.915292    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8447f9cbb-ddckj" podStartSLOduration=1.965581858 podStartE2EDuration="8.915272023s" podCreationTimestamp="2026-05-28 17:18:29 +0000 UTC" firstStartedPulling="2026-05-28 17:18:30.046326169 +0000 UTC m=+65.120419524" lastFinishedPulling="2026-05-28 17:18:36.996016331 +0000 UTC m=+72.070109689" observedRunningTime="2026-05-28 17:18:37.913278399 +0000 UTC m=+72.987371777" watchObservedRunningTime="2026-05-28 17:18:37.915272023 +0000 UTC m=+72.989365401"
May 28 17:18:37.928317 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.928159    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gw7ps" podStartSLOduration=66.776305564 podStartE2EDuration="1m12.928144563s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:18:30.845179967 +0000 UTC m=+65.919273340" lastFinishedPulling="2026-05-28 17:18:36.997018985 +0000 UTC m=+72.071112339" observedRunningTime="2026-05-28 17:18:37.927642156 +0000 UTC m=+73.001735553" watchObservedRunningTime="2026-05-28 17:18:37.928144563 +0000 UTC m=+73.002237941"
May 28 17:18:37.944554 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.944492    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t79nx" podStartSLOduration=66.370861766 podStartE2EDuration="1m12.944472881s" podCreationTimestamp="2026-05-28 17:17:25 +0000 UTC" firstStartedPulling="2026-05-28 17:18:30.382452636 +0000 UTC m=+65.456545992" lastFinishedPulling="2026-05-28 17:18:36.95606373 +0000 UTC m=+72.030157107" observedRunningTime="2026-05-28 17:18:37.943846697 +0000 UTC m=+73.017940073" watchObservedRunningTime="2026-05-28 17:18:37.944472881 +0000 UTC m=+73.018566263"
May 28 17:18:37.979883 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:37.979830    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8tpt5" podStartSLOduration=2.211286742 podStartE2EDuration="8.979812182s" podCreationTimestamp="2026-05-28 17:18:29 +0000 UTC" firstStartedPulling="2026-05-28 17:18:30.214071678 +0000 UTC m=+65.288165033" lastFinishedPulling="2026-05-28 17:18:36.982597118 +0000 UTC m=+72.056690473" observedRunningTime="2026-05-28 17:18:37.979429516 +0000 UTC m=+73.053522893" watchObservedRunningTime="2026-05-28 17:18:37.979812182 +0000 UTC m=+73.053905560"
May 28 17:18:38.898388 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.898277    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58" event={"ID":"97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c","Type":"ContainerStarted","Data":"a05e4f2de28f2a365a292d29fc692604c246892b80235db3649c5967e310a2f7"}
May 28 17:18:38.898544 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.898513    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:38.899724 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.899675    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmfbw" event={"ID":"8761fc9d-66e1-404c-b253-bb77be4d93fa","Type":"ContainerStarted","Data":"9395ad0acc37eb3f88b4052bdd050b6b6f0022b34e38fdfec5b240725705f8e5"}
May 28 17:18:38.903539 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.903519    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58"
May 28 17:18:38.911865 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.911814    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xjj58" podStartSLOduration=6.942069901 podStartE2EDuration="7.911801827s" podCreationTimestamp="2026-05-28 17:18:31 +0000 UTC" firstStartedPulling="2026-05-28 17:18:36.955471267 +0000 UTC m=+72.029564635" lastFinishedPulling="2026-05-28 17:18:37.925203189 +0000 UTC m=+72.999296561" observedRunningTime="2026-05-28 17:18:38.910561688 +0000 UTC m=+73.984655064" watchObservedRunningTime="2026-05-28 17:18:38.911801827 +0000 UTC m=+73.985895205"
May 28 17:18:38.923322 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:38.923279    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmfbw" podStartSLOduration=38.416026852 podStartE2EDuration="39.923265532s" podCreationTimestamp="2026-05-28 17:17:59 +0000 UTC" firstStartedPulling="2026-05-28 17:18:37.110234063 +0000 UTC m=+72.184327419" lastFinishedPulling="2026-05-28 17:18:38.617472735 +0000 UTC m=+73.691566099" observedRunningTime="2026-05-28 17:18:38.922526009 +0000 UTC m=+73.996619383" watchObservedRunningTime="2026-05-28 17:18:38.923265532 +0000 UTC m=+73.997358909"
May 28 17:18:39.622709 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:39.622677    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:44.675158 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.675119    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q5ltq"]
May 28 17:18:44.677464 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.677445    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.679300 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.679269    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 17:18:44.679456 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.679424    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 17:18:44.679573 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.679554    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 17:18:44.679766 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.679739    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ns2zv\""
May 28 17:18:44.679838 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.679785    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 17:18:44.680199 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.680186    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 17:18:44.680608 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.680591    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 17:18:44.706475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-wtmp\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-sys\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jqr\" (UniqueName: \"kubernetes.io/projected/ed319788-1913-408b-bcf0-7099ce8f7718-kube-api-access-g7jqr\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706847 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-textfile\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706847 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706766    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706847 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706795    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-root\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.706847 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706825    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-metrics-client-ca\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.707099 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.706848    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807362 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807309    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-metrics-client-ca\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807362 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807365    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807393    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-wtmp\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807412    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807434    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-sys\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807462    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jqr\" (UniqueName: \"kubernetes.io/projected/ed319788-1913-408b-bcf0-7099ce8f7718-kube-api-access-g7jqr\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807511    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-textfile\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807544    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807567    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-root\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807611 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807599    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-wtmp\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807632    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-root\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807680    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed319788-1913-408b-bcf0-7099ce8f7718-sys\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.807887    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-textfile\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.807999 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:44.807979    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 17:18:44.808186 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.808024    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-metrics-client-ca\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.808186 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:44.808043    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls podName:ed319788-1913-408b-bcf0-7099ce8f7718 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:45.308023859 +0000 UTC m=+80.382117223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls") pod "node-exporter-q5ltq" (UID: "ed319788-1913-408b-bcf0-7099ce8f7718") : secret "node-exporter-tls" not found
May 28 17:18:44.808186 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.808075    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.810072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.810054    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:44.817947 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:44.817923    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jqr\" (UniqueName: \"kubernetes.io/projected/ed319788-1913-408b-bcf0-7099ce8f7718-kube-api-access-g7jqr\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:45.312299 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:45.312254    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:45.314656 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:45.314633    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed319788-1913-408b-bcf0-7099ce8f7718-node-exporter-tls\") pod \"node-exporter-q5ltq\" (UID: \"ed319788-1913-408b-bcf0-7099ce8f7718\") " pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:45.588363 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:45.588256    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q5ltq"
May 28 17:18:45.596888 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:45.596856    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded319788_1913_408b_bcf0_7099ce8f7718.slice/crio-4e96bbf4045b10489a7a256ff1ead28e9c4d7d3e605067bb1f42762912489cc6 WatchSource:0}: Error finding container 4e96bbf4045b10489a7a256ff1ead28e9c4d7d3e605067bb1f42762912489cc6: Status 404 returned error can't find the container with id 4e96bbf4045b10489a7a256ff1ead28e9c4d7d3e605067bb1f42762912489cc6
May 28 17:18:45.918674 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:45.918583    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5ltq" event={"ID":"ed319788-1913-408b-bcf0-7099ce8f7718","Type":"ContainerStarted","Data":"4e96bbf4045b10489a7a256ff1ead28e9c4d7d3e605067bb1f42762912489cc6"}
May 28 17:18:46.922295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:46.922257    2566 generic.go:358] "Generic (PLEG): container finished" podID="ed319788-1913-408b-bcf0-7099ce8f7718" containerID="80cc1bacbd22def3cae9e9fc79faaab3c83eb92aa882c0f2c6bf9d61c2084970" exitCode=0
May 28 17:18:46.922764 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:46.922304    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5ltq" event={"ID":"ed319788-1913-408b-bcf0-7099ce8f7718","Type":"ContainerDied","Data":"80cc1bacbd22def3cae9e9fc79faaab3c83eb92aa882c0f2c6bf9d61c2084970"}
May 28 17:18:47.927164 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:47.927126    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5ltq" event={"ID":"ed319788-1913-408b-bcf0-7099ce8f7718","Type":"ContainerStarted","Data":"6ccb02052b8c137746c9a501dfd7765537a9b3efc4f4fdb8c266c835550589c4"}
May 28 17:18:47.927164 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:47.927167    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5ltq" event={"ID":"ed319788-1913-408b-bcf0-7099ce8f7718","Type":"ContainerStarted","Data":"a7a5c43182df788ff898a385cd7d3d75fe73a376440ebf9a20813aa47e43364d"}
May 28 17:18:47.947419 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:47.947369    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q5ltq" podStartSLOduration=3.143840786 podStartE2EDuration="3.947338467s" podCreationTimestamp="2026-05-28 17:18:44 +0000 UTC" firstStartedPulling="2026-05-28 17:18:45.59907264 +0000 UTC m=+80.673166009" lastFinishedPulling="2026-05-28 17:18:46.402570331 +0000 UTC m=+81.476663690" observedRunningTime="2026-05-28 17:18:47.946005605 +0000 UTC m=+83.020098982" watchObservedRunningTime="2026-05-28 17:18:47.947338467 +0000 UTC m=+83.021431844"
May 28 17:18:52.867160 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:52.867124    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f67b9fd9b-pw6cc"
May 28 17:18:54.636274 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.636212    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-769c56569-kk4s8" podUID="82d375e5-133e-4469-9d81-8d1125898357" containerName="registry" containerID="cri-o://7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5" gracePeriod=30
May 28 17:18:54.877444 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.877420    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:54.947784 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.947695    2566 generic.go:358] "Generic (PLEG): container finished" podID="82d375e5-133e-4469-9d81-8d1125898357" containerID="7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5" exitCode=0
May 28 17:18:54.947784 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.947759    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769c56569-kk4s8"
May 28 17:18:54.948001 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.947781    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769c56569-kk4s8" event={"ID":"82d375e5-133e-4469-9d81-8d1125898357","Type":"ContainerDied","Data":"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"}
May 28 17:18:54.948001 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.947829    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769c56569-kk4s8" event={"ID":"82d375e5-133e-4469-9d81-8d1125898357","Type":"ContainerDied","Data":"b0b371055200762f6b3ffbe759552030e8e320c2f998b9aa51222b3af4c3da3e"}
May 28 17:18:54.948001 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.947848    2566 scope.go:117] "RemoveContainer" containerID="7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"
May 28 17:18:54.955810 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.955791    2566 scope.go:117] "RemoveContainer" containerID="7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"
May 28 17:18:54.956050 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:18:54.956031    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5\": container with ID starting with 7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5 not found: ID does not exist" containerID="7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"
May 28 17:18:54.956115 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.956064    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5"} err="failed to get container status \"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5\": rpc error: code = NotFound desc = could not find container \"7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5\": container with ID starting with 7c17c6e5b0bcf9aea7944c2c06f2943cea00c410d5de56db7d50c7f96851bdf5 not found: ID does not exist"
May 28 17:18:54.981855 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.981832    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.981963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.981871    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bstf\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.981963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.981896    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982074 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982012    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982074 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982059    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982174 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982097    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982174 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982164    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982338 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982204    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token\") pod \"82d375e5-133e-4469-9d81-8d1125898357\" (UID: \"82d375e5-133e-4469-9d81-8d1125898357\") "
May 28 17:18:54.982414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982332    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:18:54.982550 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.982535    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-trusted-ca\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:54.983096 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.983070    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:18:54.984312 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.984286    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:18:54.984652 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.984585    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:18:54.984652 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.984629    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf" (OuterVolumeSpecName: "kube-api-access-4bstf") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "kube-api-access-4bstf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:18:54.984774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.984652    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:18:54.984774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.984675    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:18:54.990725 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:54.990701    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82d375e5-133e-4469-9d81-8d1125898357" (UID: "82d375e5-133e-4469-9d81-8d1125898357"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:18:55.082865 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082830    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82d375e5-133e-4469-9d81-8d1125898357-ca-trust-extracted\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.082865 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082857    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-bound-sa-token\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.082865 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082867    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-installation-pull-secrets\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.083080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082876    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bstf\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-kube-api-access-4bstf\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.083080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082887    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82d375e5-133e-4469-9d81-8d1125898357-image-registry-private-configuration\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.083080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082897    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82d375e5-133e-4469-9d81-8d1125898357-registry-tls\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.083080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.082905    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82d375e5-133e-4469-9d81-8d1125898357-registry-certificates\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:18:55.267402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.267372    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:18:55.273072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.273046    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-769c56569-kk4s8"]
May 28 17:18:55.537237 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:55.537161    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d375e5-133e-4469-9d81-8d1125898357" path="/var/lib/kubelet/pods/82d375e5-133e-4469-9d81-8d1125898357/volumes"
May 28 17:18:56.982587 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.982554    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:18:56.983068 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.982888    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d375e5-133e-4469-9d81-8d1125898357" containerName="registry"
May 28 17:18:56.983068 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.982905    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d375e5-133e-4469-9d81-8d1125898357" containerName="registry"
May 28 17:18:56.983068 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.982962    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="82d375e5-133e-4469-9d81-8d1125898357" containerName="registry"
May 28 17:18:56.987679 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.987660    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989873    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989915    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989940    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989916    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jbhnv\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989961    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989962    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989984    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 17:18:56.990072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.989949    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 17:18:56.994946 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:56.994527    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:18:57.098937 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.098902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.098937 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.098935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.099194 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.098962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz227\" (UniqueName: \"kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.099194 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.098990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.099194 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.099113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.099194 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.099156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200527 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200490    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200527 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200530    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200783 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200554    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200783 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200572    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200783 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200700    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gz227\" (UniqueName: \"kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.200783 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.200740    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.201295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.201272    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.201448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.201279    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.201448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.201309    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.202999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.202969    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.203164 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.203145    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.207356 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.207322    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz227\" (UniqueName: \"kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227\") pod \"console-79d9db8c8c-qstvt\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") " pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.297402 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.297361    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:18:57.421979 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.421941    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:18:57.424913 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:18:57.424889    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81382ec_c4b9_441b_b765_ccb631c6dd51.slice/crio-2de75590e35c1239faa8a0110c58dfbc25cfcfa2c3f6ac5f13385348d04e80c8 WatchSource:0}: Error finding container 2de75590e35c1239faa8a0110c58dfbc25cfcfa2c3f6ac5f13385348d04e80c8: Status 404 returned error can't find the container with id 2de75590e35c1239faa8a0110c58dfbc25cfcfa2c3f6ac5f13385348d04e80c8
May 28 17:18:57.957268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:18:57.957227    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d9db8c8c-qstvt" event={"ID":"c81382ec-c4b9-441b-b765-ccb631c6dd51","Type":"ContainerStarted","Data":"2de75590e35c1239faa8a0110c58dfbc25cfcfa2c3f6ac5f13385348d04e80c8"}
May 28 17:19:00.672301 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.672264    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:19:00.675823 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.675802    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.683178 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.683157    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 17:19:00.685208 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.685187    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:19:00.730716 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730798 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730725    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730798 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730745    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6wn\" (UniqueName: \"kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730798 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730905 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730848    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730905 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.730965 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.730911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.831884 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.831841    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.831884 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.831890    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.831919    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.831951    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.831979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832004    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832107 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832027    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6wn\" (UniqueName: \"kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832755 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832717    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832755 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832746    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832923 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832761    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.832923 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.832871    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.834424 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.834398    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.834509 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.834492    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.838902 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.838872    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6wn\" (UniqueName: \"kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn\") pod \"console-64b76d8776-jbvkg\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") " pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:00.966582 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.966494    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d9db8c8c-qstvt" event={"ID":"c81382ec-c4b9-441b-b765-ccb631c6dd51","Type":"ContainerStarted","Data":"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"}
May 28 17:19:00.980842 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.980797    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79d9db8c8c-qstvt" podStartSLOduration=1.701860816 podStartE2EDuration="4.980784866s" podCreationTimestamp="2026-05-28 17:18:56 +0000 UTC" firstStartedPulling="2026-05-28 17:18:57.426890965 +0000 UTC m=+92.500984320" lastFinishedPulling="2026-05-28 17:19:00.705815012 +0000 UTC m=+95.779908370" observedRunningTime="2026-05-28 17:19:00.979400141 +0000 UTC m=+96.053493518" watchObservedRunningTime="2026-05-28 17:19:00.980784866 +0000 UTC m=+96.054878244"
May 28 17:19:00.985897 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:00.985873    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:01.109631 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:01.109597    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:19:01.112392 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:19:01.112357    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c81f2b6_4dea_4062_90b6_0b54aa89790e.slice/crio-8d97e72693405af90d372730dfad6529529c3a8d05164992ec5bea8e1549a555 WatchSource:0}: Error finding container 8d97e72693405af90d372730dfad6529529c3a8d05164992ec5bea8e1549a555: Status 404 returned error can't find the container with id 8d97e72693405af90d372730dfad6529529c3a8d05164992ec5bea8e1549a555
May 28 17:19:01.970926 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:01.970881    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b76d8776-jbvkg" event={"ID":"8c81f2b6-4dea-4062-90b6-0b54aa89790e","Type":"ContainerStarted","Data":"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"}
May 28 17:19:01.970926 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:01.970931    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b76d8776-jbvkg" event={"ID":"8c81f2b6-4dea-4062-90b6-0b54aa89790e","Type":"ContainerStarted","Data":"8d97e72693405af90d372730dfad6529529c3a8d05164992ec5bea8e1549a555"}
May 28 17:19:01.986971 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:01.986912    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64b76d8776-jbvkg" podStartSLOduration=1.986892686 podStartE2EDuration="1.986892686s" podCreationTimestamp="2026-05-28 17:19:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:01.985829158 +0000 UTC m=+97.059922551" watchObservedRunningTime="2026-05-28 17:19:01.986892686 +0000 UTC m=+97.060986065"
May 28 17:19:07.298272 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:07.298219    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:07.298786 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:07.298293    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:07.303003 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:07.302978    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:07.992295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:07.992266    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:08.901891 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:08.901851    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gw7ps"
May 28 17:19:10.986571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:10.986528    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:10.986571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:10.986574    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:10.991123 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:10.991098    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:11.002089 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:11.002067    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:19:11.048828 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:11.048794    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:19:36.067759 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.067698    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79d9db8c8c-qstvt" podUID="c81382ec-c4b9-441b-b765-ccb631c6dd51" containerName="console" containerID="cri-o://37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b" gracePeriod=15
May 28 17:19:36.309158 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.309137    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79d9db8c8c-qstvt_c81382ec-c4b9-441b-b765-ccb631c6dd51/console/0.log"
May 28 17:19:36.309252 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.309197    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:36.414835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414731    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.414835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414778    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.414835 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414813    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.415108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414925    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.415108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414954    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz227\" (UniqueName: \"kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.415108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.414999    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca\") pod \"c81382ec-c4b9-441b-b765-ccb631c6dd51\" (UID: \"c81382ec-c4b9-441b-b765-ccb631c6dd51\") "
May 28 17:19:36.415311 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.415290    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:19:36.415381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.415320    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config" (OuterVolumeSpecName: "console-config") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:19:36.415435 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.415410    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca" (OuterVolumeSpecName: "service-ca") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:19:36.417141 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.417114    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227" (OuterVolumeSpecName: "kube-api-access-gz227") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "kube-api-access-gz227". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:19:36.417141 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.417129    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:19:36.417279 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.417152    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c81382ec-c4b9-441b-b765-ccb631c6dd51" (UID: "c81382ec-c4b9-441b-b765-ccb631c6dd51"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:19:36.516243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516206    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-service-ca\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:36.516243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516235    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-oauth-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:36.516243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516246    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-oauth-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:36.516243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516255    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:36.516526 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516265    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c81382ec-c4b9-441b-b765-ccb631c6dd51-console-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:36.516526 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:36.516274    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz227\" (UniqueName: \"kubernetes.io/projected/c81382ec-c4b9-441b-b765-ccb631c6dd51-kube-api-access-gz227\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:19:37.066041 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066013    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79d9db8c8c-qstvt_c81382ec-c4b9-441b-b765-ccb631c6dd51/console/0.log"
May 28 17:19:37.066199 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066058    2566 generic.go:358] "Generic (PLEG): container finished" podID="c81382ec-c4b9-441b-b765-ccb631c6dd51" containerID="37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b" exitCode=2
May 28 17:19:37.066199 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066120    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d9db8c8c-qstvt"
May 28 17:19:37.066199 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066145    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d9db8c8c-qstvt" event={"ID":"c81382ec-c4b9-441b-b765-ccb631c6dd51","Type":"ContainerDied","Data":"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"}
May 28 17:19:37.066199 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066189    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d9db8c8c-qstvt" event={"ID":"c81382ec-c4b9-441b-b765-ccb631c6dd51","Type":"ContainerDied","Data":"2de75590e35c1239faa8a0110c58dfbc25cfcfa2c3f6ac5f13385348d04e80c8"}
May 28 17:19:37.066385 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.066208    2566 scope.go:117] "RemoveContainer" containerID="37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"
May 28 17:19:37.074906 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.074761    2566 scope.go:117] "RemoveContainer" containerID="37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"
May 28 17:19:37.075150 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:19:37.075041    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b\": container with ID starting with 37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b not found: ID does not exist" containerID="37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"
May 28 17:19:37.075150 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.075066    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b"} err="failed to get container status \"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b\": rpc error: code = NotFound desc = could not find container \"37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b\": container with ID starting with 37ef4793583a71f917c4303a6ff2dc983023105a8664b8cf533802b027d6d64b not found: ID does not exist"
May 28 17:19:37.084538 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.084516    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:19:37.088273 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.087775    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79d9db8c8c-qstvt"]
May 28 17:19:37.535103 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:19:37.535071    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c81382ec-c4b9-441b-b765-ccb631c6dd51" path="/var/lib/kubelet/pods/c81382ec-c4b9-441b-b765-ccb631c6dd51/volumes"
May 28 17:20:08.835740 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.835703    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:20:08.836215 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.835954    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c81382ec-c4b9-441b-b765-ccb631c6dd51" containerName="console"
May 28 17:20:08.836215 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.835965    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81382ec-c4b9-441b-b765-ccb631c6dd51" containerName="console"
May 28 17:20:08.836215 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.836013    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="c81382ec-c4b9-441b-b765-ccb631c6dd51" containerName="console"
May 28 17:20:08.837986 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.837967    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.849491 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.849465    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:20:08.949064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949178    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lv7b\" (UniqueName: \"kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949255    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:08.949280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:08.949275    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050034 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.049992    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050034 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050042    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050065    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050081    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050104    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lv7b\" (UniqueName: \"kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050127    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050172    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.050934 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050904    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.051063 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050912    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.051063 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.050963    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.051185 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.051078    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.052630 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.052606    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.052708 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.052694    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.056972 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.056950    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lv7b\" (UniqueName: \"kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b\") pod \"console-86b766c6bf-85q98\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") " pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.147169 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.147073    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:09.272726 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:09.272568    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:20:09.275449 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:20:09.275410    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46caf0f2_e2ec_4bed_8890_340e6b23191a.slice/crio-27597e167ec7368809c2236ea4d51aabcf1578c675bfd85852c8d1c66e122c14 WatchSource:0}: Error finding container 27597e167ec7368809c2236ea4d51aabcf1578c675bfd85852c8d1c66e122c14: Status 404 returned error can't find the container with id 27597e167ec7368809c2236ea4d51aabcf1578c675bfd85852c8d1c66e122c14
May 28 17:20:10.155248 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:10.155210    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b766c6bf-85q98" event={"ID":"46caf0f2-e2ec-4bed-8890-340e6b23191a","Type":"ContainerStarted","Data":"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"}
May 28 17:20:10.155248 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:10.155247    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b766c6bf-85q98" event={"ID":"46caf0f2-e2ec-4bed-8890-340e6b23191a","Type":"ContainerStarted","Data":"27597e167ec7368809c2236ea4d51aabcf1578c675bfd85852c8d1c66e122c14"}
May 28 17:20:10.170623 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:10.170574    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86b766c6bf-85q98" podStartSLOduration=2.170559926 podStartE2EDuration="2.170559926s" podCreationTimestamp="2026-05-28 17:20:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:10.169490731 +0000 UTC m=+165.243584110" watchObservedRunningTime="2026-05-28 17:20:10.170559926 +0000 UTC m=+165.244653302"
May 28 17:20:19.147781 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:19.147691    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:19.147781 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:19.147748    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:19.152587 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:19.152564    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:19.185198 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:19.185167    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:20:19.225143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:19.225114    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:20:44.244751 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.244704    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64b76d8776-jbvkg" podUID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" containerName="console" containerID="cri-o://93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690" gracePeriod=15
May 28 17:20:44.480898 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.480868    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64b76d8776-jbvkg_8c81f2b6-4dea-4062-90b6-0b54aa89790e/console/0.log"
May 28 17:20:44.481041 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.480945    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:20:44.625880 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625793    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.625880 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625856    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625899    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625924    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625944    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl6wn\" (UniqueName: \"kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.625990    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.626010    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config\") pod \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\" (UID: \"8c81f2b6-4dea-4062-90b6-0b54aa89790e\") "
May 28 17:20:44.626256 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.626209    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:44.626496 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.626467    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:44.626636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.626505    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config" (OuterVolumeSpecName: "console-config") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:44.626636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.626607    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:44.628152 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.628126    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn" (OuterVolumeSpecName: "kube-api-access-fl6wn") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "kube-api-access-fl6wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:44.628243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.628144    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:44.628243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.628169    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c81f2b6-4dea-4062-90b6-0b54aa89790e" (UID: "8c81f2b6-4dea-4062-90b6-0b54aa89790e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:44.726719 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726683    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726719 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726718    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-service-ca\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726914 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726731    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-oauth-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726914 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726744    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl6wn\" (UniqueName: \"kubernetes.io/projected/8c81f2b6-4dea-4062-90b6-0b54aa89790e-kube-api-access-fl6wn\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726914 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726756    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-oauth-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726914 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726768    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-console-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:44.726914 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:44.726779    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c81f2b6-4dea-4062-90b6-0b54aa89790e-trusted-ca-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:20:45.255053 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255024    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64b76d8776-jbvkg_8c81f2b6-4dea-4062-90b6-0b54aa89790e/console/0.log"
May 28 17:20:45.255483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255064    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" containerID="93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690" exitCode=2
May 28 17:20:45.255483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255123    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b76d8776-jbvkg" event={"ID":"8c81f2b6-4dea-4062-90b6-0b54aa89790e","Type":"ContainerDied","Data":"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"}
May 28 17:20:45.255483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255143    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b76d8776-jbvkg" event={"ID":"8c81f2b6-4dea-4062-90b6-0b54aa89790e","Type":"ContainerDied","Data":"8d97e72693405af90d372730dfad6529529c3a8d05164992ec5bea8e1549a555"}
May 28 17:20:45.255483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255151    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b76d8776-jbvkg"
May 28 17:20:45.255483 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.255157    2566 scope.go:117] "RemoveContainer" containerID="93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"
May 28 17:20:45.263154 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.263131    2566 scope.go:117] "RemoveContainer" containerID="93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"
May 28 17:20:45.263465 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:20:45.263442    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690\": container with ID starting with 93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690 not found: ID does not exist" containerID="93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"
May 28 17:20:45.263519 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.263474    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690"} err="failed to get container status \"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690\": rpc error: code = NotFound desc = could not find container \"93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690\": container with ID starting with 93486d78c2bfa5d966c7b9d69ea96717bc317e12b9cfd66334d333156b551690 not found: ID does not exist"
May 28 17:20:45.273558 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.273536    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:20:45.277282 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.277258    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64b76d8776-jbvkg"]
May 28 17:20:45.535648 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:20:45.535571    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" path="/var/lib/kubelet/pods/8c81f2b6-4dea-4062-90b6-0b54aa89790e/volumes"
May 28 17:21:07.139577 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.139540    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"]
May 28 17:21:07.139962 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.139824    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" containerName="console"
May 28 17:21:07.139962 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.139834    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" containerName="console"
May 28 17:21:07.139962 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.139880    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c81f2b6-4dea-4062-90b6-0b54aa89790e" containerName="console"
May 28 17:21:07.142855 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.142829    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.144695 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.144676    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:21:07.144779 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.144685    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:21:07.144991 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.144975    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:21:07.149530 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.149503    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"]
May 28 17:21:07.193523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.193482    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.193523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.193527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrvhh\" (UniqueName: \"kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.193739 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.193556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.294842 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.294798    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.295036 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.294888    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.295036 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.294927    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrvhh\" (UniqueName: \"kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.295193 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.295171    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.295252 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.295199    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.302240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.302217    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrvhh\" (UniqueName: \"kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.452617 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.452538    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:07.578106 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:07.578074    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"]
May 28 17:21:07.581282 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:21:07.581253    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f3d626_f715_402b_96dc_cfe545044968.slice/crio-14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc WatchSource:0}: Error finding container 14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc: Status 404 returned error can't find the container with id 14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc
May 28 17:21:08.319462 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:08.319419    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8" event={"ID":"33f3d626-f715-402b-96dc-cfe545044968","Type":"ContainerStarted","Data":"14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc"}
May 28 17:21:12.331597 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:12.331562    2566 generic.go:358] "Generic (PLEG): container finished" podID="33f3d626-f715-402b-96dc-cfe545044968" containerID="cead5dbd8f37baa8ba797498f31f30061121f8eb3f80f3ac2554491a8e8c635e" exitCode=0
May 28 17:21:12.331902 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:12.331611    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8" event={"ID":"33f3d626-f715-402b-96dc-cfe545044968","Type":"ContainerDied","Data":"cead5dbd8f37baa8ba797498f31f30061121f8eb3f80f3ac2554491a8e8c635e"}
May 28 17:21:15.340635 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:15.340598    2566 generic.go:358] "Generic (PLEG): container finished" podID="33f3d626-f715-402b-96dc-cfe545044968" containerID="1f1984e293e0c665e7d638b4f854ced7f6449510492e7c8f631ea8f6095eae14" exitCode=0
May 28 17:21:15.341105 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:15.340656    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8" event={"ID":"33f3d626-f715-402b-96dc-cfe545044968","Type":"ContainerDied","Data":"1f1984e293e0c665e7d638b4f854ced7f6449510492e7c8f631ea8f6095eae14"}
May 28 17:21:21.359200 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:21.359164    2566 generic.go:358] "Generic (PLEG): container finished" podID="33f3d626-f715-402b-96dc-cfe545044968" containerID="b51bea5565cc8fed53e0a1c294d342c21181e69cee75c39b8c784814f1514a07" exitCode=0
May 28 17:21:21.359610 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:21.359235    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8" event={"ID":"33f3d626-f715-402b-96dc-cfe545044968","Type":"ContainerDied","Data":"b51bea5565cc8fed53e0a1c294d342c21181e69cee75c39b8c784814f1514a07"}
May 28 17:21:22.477902 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.477877    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:22.523503 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.523465    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrvhh\" (UniqueName: \"kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh\") pod \"33f3d626-f715-402b-96dc-cfe545044968\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") "
May 28 17:21:22.523503 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.523509    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle\") pod \"33f3d626-f715-402b-96dc-cfe545044968\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") "
May 28 17:21:22.523734 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.523558    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util\") pod \"33f3d626-f715-402b-96dc-cfe545044968\" (UID: \"33f3d626-f715-402b-96dc-cfe545044968\") "
May 28 17:21:22.524147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.524120    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle" (OuterVolumeSpecName: "bundle") pod "33f3d626-f715-402b-96dc-cfe545044968" (UID: "33f3d626-f715-402b-96dc-cfe545044968"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:21:22.525757 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.525728    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh" (OuterVolumeSpecName: "kube-api-access-mrvhh") pod "33f3d626-f715-402b-96dc-cfe545044968" (UID: "33f3d626-f715-402b-96dc-cfe545044968"). InnerVolumeSpecName "kube-api-access-mrvhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:21:22.527711 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.527689    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util" (OuterVolumeSpecName: "util") pod "33f3d626-f715-402b-96dc-cfe545044968" (UID: "33f3d626-f715-402b-96dc-cfe545044968"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:21:22.624629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.624546    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrvhh\" (UniqueName: \"kubernetes.io/projected/33f3d626-f715-402b-96dc-cfe545044968-kube-api-access-mrvhh\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:22.624629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.624578    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:22.624629 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:22.624588    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f3d626-f715-402b-96dc-cfe545044968-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:23.366571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:23.366535    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8" event={"ID":"33f3d626-f715-402b-96dc-cfe545044968","Type":"ContainerDied","Data":"14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc"}
May 28 17:21:23.366571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:23.366565    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jzr8"
May 28 17:21:23.366571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:23.366573    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14745cdcb2762847e48cda7a31082dea8b3dc77425510410ad8b2a6186b643fc"
May 28 17:21:30.016608 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016569    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"]
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016906    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="util"
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016920    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="util"
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016931    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="pull"
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016939    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="pull"
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016958    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="extract"
May 28 17:21:30.017019 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.016966    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="extract"
May 28 17:21:30.017232 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.017032    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="33f3d626-f715-402b-96dc-cfe545044968" containerName="extract"
May 28 17:21:30.069475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.069444    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"]
May 28 17:21:30.069631 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.069557    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.071395 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.071372    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9n4nk\""
May 28 17:21:30.071579 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.071373    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 17:21:30.071579 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.071493    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 17:21:30.181259 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.181217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ghhs\" (UniqueName: \"kubernetes.io/projected/93542445-d742-4b05-9a46-ea014e82c655-kube-api-access-2ghhs\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.181467 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.181281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93542445-d742-4b05-9a46-ea014e82c655-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.282016 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.281922    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93542445-d742-4b05-9a46-ea014e82c655-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.282016 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.281984    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ghhs\" (UniqueName: \"kubernetes.io/projected/93542445-d742-4b05-9a46-ea014e82c655-kube-api-access-2ghhs\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.282335 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.282312    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93542445-d742-4b05-9a46-ea014e82c655-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.292259 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.292229    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ghhs\" (UniqueName: \"kubernetes.io/projected/93542445-d742-4b05-9a46-ea014e82c655-kube-api-access-2ghhs\") pod \"cert-manager-operator-controller-manager-54b9655956-55v5x\" (UID: \"93542445-d742-4b05-9a46-ea014e82c655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.378518 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.378476    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"
May 28 17:21:30.501758 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:30.501726    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x"]
May 28 17:21:30.505388 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:21:30.505361    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93542445_d742_4b05_9a46_ea014e82c655.slice/crio-206585e9c586aedf3a0652fe193304cb50e66891ab1a14c31327fe8a27d5439b WatchSource:0}: Error finding container 206585e9c586aedf3a0652fe193304cb50e66891ab1a14c31327fe8a27d5439b: Status 404 returned error can't find the container with id 206585e9c586aedf3a0652fe193304cb50e66891ab1a14c31327fe8a27d5439b
May 28 17:21:31.390441 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:31.390396    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x" event={"ID":"93542445-d742-4b05-9a46-ea014e82c655","Type":"ContainerStarted","Data":"206585e9c586aedf3a0652fe193304cb50e66891ab1a14c31327fe8a27d5439b"}
May 28 17:21:33.398726 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:33.398687    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x" event={"ID":"93542445-d742-4b05-9a46-ea014e82c655","Type":"ContainerStarted","Data":"ef1372d75fc79875b5fa3074527f9a1a7f41c74722027f8ae5190d517d9f8a16"}
May 28 17:21:33.418537 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:33.418484    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-55v5x" podStartSLOduration=2.1263550430000002 podStartE2EDuration="4.418469549s" podCreationTimestamp="2026-05-28 17:21:29 +0000 UTC" firstStartedPulling="2026-05-28 17:21:30.507804847 +0000 UTC m=+245.581898203" lastFinishedPulling="2026-05-28 17:21:32.799919351 +0000 UTC m=+247.874012709" observedRunningTime="2026-05-28 17:21:33.416646201 +0000 UTC m=+248.490739578" watchObservedRunningTime="2026-05-28 17:21:33.418469549 +0000 UTC m=+248.492562926"
May 28 17:21:34.174036 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.174004    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"]
May 28 17:21:34.179213 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.179194    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.180992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.180963    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:21:34.181112 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.181025    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:21:34.181304 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.181289    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:21:34.186827 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.186805    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"]
May 28 17:21:34.316922 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.316883    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.316922 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.316929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.317152 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.317019    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4kfv\" (UniqueName: \"kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.418283 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.418245    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4kfv\" (UniqueName: \"kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.418741 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.418294    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.418741 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.418406    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.418741 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.418604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.418881 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.418782    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.427000 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.426931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4kfv\" (UniqueName: \"kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.489783 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.489736    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:34.612795 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:34.612625    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"]
May 28 17:21:34.615317 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:21:34.615286    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde05f6f_f14b_49a2_b9df_451ddcec19e7.slice/crio-9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce WatchSource:0}: Error finding container 9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce: Status 404 returned error can't find the container with id 9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce
May 28 17:21:35.405465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:35.405424    2566 generic.go:358] "Generic (PLEG): container finished" podID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerID="c56999134624367c30c997f35af7f2cb4fec2c1f855435c0eccaa813807f88d3" exitCode=0
May 28 17:21:35.405643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:35.405516    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q" event={"ID":"dde05f6f-f14b-49a2-b9df-451ddcec19e7","Type":"ContainerDied","Data":"c56999134624367c30c997f35af7f2cb4fec2c1f855435c0eccaa813807f88d3"}
May 28 17:21:35.405643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:35.405553    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q" event={"ID":"dde05f6f-f14b-49a2-b9df-451ddcec19e7","Type":"ContainerStarted","Data":"9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce"}
May 28 17:21:39.420874 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:39.420833    2566 generic.go:358] "Generic (PLEG): container finished" podID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerID="418d9ff57d6f22bd094f0f4ef550c4debcf97012c1cbbde18b517b02c1761c46" exitCode=0
May 28 17:21:39.421234 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:39.420915    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q" event={"ID":"dde05f6f-f14b-49a2-b9df-451ddcec19e7","Type":"ContainerDied","Data":"418d9ff57d6f22bd094f0f4ef550c4debcf97012c1cbbde18b517b02c1761c46"}
May 28 17:21:40.425949 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:40.425910    2566 generic.go:358] "Generic (PLEG): container finished" podID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerID="3d053b19ef8eee7665aa08a4ba908356c4956fbb61486a06fb1416476f280a2f" exitCode=0
May 28 17:21:40.426318 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:40.425993    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q" event={"ID":"dde05f6f-f14b-49a2-b9df-451ddcec19e7","Type":"ContainerDied","Data":"3d053b19ef8eee7665aa08a4ba908356c4956fbb61486a06fb1416476f280a2f"}
May 28 17:21:41.548875 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.548855    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:41.674599 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.674551    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle\") pod \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") "
May 28 17:21:41.674774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.674620    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util\") pod \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") "
May 28 17:21:41.674774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.674644    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4kfv\" (UniqueName: \"kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv\") pod \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\" (UID: \"dde05f6f-f14b-49a2-b9df-451ddcec19e7\") "
May 28 17:21:41.674953 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.674930    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle" (OuterVolumeSpecName: "bundle") pod "dde05f6f-f14b-49a2-b9df-451ddcec19e7" (UID: "dde05f6f-f14b-49a2-b9df-451ddcec19e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:21:41.676710 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.676682    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv" (OuterVolumeSpecName: "kube-api-access-z4kfv") pod "dde05f6f-f14b-49a2-b9df-451ddcec19e7" (UID: "dde05f6f-f14b-49a2-b9df-451ddcec19e7"). InnerVolumeSpecName "kube-api-access-z4kfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:21:41.679170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.679098    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util" (OuterVolumeSpecName: "util") pod "dde05f6f-f14b-49a2-b9df-451ddcec19e7" (UID: "dde05f6f-f14b-49a2-b9df-451ddcec19e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:21:41.775224 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.775175    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:41.775224 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.775217    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4kfv\" (UniqueName: \"kubernetes.io/projected/dde05f6f-f14b-49a2-b9df-451ddcec19e7-kube-api-access-z4kfv\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:41.775440 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:41.775238    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dde05f6f-f14b-49a2-b9df-451ddcec19e7-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:21:42.432942 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:42.432913    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q" event={"ID":"dde05f6f-f14b-49a2-b9df-451ddcec19e7","Type":"ContainerDied","Data":"9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce"}
May 28 17:21:42.432942 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:42.432944    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9757268c3195af2eff30ac3b7bcf0039178e7c87715168ab24957fcaeaef5dce"
May 28 17:21:42.433144 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:42.432945    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgr28q"
May 28 17:21:48.875226 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875146    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6tttt"]
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875478    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="util"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875493    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="util"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875512    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="pull"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875518    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="pull"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875532    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="extract"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875540    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="extract"
May 28 17:21:48.875694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.875581    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dde05f6f-f14b-49a2-b9df-451ddcec19e7" containerName="extract"
May 28 17:21:48.877610 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.877595    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:48.879271 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.879247    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 17:21:48.879534 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.879517    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rm46f\""
May 28 17:21:48.879631 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.879519    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 17:21:48.886800 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:48.886777    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6tttt"]
May 28 17:21:49.031490 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.031450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8zf\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-kube-api-access-zn8zf\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.031490 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.031494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-bound-sa-token\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.132753 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.132671    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8zf\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-kube-api-access-zn8zf\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.132753 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.132719    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-bound-sa-token\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.140148 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.140125    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-bound-sa-token\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.140358 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.140324    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8zf\" (UniqueName: \"kubernetes.io/projected/38cf5e27-3ce4-4564-85f3-db1d02482bec-kube-api-access-zn8zf\") pod \"cert-manager-79c8d999ff-6tttt\" (UID: \"38cf5e27-3ce4-4564-85f3-db1d02482bec\") " pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.186958 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.186927    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6tttt"
May 28 17:21:49.309128 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.309089    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6tttt"]
May 28 17:21:49.313212 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:21:49.313187    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38cf5e27_3ce4_4564_85f3_db1d02482bec.slice/crio-9076be37bfc8afd185da587318af380be11a42fd5f39f08a88ad8bb77b3f6e6a WatchSource:0}: Error finding container 9076be37bfc8afd185da587318af380be11a42fd5f39f08a88ad8bb77b3f6e6a: Status 404 returned error can't find the container with id 9076be37bfc8afd185da587318af380be11a42fd5f39f08a88ad8bb77b3f6e6a
May 28 17:21:49.453877 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:49.453786    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6tttt" event={"ID":"38cf5e27-3ce4-4564-85f3-db1d02482bec","Type":"ContainerStarted","Data":"9076be37bfc8afd185da587318af380be11a42fd5f39f08a88ad8bb77b3f6e6a"}
May 28 17:21:52.342460 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.342417    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"]
May 28 17:21:52.345466 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.345450    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.347044 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.347023    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 17:21:52.347491 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.347472    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 17:21:52.347587 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.347499    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7xscb\""
May 28 17:21:52.353100 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.353076    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"]
May 28 17:21:52.462757 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.462705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2baae415-b937-455c-a36b-a0a3a9ffd229-tmp\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.462963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.462800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbdj\" (UniqueName: \"kubernetes.io/projected/2baae415-b937-455c-a36b-a0a3a9ffd229-kube-api-access-rgbdj\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.470385 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.470327    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6tttt" event={"ID":"38cf5e27-3ce4-4564-85f3-db1d02482bec","Type":"ContainerStarted","Data":"4f824d6cd6293c756d78c88b01f048822c888e05b89f83c49e6e7c9eba3274c9"}
May 28 17:21:52.487025 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.486966    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-6tttt" podStartSLOduration=1.872236724 podStartE2EDuration="4.486948372s" podCreationTimestamp="2026-05-28 17:21:48 +0000 UTC" firstStartedPulling="2026-05-28 17:21:49.315484858 +0000 UTC m=+264.389578213" lastFinishedPulling="2026-05-28 17:21:51.930196489 +0000 UTC m=+267.004289861" observedRunningTime="2026-05-28 17:21:52.485730825 +0000 UTC m=+267.559824204" watchObservedRunningTime="2026-05-28 17:21:52.486948372 +0000 UTC m=+267.561041749"
May 28 17:21:52.564273 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.564235    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2baae415-b937-455c-a36b-a0a3a9ffd229-tmp\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.564454 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.564300    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbdj\" (UniqueName: \"kubernetes.io/projected/2baae415-b937-455c-a36b-a0a3a9ffd229-kube-api-access-rgbdj\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.564735 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.564710    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2baae415-b937-455c-a36b-a0a3a9ffd229-tmp\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.572108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.572084    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbdj\" (UniqueName: \"kubernetes.io/projected/2baae415-b937-455c-a36b-a0a3a9ffd229-kube-api-access-rgbdj\") pod \"openshift-lws-operator-bfc7f696d-45ttj\" (UID: \"2baae415-b937-455c-a36b-a0a3a9ffd229\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.655947 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.655848    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"
May 28 17:21:52.778617 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:52.778585    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj"]
May 28 17:21:52.781045 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:21:52.781019    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2baae415_b937_455c_a36b_a0a3a9ffd229.slice/crio-641062dc52e2d2aef695a097c77c4fae9579b5d733fe64c65a039b544e3fc57d WatchSource:0}: Error finding container 641062dc52e2d2aef695a097c77c4fae9579b5d733fe64c65a039b544e3fc57d: Status 404 returned error can't find the container with id 641062dc52e2d2aef695a097c77c4fae9579b5d733fe64c65a039b544e3fc57d
May 28 17:21:53.474119 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:53.474081    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj" event={"ID":"2baae415-b937-455c-a36b-a0a3a9ffd229","Type":"ContainerStarted","Data":"641062dc52e2d2aef695a097c77c4fae9579b5d733fe64c65a039b544e3fc57d"}
May 28 17:21:56.484722 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:56.484628    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj" event={"ID":"2baae415-b937-455c-a36b-a0a3a9ffd229","Type":"ContainerStarted","Data":"63f638012989fdea72b58377d486fed81e3ff206204b6df9cd4dc47ddf21ca73"}
May 28 17:21:56.498794 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:56.498744    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45ttj" podStartSLOduration=1.071844411 podStartE2EDuration="4.498730512s" podCreationTimestamp="2026-05-28 17:21:52 +0000 UTC" firstStartedPulling="2026-05-28 17:21:52.782890419 +0000 UTC m=+267.856983777" lastFinishedPulling="2026-05-28 17:21:56.20977652 +0000 UTC m=+271.283869878" observedRunningTime="2026-05-28 17:21:56.4974835 +0000 UTC m=+271.571576877" watchObservedRunningTime="2026-05-28 17:21:56.498730512 +0000 UTC m=+271.572823888"
May 28 17:21:59.927767 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.927732    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"]
May 28 17:21:59.930796 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.930780    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:21:59.932793 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.932765    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:21:59.932793 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.932787    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:21:59.933309 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.933288    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:21:59.942986 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:21:59.940824    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"]
May 28 17:22:00.117756 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.117713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.117928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.117777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.117928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.117819    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6djf\" (UniqueName: \"kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.219243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.219165    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.219243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.219223    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.219423 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.219248    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6djf\" (UniqueName: \"kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.219685 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.219660    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.219722 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.219660    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.226384 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.226338    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6djf\" (UniqueName: \"kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.245179 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.245143    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:00.370798 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.370775    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"]
May 28 17:22:00.373223 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:00.373191    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a6cceb_68cd_4374_b7fe_c424e0dacfc0.slice/crio-706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111 WatchSource:0}: Error finding container 706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111: Status 404 returned error can't find the container with id 706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111
May 28 17:22:00.497979 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.497945    2566 generic.go:358] "Generic (PLEG): container finished" podID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerID="454d8e21652129702f82ad9a50ac6c56eb1527b29670c10ed0011a9f852f3ab9" exitCode=0
May 28 17:22:00.498137 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.498032    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s" event={"ID":"80a6cceb-68cd-4374-b7fe-c424e0dacfc0","Type":"ContainerDied","Data":"454d8e21652129702f82ad9a50ac6c56eb1527b29670c10ed0011a9f852f3ab9"}
May 28 17:22:00.498137 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:00.498067    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s" event={"ID":"80a6cceb-68cd-4374-b7fe-c424e0dacfc0","Type":"ContainerStarted","Data":"706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111"}
May 28 17:22:01.502830 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:01.502795    2566 generic.go:358] "Generic (PLEG): container finished" podID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerID="c4a79f9108f3e039f9524328852d5f387ecfd5017885b4177686f8c1cf5002b8" exitCode=0
May 28 17:22:01.503266 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:01.502861    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s" event={"ID":"80a6cceb-68cd-4374-b7fe-c424e0dacfc0","Type":"ContainerDied","Data":"c4a79f9108f3e039f9524328852d5f387ecfd5017885b4177686f8c1cf5002b8"}
May 28 17:22:02.510131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:02.510097    2566 generic.go:358] "Generic (PLEG): container finished" podID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerID="054b2176985a11add965bdc7941dc72281faf8b8fe3001314e83e99605024e3d" exitCode=0
May 28 17:22:02.510528 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:02.510193    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s" event={"ID":"80a6cceb-68cd-4374-b7fe-c424e0dacfc0","Type":"ContainerDied","Data":"054b2176985a11add965bdc7941dc72281faf8b8fe3001314e83e99605024e3d"}
May 28 17:22:03.641106 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.641081    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:03.645963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.645943    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util\") pod \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") "
May 28 17:22:03.646050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.646010    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6djf\" (UniqueName: \"kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf\") pod \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") "
May 28 17:22:03.646050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.646032    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle\") pod \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\" (UID: \"80a6cceb-68cd-4374-b7fe-c424e0dacfc0\") "
May 28 17:22:03.646799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.646775    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle" (OuterVolumeSpecName: "bundle") pod "80a6cceb-68cd-4374-b7fe-c424e0dacfc0" (UID: "80a6cceb-68cd-4374-b7fe-c424e0dacfc0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:03.648046 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.648028    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf" (OuterVolumeSpecName: "kube-api-access-j6djf") pod "80a6cceb-68cd-4374-b7fe-c424e0dacfc0" (UID: "80a6cceb-68cd-4374-b7fe-c424e0dacfc0"). InnerVolumeSpecName "kube-api-access-j6djf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:22:03.651307 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.651271    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util" (OuterVolumeSpecName: "util") pod "80a6cceb-68cd-4374-b7fe-c424e0dacfc0" (UID: "80a6cceb-68cd-4374-b7fe-c424e0dacfc0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:03.747016 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.746987    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:03.747016 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.747014    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6djf\" (UniqueName: \"kubernetes.io/projected/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-kube-api-access-j6djf\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:03.747202 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:03.747025    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80a6cceb-68cd-4374-b7fe-c424e0dacfc0-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:04.518051 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:04.518014    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s" event={"ID":"80a6cceb-68cd-4374-b7fe-c424e0dacfc0","Type":"ContainerDied","Data":"706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111"}
May 28 17:22:04.518051 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:04.518051    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="706c2557138c4712f6475f34f9db7fd6177ed814514b4eef3ad75fc4786f6111"
May 28 17:22:04.518284 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:04.518067    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5mt28s"
May 28 17:22:10.317427 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317390    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"]
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317816    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="extract"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317836    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="extract"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317850    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="util"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317858    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="util"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317869    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="pull"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317879    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="pull"
May 28 17:22:10.318010 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.317983    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="80a6cceb-68cd-4374-b7fe-c424e0dacfc0" containerName="extract"
May 28 17:22:10.320933 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.320912    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.322577 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.322550    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:22:10.322709 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.322612    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:22:10.322870 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.322854    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:22:10.330170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.330146    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"]
May 28 17:22:10.399407 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.399366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5sf\" (UniqueName: \"kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.399566 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.399416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.399566 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.399439    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.500525 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.500489    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5sf\" (UniqueName: \"kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.500652 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.500543    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.500652 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.500572    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.500897 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.500881    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.500940 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.500904    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.507520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.507487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5sf\" (UniqueName: \"kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.631123 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.631038    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:10.757640 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:10.757607    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"]
May 28 17:22:10.760509 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:10.760481    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fcb039_4874_4b66_a2e0_a15464512acd.slice/crio-c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9 WatchSource:0}: Error finding container c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9: Status 404 returned error can't find the container with id c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9
May 28 17:22:11.537968 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:11.537936    2566 generic.go:358] "Generic (PLEG): container finished" podID="58fcb039-4874-4b66-a2e0-a15464512acd" containerID="dabb6ab7e01eaaec938629b27b5a984abde0f7698f414dcc2712b2dbbb716d55" exitCode=0
May 28 17:22:11.538338 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:11.538016    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x" event={"ID":"58fcb039-4874-4b66-a2e0-a15464512acd","Type":"ContainerDied","Data":"dabb6ab7e01eaaec938629b27b5a984abde0f7698f414dcc2712b2dbbb716d55"}
May 28 17:22:11.538338 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:11.538051    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x" event={"ID":"58fcb039-4874-4b66-a2e0-a15464512acd","Type":"ContainerStarted","Data":"c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9"}
May 28 17:22:12.300210 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.300179    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"]
May 28 17:22:12.302486 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.302468    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.304135 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.304087    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 17:22:12.304279 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.304181    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 17:22:12.304279 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.304190    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 17:22:12.304279 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.304181    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tbcs9\""
May 28 17:22:12.304279 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.304181    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 17:22:12.316928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.316905    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"]
May 28 17:22:12.415971 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.415884    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbtcr\" (UniqueName: \"kubernetes.io/projected/82b80e89-7817-4b22-9f52-e1d3e3e97fea-kube-api-access-gbtcr\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.415971 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.415927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.416143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.416011    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.516679 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.516641    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbtcr\" (UniqueName: \"kubernetes.io/projected/82b80e89-7817-4b22-9f52-e1d3e3e97fea-kube-api-access-gbtcr\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.516848 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.516689    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.516848 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.516735    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.519173 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.519142    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.519285 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.519192    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82b80e89-7817-4b22-9f52-e1d3e3e97fea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.526598 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.526578    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbtcr\" (UniqueName: \"kubernetes.io/projected/82b80e89-7817-4b22-9f52-e1d3e3e97fea-kube-api-access-gbtcr\") pod \"opendatahub-operator-controller-manager-7bc6886474-md55t\" (UID: \"82b80e89-7817-4b22-9f52-e1d3e3e97fea\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.544772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.544745    2566 generic.go:358] "Generic (PLEG): container finished" podID="58fcb039-4874-4b66-a2e0-a15464512acd" containerID="3ac3470e4f6cae40a02d769e56b263df01791735618535fec2c25764f68b84c3" exitCode=0
May 28 17:22:12.545085 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.544834    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x" event={"ID":"58fcb039-4874-4b66-a2e0-a15464512acd","Type":"ContainerDied","Data":"3ac3470e4f6cae40a02d769e56b263df01791735618535fec2c25764f68b84c3"}
May 28 17:22:12.611965 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.611943    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:12.744988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:12.744963    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"]
May 28 17:22:12.747485 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:12.747447    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b80e89_7817_4b22_9f52_e1d3e3e97fea.slice/crio-84c3617e7336585a0a61e37b3d63fbf3304c6262b4b5bed4423b5223db9c1047 WatchSource:0}: Error finding container 84c3617e7336585a0a61e37b3d63fbf3304c6262b4b5bed4423b5223db9c1047: Status 404 returned error can't find the container with id 84c3617e7336585a0a61e37b3d63fbf3304c6262b4b5bed4423b5223db9c1047
May 28 17:22:13.550115 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:13.550076    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t" event={"ID":"82b80e89-7817-4b22-9f52-e1d3e3e97fea","Type":"ContainerStarted","Data":"84c3617e7336585a0a61e37b3d63fbf3304c6262b4b5bed4423b5223db9c1047"}
May 28 17:22:13.552582 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:13.552522    2566 generic.go:358] "Generic (PLEG): container finished" podID="58fcb039-4874-4b66-a2e0-a15464512acd" containerID="bc57d0c514b92cc663110ab503cc50d84d3db18073e18fec60f7a10ba74cabbc" exitCode=0
May 28 17:22:13.552714 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:13.552605    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x" event={"ID":"58fcb039-4874-4b66-a2e0-a15464512acd","Type":"ContainerDied","Data":"bc57d0c514b92cc663110ab503cc50d84d3db18073e18fec60f7a10ba74cabbc"}
May 28 17:22:15.222151 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.222125    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:15.345207 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.345178    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle\") pod \"58fcb039-4874-4b66-a2e0-a15464512acd\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") "
May 28 17:22:15.345370 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.345224    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd5sf\" (UniqueName: \"kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf\") pod \"58fcb039-4874-4b66-a2e0-a15464512acd\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") "
May 28 17:22:15.345370 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.345253    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util\") pod \"58fcb039-4874-4b66-a2e0-a15464512acd\" (UID: \"58fcb039-4874-4b66-a2e0-a15464512acd\") "
May 28 17:22:15.346075 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.346046    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle" (OuterVolumeSpecName: "bundle") pod "58fcb039-4874-4b66-a2e0-a15464512acd" (UID: "58fcb039-4874-4b66-a2e0-a15464512acd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:15.347270 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.347245    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf" (OuterVolumeSpecName: "kube-api-access-zd5sf") pod "58fcb039-4874-4b66-a2e0-a15464512acd" (UID: "58fcb039-4874-4b66-a2e0-a15464512acd"). InnerVolumeSpecName "kube-api-access-zd5sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:22:15.350571 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.350548    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util" (OuterVolumeSpecName: "util") pod "58fcb039-4874-4b66-a2e0-a15464512acd" (UID: "58fcb039-4874-4b66-a2e0-a15464512acd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:15.446636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.446599    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:15.446636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.446631    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd5sf\" (UniqueName: \"kubernetes.io/projected/58fcb039-4874-4b66-a2e0-a15464512acd-kube-api-access-zd5sf\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:15.446636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.446643    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58fcb039-4874-4b66-a2e0-a15464512acd-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:15.560989 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.560956    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t" event={"ID":"82b80e89-7817-4b22-9f52-e1d3e3e97fea","Type":"ContainerStarted","Data":"8890cd9c15e6af5cec07c1c9666b05242edee3421df7507900ed073e8e01d2cf"}
May 28 17:22:15.561151 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.561018    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:15.562556 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.562534    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x"
May 28 17:22:15.562679 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.562531    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9k4d4x" event={"ID":"58fcb039-4874-4b66-a2e0-a15464512acd","Type":"ContainerDied","Data":"c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9"}
May 28 17:22:15.562679 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.562640    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c51b3e2f55b1d21c81aef47dea46ff3c122b6884c2976eb16cbe71965d3109b9"
May 28 17:22:15.590115 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:15.590063    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t" podStartSLOduration=1.10188599 podStartE2EDuration="3.590043286s" podCreationTimestamp="2026-05-28 17:22:12 +0000 UTC" firstStartedPulling="2026-05-28 17:22:12.749239959 +0000 UTC m=+287.823333314" lastFinishedPulling="2026-05-28 17:22:15.237397254 +0000 UTC m=+290.311490610" observedRunningTime="2026-05-28 17:22:15.588907769 +0000 UTC m=+290.663001146" watchObservedRunningTime="2026-05-28 17:22:15.590043286 +0000 UTC m=+290.664136664"
May 28 17:22:25.417183 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:25.417156    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:22:25.418123 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:25.418095    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:22:25.420991 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:25.420970    2566 kubelet.go:1628] "Image garbage collection succeeded"
May 28 17:22:26.568147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:26.568113    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-md55t"
May 28 17:22:29.578288 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578249    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"]
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578552    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="extract"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578565    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="extract"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578576    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="util"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578581    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="util"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578587    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="pull"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578593    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="pull"
May 28 17:22:29.578672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.578651    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="58fcb039-4874-4b66-a2e0-a15464512acd" containerName="extract"
May 28 17:22:29.580867 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.580851    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.582694 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.582668    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:22:29.583155 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.583136    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:22:29.583291 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.583271    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:22:29.601809 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.601776    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"]
May 28 17:22:29.656197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.656149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.656197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.656195    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2frlq\" (UniqueName: \"kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.656493 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.656280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.757194 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.757158    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.757421 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.757220    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.757421 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.757242    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2frlq\" (UniqueName: \"kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.757656 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.757633    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.757710 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.757642    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.765638 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.765616    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2frlq\" (UniqueName: \"kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:29.890281 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:29.890185    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:30.029197 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.029045    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"]
May 28 17:22:30.031319 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:30.031290    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a963c9b_62d5_4bec_b61c_b2e3f15993d4.slice/crio-b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea WatchSource:0}: Error finding container b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea: Status 404 returned error can't find the container with id b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea
May 28 17:22:30.033272 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.033253    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:22:30.610325 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.610290    2566 generic.go:358] "Generic (PLEG): container finished" podID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerID="61ab4899381dc84b7814b56b46255b838046f30342be1e4a0abb42c901352d89" exitCode=0
May 28 17:22:30.610799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.610379    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8" event={"ID":"9a963c9b-62d5-4bec-b61c-b2e3f15993d4","Type":"ContainerDied","Data":"61ab4899381dc84b7814b56b46255b838046f30342be1e4a0abb42c901352d89"}
May 28 17:22:30.610799 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.610422    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8" event={"ID":"9a963c9b-62d5-4bec-b61c-b2e3f15993d4","Type":"ContainerStarted","Data":"b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea"}
May 28 17:22:30.765679 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.765643    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"]
May 28 17:22:30.773726 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.773708    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.776072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776044    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 17:22:30.776204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776051    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 17:22:30.776204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776149    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ldwnr\""
May 28 17:22:30.776204 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776189    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 17:22:30.776365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776329    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 17:22:30.776702 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.776684    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"]
May 28 17:22:30.865772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.865686    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86p4q\" (UniqueName: \"kubernetes.io/projected/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-kube-api-access-86p4q\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.865772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.865727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.865772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.865764    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tmp\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.967179 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.967148    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86p4q\" (UniqueName: \"kubernetes.io/projected/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-kube-api-access-86p4q\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.967179 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.967179    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.967453 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.967216    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tmp\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.969319 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.969298    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tmp\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.969627 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.969607    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:30.973651 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:30.973631    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86p4q\" (UniqueName: \"kubernetes.io/projected/1e3aaa1e-ea15-433f-be22-ac0e5aaea53e-kube-api-access-86p4q\") pod \"kube-auth-proxy-6c878b64bb-jl45m\" (UID: \"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:31.084781 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:31.084746    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"
May 28 17:22:31.210430 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:31.210330    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m"]
May 28 17:22:31.221845 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:31.221811    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3aaa1e_ea15_433f_be22_ac0e5aaea53e.slice/crio-4927f3ae9b071ed0889b8d7d5bdf85b88595da1efe602b73fc1120921e684d7e WatchSource:0}: Error finding container 4927f3ae9b071ed0889b8d7d5bdf85b88595da1efe602b73fc1120921e684d7e: Status 404 returned error can't find the container with id 4927f3ae9b071ed0889b8d7d5bdf85b88595da1efe602b73fc1120921e684d7e
May 28 17:22:31.615187 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:31.615156    2566 generic.go:358] "Generic (PLEG): container finished" podID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerID="961b26e0dababcc35917df73c657c958c14e55d2f79c3dbe8af76fb6465129be" exitCode=0
May 28 17:22:31.615622 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:31.615229    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8" event={"ID":"9a963c9b-62d5-4bec-b61c-b2e3f15993d4","Type":"ContainerDied","Data":"961b26e0dababcc35917df73c657c958c14e55d2f79c3dbe8af76fb6465129be"}
May 28 17:22:31.616358 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:31.616321    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m" event={"ID":"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e","Type":"ContainerStarted","Data":"4927f3ae9b071ed0889b8d7d5bdf85b88595da1efe602b73fc1120921e684d7e"}
May 28 17:22:32.622201 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.622150    2566 generic.go:358] "Generic (PLEG): container finished" podID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerID="a61ee9b376d093a8c8e0bfb6c7c22442282b2aa9f5a8258778b840ee9c88d733" exitCode=0
May 28 17:22:32.622693 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.622291    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8" event={"ID":"9a963c9b-62d5-4bec-b61c-b2e3f15993d4","Type":"ContainerDied","Data":"a61ee9b376d093a8c8e0bfb6c7c22442282b2aa9f5a8258778b840ee9c88d733"}
May 28 17:22:32.881166 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.881073    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9pjkz"]
May 28 17:22:32.887481 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.887440    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:32.889681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.889465    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 17:22:32.889820 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.889791    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-84g7m\""
May 28 17:22:32.890825 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.890777    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9pjkz"]
May 28 17:22:32.986323 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.986257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzc8\" (UniqueName: \"kubernetes.io/projected/b254e869-ffbe-4990-9b78-1a569114057a-kube-api-access-whzc8\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:32.986523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:32.986333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:33.087275 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:33.087237    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:33.087488 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:33.087371    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whzc8\" (UniqueName: \"kubernetes.io/projected/b254e869-ffbe-4990-9b78-1a569114057a-kube-api-access-whzc8\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:33.087488 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:33.087428    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 17:22:33.087606 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:33.087507    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert podName:b254e869-ffbe-4990-9b78-1a569114057a nodeName:}" failed. No retries permitted until 2026-05-28 17:22:33.587485566 +0000 UTC m=+308.661578925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert") pod "odh-model-controller-858dbf95b8-9pjkz" (UID: "b254e869-ffbe-4990-9b78-1a569114057a") : secret "odh-model-controller-webhook-cert" not found
May 28 17:22:33.096573 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:33.096542    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzc8\" (UniqueName: \"kubernetes.io/projected/b254e869-ffbe-4990-9b78-1a569114057a-kube-api-access-whzc8\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:33.592792 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:33.592751    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:33.592963 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:33.592894    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 17:22:33.592963 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:33.592959    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert podName:b254e869-ffbe-4990-9b78-1a569114057a nodeName:}" failed. No retries permitted until 2026-05-28 17:22:34.592941765 +0000 UTC m=+309.667035125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert") pod "odh-model-controller-858dbf95b8-9pjkz" (UID: "b254e869-ffbe-4990-9b78-1a569114057a") : secret "odh-model-controller-webhook-cert" not found
May 28 17:22:34.276821 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.276796    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:34.400028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.399994    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util\") pod \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") "
May 28 17:22:34.400158 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.400061    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle\") pod \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") "
May 28 17:22:34.400158 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.400096    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2frlq\" (UniqueName: \"kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq\") pod \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\" (UID: \"9a963c9b-62d5-4bec-b61c-b2e3f15993d4\") "
May 28 17:22:34.400948 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.400923    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle" (OuterVolumeSpecName: "bundle") pod "9a963c9b-62d5-4bec-b61c-b2e3f15993d4" (UID: "9a963c9b-62d5-4bec-b61c-b2e3f15993d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:34.402229 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.402189    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq" (OuterVolumeSpecName: "kube-api-access-2frlq") pod "9a963c9b-62d5-4bec-b61c-b2e3f15993d4" (UID: "9a963c9b-62d5-4bec-b61c-b2e3f15993d4"). InnerVolumeSpecName "kube-api-access-2frlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:22:34.405088 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.405054    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util" (OuterVolumeSpecName: "util") pod "9a963c9b-62d5-4bec-b61c-b2e3f15993d4" (UID: "9a963c9b-62d5-4bec-b61c-b2e3f15993d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:34.501687 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.501654    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:34.501687 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.501682    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:34.501687 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.501692    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2frlq\" (UniqueName: \"kubernetes.io/projected/9a963c9b-62d5-4bec-b61c-b2e3f15993d4-kube-api-access-2frlq\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:34.602810 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.602709    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:34.605143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.605116    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b254e869-ffbe-4990-9b78-1a569114057a-cert\") pod \"odh-model-controller-858dbf95b8-9pjkz\" (UID: \"b254e869-ffbe-4990-9b78-1a569114057a\") " pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:34.631314 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.631286    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8" event={"ID":"9a963c9b-62d5-4bec-b61c-b2e3f15993d4","Type":"ContainerDied","Data":"b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea"}
May 28 17:22:34.631314 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.631311    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358bhd8"
May 28 17:22:34.631556 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.631316    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b13f810e8ee890eef091077c9ef65bed0059259d0359983dbe95eebf861a6aea"
May 28 17:22:34.632654 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.632609    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m" event={"ID":"1e3aaa1e-ea15-433f-be22-ac0e5aaea53e","Type":"ContainerStarted","Data":"c1928a881b0ecfa0187e1394df6fdce8d3ba314a5e3f85979a9db48a9ee61618"}
May 28 17:22:34.646336 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.646296    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-jl45m" podStartSLOduration=1.568921557 podStartE2EDuration="4.646283005s" podCreationTimestamp="2026-05-28 17:22:30 +0000 UTC" firstStartedPulling="2026-05-28 17:22:31.223656178 +0000 UTC m=+306.297749543" lastFinishedPulling="2026-05-28 17:22:34.301017632 +0000 UTC m=+309.375110991" observedRunningTime="2026-05-28 17:22:34.644813709 +0000 UTC m=+309.718907097" watchObservedRunningTime="2026-05-28 17:22:34.646283005 +0000 UTC m=+309.720376381"
May 28 17:22:34.701364 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.701323    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:34.820394 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:34.820322    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9pjkz"]
May 28 17:22:34.822520 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:34.822495    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb254e869_ffbe_4990_9b78_1a569114057a.slice/crio-4cbe632e9bc691a53d9f00d528361a7446b705d36b5f5051d4b846333efe3fc0 WatchSource:0}: Error finding container 4cbe632e9bc691a53d9f00d528361a7446b705d36b5f5051d4b846333efe3fc0: Status 404 returned error can't find the container with id 4cbe632e9bc691a53d9f00d528361a7446b705d36b5f5051d4b846333efe3fc0
May 28 17:22:35.637143 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:35.637107    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz" event={"ID":"b254e869-ffbe-4990-9b78-1a569114057a","Type":"ContainerStarted","Data":"4cbe632e9bc691a53d9f00d528361a7446b705d36b5f5051d4b846333efe3fc0"}
May 28 17:22:38.650475 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:38.650441    2566 generic.go:358] "Generic (PLEG): container finished" podID="b254e869-ffbe-4990-9b78-1a569114057a" containerID="1069a44d090e8f8bf4d60e2a0d47f680d90686f1677bb4660e5a77b4fc55be01" exitCode=1
May 28 17:22:38.650848 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:38.650492    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz" event={"ID":"b254e869-ffbe-4990-9b78-1a569114057a","Type":"ContainerDied","Data":"1069a44d090e8f8bf4d60e2a0d47f680d90686f1677bb4660e5a77b4fc55be01"}
May 28 17:22:38.650848 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:38.650714    2566 scope.go:117] "RemoveContainer" containerID="1069a44d090e8f8bf4d60e2a0d47f680d90686f1677bb4660e5a77b4fc55be01"
May 28 17:22:39.097037 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097000    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-2c7j7"]
May 28 17:22:39.097290 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097278    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="pull"
May 28 17:22:39.097365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097292    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="pull"
May 28 17:22:39.097365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097308    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="extract"
May 28 17:22:39.097365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097313    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="extract"
May 28 17:22:39.097365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097323    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="util"
May 28 17:22:39.097365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097329    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="util"
May 28 17:22:39.097529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.097391    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a963c9b-62d5-4bec-b61c-b2e3f15993d4" containerName="extract"
May 28 17:22:39.099233 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.099217    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.101067 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.101038    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 17:22:39.101161 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.101058    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6m4zz\""
May 28 17:22:39.109512 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.109482    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-2c7j7"]
May 28 17:22:39.239239 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.239149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.239239 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.239187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxnb\" (UniqueName: \"kubernetes.io/projected/ad6e2ded-622a-49e3-a269-c8e3078d845c-kube-api-access-4zxnb\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.340737 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.340696    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.340940 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.340753    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxnb\" (UniqueName: \"kubernetes.io/projected/ad6e2ded-622a-49e3-a269-c8e3078d845c-kube-api-access-4zxnb\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.340940 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:39.340849    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 17:22:39.340940 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:22:39.340922    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert podName:ad6e2ded-622a-49e3-a269-c8e3078d845c nodeName:}" failed. No retries permitted until 2026-05-28 17:22:39.840901325 +0000 UTC m=+314.914994681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert") pod "kserve-controller-manager-856948b99f-2c7j7" (UID: "ad6e2ded-622a-49e3-a269-c8e3078d845c") : secret "kserve-webhook-server-cert" not found
May 28 17:22:39.349072 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.349045    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxnb\" (UniqueName: \"kubernetes.io/projected/ad6e2ded-622a-49e3-a269-c8e3078d845c-kube-api-access-4zxnb\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.655428 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.655379    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz" event={"ID":"b254e869-ffbe-4990-9b78-1a569114057a","Type":"ContainerStarted","Data":"72c4c549906b3e4523b24e0acd85d458957a071333e0ce37f3ad5fd827221b83"}
May 28 17:22:39.655812 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.655515    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:39.669936 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.669845    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz" podStartSLOduration=3.52774432 podStartE2EDuration="7.669829857s" podCreationTimestamp="2026-05-28 17:22:32 +0000 UTC" firstStartedPulling="2026-05-28 17:22:34.823805735 +0000 UTC m=+309.897899090" lastFinishedPulling="2026-05-28 17:22:38.965891272 +0000 UTC m=+314.039984627" observedRunningTime="2026-05-28 17:22:39.669682043 +0000 UTC m=+314.743775419" watchObservedRunningTime="2026-05-28 17:22:39.669829857 +0000 UTC m=+314.743923235"
May 28 17:22:39.845923 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.845889    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:39.848651 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:39.848608    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6e2ded-622a-49e3-a269-c8e3078d845c-cert\") pod \"kserve-controller-manager-856948b99f-2c7j7\" (UID: \"ad6e2ded-622a-49e3-a269-c8e3078d845c\") " pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:40.011417 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:40.011380    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:40.164959 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:40.164924    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-2c7j7"]
May 28 17:22:40.168044 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:40.168017    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6e2ded_622a_49e3_a269_c8e3078d845c.slice/crio-bd5c3b685ea7d74aa04e98d7eed9663399ab0141ab0be5c458ce3cdab6cf6077 WatchSource:0}: Error finding container bd5c3b685ea7d74aa04e98d7eed9663399ab0141ab0be5c458ce3cdab6cf6077: Status 404 returned error can't find the container with id bd5c3b685ea7d74aa04e98d7eed9663399ab0141ab0be5c458ce3cdab6cf6077
May 28 17:22:40.660450 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:40.660411    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7" event={"ID":"ad6e2ded-622a-49e3-a269-c8e3078d845c","Type":"ContainerStarted","Data":"bd5c3b685ea7d74aa04e98d7eed9663399ab0141ab0be5c458ce3cdab6cf6077"}
May 28 17:22:43.421762 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.421728    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"]
May 28 17:22:43.426481 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.426461    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.432751 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.432623    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:22:43.433924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.433771    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:22:43.436028 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.436008    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fg4d8\""
May 28 17:22:43.455825 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.455790    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"]
May 28 17:22:43.581302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.581257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.581505 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.581320    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sstvk\" (UniqueName: \"kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.581505 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.581454    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.682698 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.682608    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.682698 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.682657    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sstvk\" (UniqueName: \"kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.682900 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.682744    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.683105 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.683086    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.683105 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.683090    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.691581 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.691556    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sstvk\" (UniqueName: \"kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:43.738063 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:43.738025    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:44.048594 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.048566    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"]
May 28 17:22:44.050581 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:44.050550    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc7e656_608a_4b6b_b918_ca1d85a95dcf.slice/crio-14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32 WatchSource:0}: Error finding container 14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32: Status 404 returned error can't find the container with id 14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32
May 28 17:22:44.620994 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.620957    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"]
May 28 17:22:44.623764 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.623747    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.625706 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.625676    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 17:22:44.625706 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.625690    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 17:22:44.625883 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.625730    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-lwk7x\""
May 28 17:22:44.637489 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.637464    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"]
May 28 17:22:44.677032 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.676996    2566 generic.go:358] "Generic (PLEG): container finished" podID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerID="6d740a35fc0ff46053abc4179e998bf55ec7a8088f198a41feb6c54b4a93bd10" exitCode=0
May 28 17:22:44.677232 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.677086    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj" event={"ID":"7fc7e656-608a-4b6b-b918-ca1d85a95dcf","Type":"ContainerDied","Data":"6d740a35fc0ff46053abc4179e998bf55ec7a8088f198a41feb6c54b4a93bd10"}
May 28 17:22:44.677232 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.677132    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj" event={"ID":"7fc7e656-608a-4b6b-b918-ca1d85a95dcf","Type":"ContainerStarted","Data":"14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32"}
May 28 17:22:44.678646 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.678624    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7" event={"ID":"ad6e2ded-622a-49e3-a269-c8e3078d845c","Type":"ContainerStarted","Data":"16da6ec60bfd91e53be0b77880ea55a3dd0e04d02c4c2bee3d36eb683c382538"}
May 28 17:22:44.678837 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.678817    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:22:44.709384 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.709307    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7" podStartSLOduration=1.930239262 podStartE2EDuration="5.709294218s" podCreationTimestamp="2026-05-28 17:22:39 +0000 UTC" firstStartedPulling="2026-05-28 17:22:40.169663524 +0000 UTC m=+315.243756891" lastFinishedPulling="2026-05-28 17:22:43.948718472 +0000 UTC m=+319.022811847" observedRunningTime="2026-05-28 17:22:44.70896464 +0000 UTC m=+319.783058016" watchObservedRunningTime="2026-05-28 17:22:44.709294218 +0000 UTC m=+319.783387595"
May 28 17:22:44.792561 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.792511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.792761 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.792587    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzlp8\" (UniqueName: \"kubernetes.io/projected/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-kube-api-access-qzlp8\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.893139 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.893024    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzlp8\" (UniqueName: \"kubernetes.io/projected/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-kube-api-access-qzlp8\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.893139 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.893132    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.895709 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.895686    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.899639 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.899617    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzlp8\" (UniqueName: \"kubernetes.io/projected/a6bed2d6-559a-4035-8f86-6c2e7f3a553c-kube-api-access-qzlp8\") pod \"servicemesh-operator3-55f49c5f94-flwnl\" (UID: \"a6bed2d6-559a-4035-8f86-6c2e7f3a553c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:44.932643 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:44.932611    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:45.080055 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:45.080026    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"]
May 28 17:22:45.082167 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:45.082139    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bed2d6_559a_4035_8f86_6c2e7f3a553c.slice/crio-27f9c35cb2e91a94d375e816b7e88ff964807526ecfa9428fcff0749a8f98853 WatchSource:0}: Error finding container 27f9c35cb2e91a94d375e816b7e88ff964807526ecfa9428fcff0749a8f98853: Status 404 returned error can't find the container with id 27f9c35cb2e91a94d375e816b7e88ff964807526ecfa9428fcff0749a8f98853
May 28 17:22:45.683093 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:45.683009    2566 generic.go:358] "Generic (PLEG): container finished" podID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerID="812a6d3ccf8ab83dd6f443083eb4e7f412990616ae38e290b29c716f38c99590" exitCode=0
May 28 17:22:45.683537 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:45.683100    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj" event={"ID":"7fc7e656-608a-4b6b-b918-ca1d85a95dcf","Type":"ContainerDied","Data":"812a6d3ccf8ab83dd6f443083eb4e7f412990616ae38e290b29c716f38c99590"}
May 28 17:22:45.684386 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:45.684333    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl" event={"ID":"a6bed2d6-559a-4035-8f86-6c2e7f3a553c","Type":"ContainerStarted","Data":"27f9c35cb2e91a94d375e816b7e88ff964807526ecfa9428fcff0749a8f98853"}
May 28 17:22:46.689772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:46.689733    2566 generic.go:358] "Generic (PLEG): container finished" podID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerID="7fa8796dc93c0530d688bdab3dbb34a3d4f3ea758fb49730fda651e0d83738a8" exitCode=0
May 28 17:22:46.690196 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:46.689796    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj" event={"ID":"7fc7e656-608a-4b6b-b918-ca1d85a95dcf","Type":"ContainerDied","Data":"7fa8796dc93c0530d688bdab3dbb34a3d4f3ea758fb49730fda651e0d83738a8"}
May 28 17:22:47.829231 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:47.829210    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:48.018645 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.018610    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle\") pod \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") "
May 28 17:22:48.018808 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.018686    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sstvk\" (UniqueName: \"kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk\") pod \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") "
May 28 17:22:48.018808 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.018714    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util\") pod \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\" (UID: \"7fc7e656-608a-4b6b-b918-ca1d85a95dcf\") "
May 28 17:22:48.019772 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.019739    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle" (OuterVolumeSpecName: "bundle") pod "7fc7e656-608a-4b6b-b918-ca1d85a95dcf" (UID: "7fc7e656-608a-4b6b-b918-ca1d85a95dcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:48.022853 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.022808    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk" (OuterVolumeSpecName: "kube-api-access-sstvk") pod "7fc7e656-608a-4b6b-b918-ca1d85a95dcf" (UID: "7fc7e656-608a-4b6b-b918-ca1d85a95dcf"). InnerVolumeSpecName "kube-api-access-sstvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:22:48.026190 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.026159    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util" (OuterVolumeSpecName: "util") pod "7fc7e656-608a-4b6b-b918-ca1d85a95dcf" (UID: "7fc7e656-608a-4b6b-b918-ca1d85a95dcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:22:48.120050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.120008    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:48.120050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.120054    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:48.120256 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.120072    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sstvk\" (UniqueName: \"kubernetes.io/projected/7fc7e656-608a-4b6b-b918-ca1d85a95dcf-kube-api-access-sstvk\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:22:48.699066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.699023    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl" event={"ID":"a6bed2d6-559a-4035-8f86-6c2e7f3a553c","Type":"ContainerStarted","Data":"76cc5498ed13b73fed433f8460dd49aa40d446473c4e8da1f782162c9803a704"}
May 28 17:22:48.699066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.699074    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:48.700639 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.700614    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj" event={"ID":"7fc7e656-608a-4b6b-b918-ca1d85a95dcf","Type":"ContainerDied","Data":"14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32"}
May 28 17:22:48.700771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.700643    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aznwrj"
May 28 17:22:48.700771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.700652    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14d90d23d8634dfb8f0dfae58174e4272482a0eb6a5066f1217729b447c85c32"
May 28 17:22:48.718708 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:48.718658    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl" podStartSLOduration=1.982512198 podStartE2EDuration="4.718640231s" podCreationTimestamp="2026-05-28 17:22:44 +0000 UTC" firstStartedPulling="2026-05-28 17:22:45.085185968 +0000 UTC m=+320.159279322" lastFinishedPulling="2026-05-28 17:22:47.821313995 +0000 UTC m=+322.895407355" observedRunningTime="2026-05-28 17:22:48.715429276 +0000 UTC m=+323.789522653" watchObservedRunningTime="2026-05-28 17:22:48.718640231 +0000 UTC m=+323.792733610"
May 28 17:22:50.662866 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:50.662831    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-9pjkz"
May 28 17:22:54.793117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793079    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"]
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793386    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="pull"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793398    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="pull"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793406    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="util"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793411    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="util"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793419    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="extract"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793424    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="extract"
May 28 17:22:54.793510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.793480    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="7fc7e656-608a-4b6b-b918-ca1d85a95dcf" containerName="extract"
May 28 17:22:54.799112 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.799091    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.801076 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.801054    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 17:22:54.801382 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.801335    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 17:22:54.801382 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.801369    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 17:22:54.801540 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.801370    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 17:22:54.801540 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.801458    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5hpgc\""
May 28 17:22:54.807048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.807026    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"]
May 28 17:22:54.873278 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f2f335-bdeb-4545-a68c-76f199b32df7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-829bw\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-kube-api-access-829bw\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.873465 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.873453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974527 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974494    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f2f335-bdeb-4545-a68c-76f199b32df7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974716 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974553    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974716 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974575    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974716 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974597    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974879 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974710    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974879 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974780    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-829bw\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-kube-api-access-829bw\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.974879 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.974810    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.975514 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.975377    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.976963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.976940    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f2f335-bdeb-4545-a68c-76f199b32df7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.977210 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.977191    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.977288 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.977209    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.977288 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.977237    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.981675 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.981655    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:54.982097 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:54.982075    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-829bw\" (UniqueName: \"kubernetes.io/projected/60f2f335-bdeb-4545-a68c-76f199b32df7-kube-api-access-829bw\") pod \"istiod-openshift-gateway-798958bb55-gbxxf\" (UID: \"60f2f335-bdeb-4545-a68c-76f199b32df7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:55.110149 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:55.110052    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:55.247889 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:55.247864    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"]
May 28 17:22:55.250848 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:22:55.250780    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f2f335_bdeb_4545_a68c_76f199b32df7.slice/crio-224f22166260a596717f417834d11032b0f8bdc674987568ed85cf2611adb342 WatchSource:0}: Error finding container 224f22166260a596717f417834d11032b0f8bdc674987568ed85cf2611adb342: Status 404 returned error can't find the container with id 224f22166260a596717f417834d11032b0f8bdc674987568ed85cf2611adb342
May 28 17:22:55.724868 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:55.724832    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf" event={"ID":"60f2f335-bdeb-4545-a68c-76f199b32df7","Type":"ContainerStarted","Data":"224f22166260a596717f417834d11032b0f8bdc674987568ed85cf2611adb342"}
May 28 17:22:57.750814 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:57.750770    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 17:22:57.751111 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:57.750856    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 17:22:58.737845 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:58.737802    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf" event={"ID":"60f2f335-bdeb-4545-a68c-76f199b32df7","Type":"ContainerStarted","Data":"43f4a7f6b49f5e284c99d8517378caac86c03066a7fb1bc016d5adc0ee56683c"}
May 28 17:22:58.738096 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:58.738070    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:22:58.739780 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:58.739755    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-gbxxf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 28 17:22:58.739871 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:58.739796    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf" podUID="60f2f335-bdeb-4545-a68c-76f199b32df7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 17:22:58.756749 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:58.756700    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf" podStartSLOduration=2.259129307 podStartE2EDuration="4.756684645s" podCreationTimestamp="2026-05-28 17:22:54 +0000 UTC" firstStartedPulling="2026-05-28 17:22:55.252930521 +0000 UTC m=+330.327023893" lastFinishedPulling="2026-05-28 17:22:57.750485862 +0000 UTC m=+332.824579231" observedRunningTime="2026-05-28 17:22:58.75378021 +0000 UTC m=+333.827873587" watchObservedRunningTime="2026-05-28 17:22:58.756684645 +0000 UTC m=+333.830778021"
May 28 17:22:59.706404 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:59.706374    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-flwnl"
May 28 17:22:59.743543 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:22:59.743515    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gbxxf"
May 28 17:23:15.690242 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:15.690152    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-2c7j7"
May 28 17:23:31.099404 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.099365    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7796r"]
May 28 17:23:31.115061 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.115025    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7796r"]
May 28 17:23:31.115230 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.115150    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:31.117502 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.117473    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 17:23:31.118142 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.118115    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 17:23:31.118261 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.118152    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qfsn9\""
May 28 17:23:31.301957 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.301923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvw4\" (UniqueName: \"kubernetes.io/projected/b2d58115-bc11-41d9-8ad2-ead8ca373b7a-kube-api-access-ftvw4\") pod \"kuadrant-operator-catalog-7796r\" (UID: \"b2d58115-bc11-41d9-8ad2-ead8ca373b7a\") " pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:31.402856 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.402759    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvw4\" (UniqueName: \"kubernetes.io/projected/b2d58115-bc11-41d9-8ad2-ead8ca373b7a-kube-api-access-ftvw4\") pod \"kuadrant-operator-catalog-7796r\" (UID: \"b2d58115-bc11-41d9-8ad2-ead8ca373b7a\") " pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:31.410521 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.410489    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvw4\" (UniqueName: \"kubernetes.io/projected/b2d58115-bc11-41d9-8ad2-ead8ca373b7a-kube-api-access-ftvw4\") pod \"kuadrant-operator-catalog-7796r\" (UID: \"b2d58115-bc11-41d9-8ad2-ead8ca373b7a\") " pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:31.425524 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.425493    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:31.548267 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.548198    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7796r"]
May 28 17:23:31.550655 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:31.550627    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d58115_bc11_41d9_8ad2_ead8ca373b7a.slice/crio-628f3a40ced7ce3380a57b027e5cda13a08623e75369f589d42764dbdbeba13b WatchSource:0}: Error finding container 628f3a40ced7ce3380a57b027e5cda13a08623e75369f589d42764dbdbeba13b: Status 404 returned error can't find the container with id 628f3a40ced7ce3380a57b027e5cda13a08623e75369f589d42764dbdbeba13b
May 28 17:23:31.849556 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:31.849516    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7796r" event={"ID":"b2d58115-bc11-41d9-8ad2-ead8ca373b7a","Type":"ContainerStarted","Data":"628f3a40ced7ce3380a57b027e5cda13a08623e75369f589d42764dbdbeba13b"}
May 28 17:23:33.858711 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:33.858623    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7796r" event={"ID":"b2d58115-bc11-41d9-8ad2-ead8ca373b7a","Type":"ContainerStarted","Data":"2883caad59bb0cb0dec68740f736d8567c4c3ccf62e25ac9e0c0de03925f22fc"}
May 28 17:23:33.871445 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:33.871151    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7796r" podStartSLOduration=0.858391248 podStartE2EDuration="2.871133918s" podCreationTimestamp="2026-05-28 17:23:31 +0000 UTC" firstStartedPulling="2026-05-28 17:23:31.551906238 +0000 UTC m=+366.625999609" lastFinishedPulling="2026-05-28 17:23:33.56464891 +0000 UTC m=+368.638742279" observedRunningTime="2026-05-28 17:23:33.871068904 +0000 UTC m=+368.945162291" watchObservedRunningTime="2026-05-28 17:23:33.871133918 +0000 UTC m=+368.945227297"
May 28 17:23:41.426261 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:41.426203    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:41.426776 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:41.426286    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:41.448322 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:41.448293    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:41.906304 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:41.906274    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7796r"
May 28 17:23:46.110265 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.110227    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"]
May 28 17:23:46.113639 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.113623    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.115413 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.115389    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b46pb\""
May 28 17:23:46.121076 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.121049    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"]
May 28 17:23:46.226759 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.226722    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.226928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.226778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zf9n\" (UniqueName: \"kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.226928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.226824    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.327323 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.327281    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.327513 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.327381    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.327513 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.327423    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zf9n\" (UniqueName: \"kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.327687 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.327668    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.327731 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.327693    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.335599 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.335571    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zf9n\" (UniqueName: \"kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.423500 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.423410    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:46.547487 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.547458    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"]
May 28 17:23:46.550760 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:46.550724    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d475ae_7a22_4947_9f43_4b333358dccc.slice/crio-d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c WatchSource:0}: Error finding container d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c: Status 404 returned error can't find the container with id d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c
May 28 17:23:46.708500 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.708427    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"]
May 28 17:23:46.711726 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.711711    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.718193 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.718168    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"]
May 28 17:23:46.731164 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.731136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.731295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.731215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksn7m\" (UniqueName: \"kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.731295 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.731241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.832130 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.832094    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksn7m\" (UniqueName: \"kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.832130 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.832133    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.832433 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.832158    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.832628 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.832604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.832666 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.832617    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.838997 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.838976    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksn7m\" (UniqueName: \"kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:46.906313 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.906270    2566 generic.go:358] "Generic (PLEG): container finished" podID="09d475ae-7a22-4947-9f43-4b333358dccc" containerID="514f85939a1bdecda79190028106e3d6a27b155f5a586445cd312af457879b25" exitCode=0
May 28 17:23:46.906491 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.906325    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz" event={"ID":"09d475ae-7a22-4947-9f43-4b333358dccc","Type":"ContainerDied","Data":"514f85939a1bdecda79190028106e3d6a27b155f5a586445cd312af457879b25"}
May 28 17:23:46.906491 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:46.906381    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz" event={"ID":"09d475ae-7a22-4947-9f43-4b333358dccc","Type":"ContainerStarted","Data":"d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c"}
May 28 17:23:47.028132 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.028104    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:47.149491 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.149466    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"]
May 28 17:23:47.151264 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:47.151233    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47df50c_f822_4cc5_98e8_3b4726023766.slice/crio-38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823 WatchSource:0}: Error finding container 38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823: Status 404 returned error can't find the container with id 38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823
May 28 17:23:47.307167 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.307091    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"]
May 28 17:23:47.310631 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.310612    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.317517 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.317489    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"]
May 28 17:23:47.337161 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.337129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq92h\" (UniqueName: \"kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.337329 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.337203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.337329 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.337223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.438211 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.438171    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.438410 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.438230    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.438410 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.438279    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq92h\" (UniqueName: \"kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.438725 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.438701    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.438725 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.438717    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.445461 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.445431    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq92h\" (UniqueName: \"kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.622088 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.622015    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:47.714268 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.713903    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"]
May 28 17:23:47.717996 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.717976    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.724493 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.724467    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"]
May 28 17:23:47.741522 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.741491    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.741682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.741532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8pq\" (UniqueName: \"kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.741682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.741669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.797457 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.797419    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"]
May 28 17:23:47.799466 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:47.799434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19ce163_d101_45b3_a01a_0eecfa48f036.slice/crio-b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933 WatchSource:0}: Error finding container b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933: Status 404 returned error can't find the container with id b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933
May 28 17:23:47.842498 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.842461    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.842661 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.842521    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.842661 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.842540    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8pq\" (UniqueName: \"kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.842859 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.842829    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.842899 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.842882    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.849715 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.849689    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8pq\" (UniqueName: \"kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:47.910901 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.910868    2566 generic.go:358] "Generic (PLEG): container finished" podID="09d475ae-7a22-4947-9f43-4b333358dccc" containerID="e30523e1cc6b0e195a60e73ed733ab329473cc71d5a11d310772c658447bcf9c" exitCode=0
May 28 17:23:47.911023 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.910952    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz" event={"ID":"09d475ae-7a22-4947-9f43-4b333358dccc","Type":"ContainerDied","Data":"e30523e1cc6b0e195a60e73ed733ab329473cc71d5a11d310772c658447bcf9c"}
May 28 17:23:47.912322 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.912288    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerStarted","Data":"17fbf6f27aadd49c9c8af2fe512f76d2fb54bf92ad3ef788017413962366b92e"}
May 28 17:23:47.912441 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.912325    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerStarted","Data":"b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933"}
May 28 17:23:47.913695 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.913675    2566 generic.go:358] "Generic (PLEG): container finished" podID="b47df50c-f822-4cc5-98e8-3b4726023766" containerID="c77701462ff2eaa5574f0453b5a2590c0be93df40157690b5314103b8efd10d7" exitCode=0
May 28 17:23:47.913790 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.913727    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd" event={"ID":"b47df50c-f822-4cc5-98e8-3b4726023766","Type":"ContainerDied","Data":"c77701462ff2eaa5574f0453b5a2590c0be93df40157690b5314103b8efd10d7"}
May 28 17:23:47.913790 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:47.913745    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd" event={"ID":"b47df50c-f822-4cc5-98e8-3b4726023766","Type":"ContainerStarted","Data":"38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823"}
May 28 17:23:48.055672 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.055643    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:48.180070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.180044    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"]
May 28 17:23:48.180822 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:48.180797    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2034537_906d_4a15_957a_89e8a803ad0a.slice/crio-8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4 WatchSource:0}: Error finding container 8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4: Status 404 returned error can't find the container with id 8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4
May 28 17:23:48.921939 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.921854    2566 generic.go:358] "Generic (PLEG): container finished" podID="09d475ae-7a22-4947-9f43-4b333358dccc" containerID="35b99f031f40421a7c0b4ec9897af2cc584dca369509616396587b158f373ed8" exitCode=0
May 28 17:23:48.922254 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.921938    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz" event={"ID":"09d475ae-7a22-4947-9f43-4b333358dccc","Type":"ContainerDied","Data":"35b99f031f40421a7c0b4ec9897af2cc584dca369509616396587b158f373ed8"}
May 28 17:23:48.923186 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.923164    2566 generic.go:358] "Generic (PLEG): container finished" podID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerID="17fbf6f27aadd49c9c8af2fe512f76d2fb54bf92ad3ef788017413962366b92e" exitCode=0
May 28 17:23:48.923286 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.923227    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerDied","Data":"17fbf6f27aadd49c9c8af2fe512f76d2fb54bf92ad3ef788017413962366b92e"}
May 28 17:23:48.924804 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.924780    2566 generic.go:358] "Generic (PLEG): container finished" podID="b47df50c-f822-4cc5-98e8-3b4726023766" containerID="0cf00fba02be26a2574acc6bc0d8eb368746f55f921c154f0f5f3c74e6f2afe0" exitCode=0
May 28 17:23:48.924896 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.924859    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd" event={"ID":"b47df50c-f822-4cc5-98e8-3b4726023766","Type":"ContainerDied","Data":"0cf00fba02be26a2574acc6bc0d8eb368746f55f921c154f0f5f3c74e6f2afe0"}
May 28 17:23:48.926237 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.926216    2566 generic.go:358] "Generic (PLEG): container finished" podID="c2034537-906d-4a15-957a-89e8a803ad0a" containerID="fa573a0620d0002cf423a401bde9495859e028aa9f474bde0b46443db6ea5a65" exitCode=0
May 28 17:23:48.926326 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.926288    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db" event={"ID":"c2034537-906d-4a15-957a-89e8a803ad0a","Type":"ContainerDied","Data":"fa573a0620d0002cf423a401bde9495859e028aa9f474bde0b46443db6ea5a65"}
May 28 17:23:48.926396 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:48.926323    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db" event={"ID":"c2034537-906d-4a15-957a-89e8a803ad0a","Type":"ContainerStarted","Data":"8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4"}
May 28 17:23:49.931802 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.931718    2566 generic.go:358] "Generic (PLEG): container finished" podID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerID="f4ed124bf78f9f6e3a40d93e690f1f2d040c1e403dbe4e5c5bd340321e77cf5f" exitCode=0
May 28 17:23:49.932219 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.931800    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerDied","Data":"f4ed124bf78f9f6e3a40d93e690f1f2d040c1e403dbe4e5c5bd340321e77cf5f"}
May 28 17:23:49.933796 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.933775    2566 generic.go:358] "Generic (PLEG): container finished" podID="b47df50c-f822-4cc5-98e8-3b4726023766" containerID="00812d31219b20d07893bfe5135ff106b02054b59ec180db1a53e59069bed15d" exitCode=0
May 28 17:23:49.933889 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.933839    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd" event={"ID":"b47df50c-f822-4cc5-98e8-3b4726023766","Type":"ContainerDied","Data":"00812d31219b20d07893bfe5135ff106b02054b59ec180db1a53e59069bed15d"}
May 28 17:23:49.935457 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.935435    2566 generic.go:358] "Generic (PLEG): container finished" podID="c2034537-906d-4a15-957a-89e8a803ad0a" containerID="1ef1588ffe0f11709bd84e0a3e64d313293272424137f59d939de76d9fddbb65" exitCode=0
May 28 17:23:49.935529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:49.935467    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db" event={"ID":"c2034537-906d-4a15-957a-89e8a803ad0a","Type":"ContainerDied","Data":"1ef1588ffe0f11709bd84e0a3e64d313293272424137f59d939de76d9fddbb65"}
May 28 17:23:50.057057 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.056979    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:50.161322 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.161287    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle\") pod \"09d475ae-7a22-4947-9f43-4b333358dccc\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") "
May 28 17:23:50.161468 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.161362    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zf9n\" (UniqueName: \"kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n\") pod \"09d475ae-7a22-4947-9f43-4b333358dccc\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") "
May 28 17:23:50.161468 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.161406    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util\") pod \"09d475ae-7a22-4947-9f43-4b333358dccc\" (UID: \"09d475ae-7a22-4947-9f43-4b333358dccc\") "
May 28 17:23:50.161812 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.161787    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle" (OuterVolumeSpecName: "bundle") pod "09d475ae-7a22-4947-9f43-4b333358dccc" (UID: "09d475ae-7a22-4947-9f43-4b333358dccc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:50.163559 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.163538    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n" (OuterVolumeSpecName: "kube-api-access-7zf9n") pod "09d475ae-7a22-4947-9f43-4b333358dccc" (UID: "09d475ae-7a22-4947-9f43-4b333358dccc"). InnerVolumeSpecName "kube-api-access-7zf9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:23:50.166372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.166320    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util" (OuterVolumeSpecName: "util") pod "09d475ae-7a22-4947-9f43-4b333358dccc" (UID: "09d475ae-7a22-4947-9f43-4b333358dccc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:50.262144 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.262111    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zf9n\" (UniqueName: \"kubernetes.io/projected/09d475ae-7a22-4947-9f43-4b333358dccc-kube-api-access-7zf9n\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:50.262144 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.262143    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:50.262316 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.262155    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d475ae-7a22-4947-9f43-4b333358dccc-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:50.941184 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.941094    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz" event={"ID":"09d475ae-7a22-4947-9f43-4b333358dccc","Type":"ContainerDied","Data":"d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c"}
May 28 17:23:50.941184 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.941132    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8214bd6584d9822708883cb0e2a90949f4c23865d133a8397babc32091d064c"
May 28 17:23:50.941184 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.941151    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz"
May 28 17:23:50.943011 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.942983    2566 generic.go:358] "Generic (PLEG): container finished" podID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerID="c4e331fd2ea472f7af8390aed8435d7b8f4e4553579cb2dee610af967a5e6ee3" exitCode=0
May 28 17:23:50.943147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.943067    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerDied","Data":"c4e331fd2ea472f7af8390aed8435d7b8f4e4553579cb2dee610af967a5e6ee3"}
May 28 17:23:50.944840 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.944820    2566 generic.go:358] "Generic (PLEG): container finished" podID="c2034537-906d-4a15-957a-89e8a803ad0a" containerID="10461ee07c5584af1b2ffba1ab5a90e417d0f1aaa1209d64922fb42e47e6b14b" exitCode=0
May 28 17:23:50.944938 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:50.944902    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db" event={"ID":"c2034537-906d-4a15-957a-89e8a803ad0a","Type":"ContainerDied","Data":"10461ee07c5584af1b2ffba1ab5a90e417d0f1aaa1209d64922fb42e47e6b14b"}
May 28 17:23:51.074992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.074967    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:51.168592 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.168557    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksn7m\" (UniqueName: \"kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m\") pod \"b47df50c-f822-4cc5-98e8-3b4726023766\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") "
May 28 17:23:51.168771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.168610    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util\") pod \"b47df50c-f822-4cc5-98e8-3b4726023766\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") "
May 28 17:23:51.168771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.168671    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle\") pod \"b47df50c-f822-4cc5-98e8-3b4726023766\" (UID: \"b47df50c-f822-4cc5-98e8-3b4726023766\") "
May 28 17:23:51.169196 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.169162    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle" (OuterVolumeSpecName: "bundle") pod "b47df50c-f822-4cc5-98e8-3b4726023766" (UID: "b47df50c-f822-4cc5-98e8-3b4726023766"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:51.170675 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.170642    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m" (OuterVolumeSpecName: "kube-api-access-ksn7m") pod "b47df50c-f822-4cc5-98e8-3b4726023766" (UID: "b47df50c-f822-4cc5-98e8-3b4726023766"). InnerVolumeSpecName "kube-api-access-ksn7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:23:51.174140 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.174120    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util" (OuterVolumeSpecName: "util") pod "b47df50c-f822-4cc5-98e8-3b4726023766" (UID: "b47df50c-f822-4cc5-98e8-3b4726023766"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:51.269768 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.269718    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:51.269768 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.269762    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47df50c-f822-4cc5-98e8-3b4726023766-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:51.269768 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.269773    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksn7m\" (UniqueName: \"kubernetes.io/projected/b47df50c-f822-4cc5-98e8-3b4726023766-kube-api-access-ksn7m\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:51.950746 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.950664    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd"
May 28 17:23:51.950746 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.950670    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd" event={"ID":"b47df50c-f822-4cc5-98e8-3b4726023766","Type":"ContainerDied","Data":"38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823"}
May 28 17:23:51.950746 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:51.950705    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38a3524f1a5b424a65f1cf62b61eb7e4e81ed15587d2ca69e11a00593be93823"
May 28 17:23:52.105066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.105045    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:52.108125 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.108106    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:52.176916 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.176886    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util\") pod \"f19ce163-d101-45b3-a01a-0eecfa48f036\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") "
May 28 17:23:52.177081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.176926    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq92h\" (UniqueName: \"kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h\") pod \"f19ce163-d101-45b3-a01a-0eecfa48f036\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") "
May 28 17:23:52.177081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177002    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle\") pod \"c2034537-906d-4a15-957a-89e8a803ad0a\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") "
May 28 17:23:52.177081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177020    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util\") pod \"c2034537-906d-4a15-957a-89e8a803ad0a\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") "
May 28 17:23:52.177081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177049    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8pq\" (UniqueName: \"kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq\") pod \"c2034537-906d-4a15-957a-89e8a803ad0a\" (UID: \"c2034537-906d-4a15-957a-89e8a803ad0a\") "
May 28 17:23:52.177304 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177110    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle\") pod \"f19ce163-d101-45b3-a01a-0eecfa48f036\" (UID: \"f19ce163-d101-45b3-a01a-0eecfa48f036\") "
May 28 17:23:52.177742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177678    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle" (OuterVolumeSpecName: "bundle") pod "f19ce163-d101-45b3-a01a-0eecfa48f036" (UID: "f19ce163-d101-45b3-a01a-0eecfa48f036"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:52.177834 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.177756    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle" (OuterVolumeSpecName: "bundle") pod "c2034537-906d-4a15-957a-89e8a803ad0a" (UID: "c2034537-906d-4a15-957a-89e8a803ad0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:52.179212 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.179191    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h" (OuterVolumeSpecName: "kube-api-access-zq92h") pod "f19ce163-d101-45b3-a01a-0eecfa48f036" (UID: "f19ce163-d101-45b3-a01a-0eecfa48f036"). InnerVolumeSpecName "kube-api-access-zq92h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:23:52.179316 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.179220    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq" (OuterVolumeSpecName: "kube-api-access-cg8pq") pod "c2034537-906d-4a15-957a-89e8a803ad0a" (UID: "c2034537-906d-4a15-957a-89e8a803ad0a"). InnerVolumeSpecName "kube-api-access-cg8pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:23:52.184038 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.183990    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util" (OuterVolumeSpecName: "util") pod "f19ce163-d101-45b3-a01a-0eecfa48f036" (UID: "f19ce163-d101-45b3-a01a-0eecfa48f036"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:52.185605 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.185581    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util" (OuterVolumeSpecName: "util") pod "c2034537-906d-4a15-957a-89e8a803ad0a" (UID: "c2034537-906d-4a15-957a-89e8a803ad0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:23:52.278334 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278301    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.278334 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278331    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19ce163-d101-45b3-a01a-0eecfa48f036-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.278547 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278364    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq92h\" (UniqueName: \"kubernetes.io/projected/f19ce163-d101-45b3-a01a-0eecfa48f036-kube-api-access-zq92h\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.278547 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278376    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.278547 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278385    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2034537-906d-4a15-957a-89e8a803ad0a-util\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.278547 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.278393    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8pq\" (UniqueName: \"kubernetes.io/projected/c2034537-906d-4a15-957a-89e8a803ad0a-kube-api-access-cg8pq\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:23:52.956591 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.956554    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj" event={"ID":"f19ce163-d101-45b3-a01a-0eecfa48f036","Type":"ContainerDied","Data":"b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933"}
May 28 17:23:52.956591 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.956589    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b269a7634d858225fdb3f1cf2e18c832107b6711c1386c26b873498250e933"
May 28 17:23:52.956591 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.956590    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj"
May 28 17:23:52.958269 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.958249    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db"
May 28 17:23:52.958397 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.958251    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db" event={"ID":"c2034537-906d-4a15-957a-89e8a803ad0a","Type":"ContainerDied","Data":"8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4"}
May 28 17:23:52.958397 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:52.958375    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a29b996588d56ae3f7d01da83d3f429a30128c84248da8db5640c4f81689ec4"
May 28 17:23:57.784369 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784320    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd7c94d75-9hg6p"]
May 28 17:23:57.784843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784795    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="extract"
May 28 17:23:57.784843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784819    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="extract"
May 28 17:23:57.784843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784837    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="extract"
May 28 17:23:57.784843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784844    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="extract"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784858    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784865    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784884    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784895    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784906    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784914    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784924    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784933    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784941    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784948    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="util"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784962    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784970    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784981    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="extract"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784989    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="extract"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.784996    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="extract"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785004    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="extract"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785014    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785022    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785031    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="pull"
May 28 17:23:57.785048 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785038    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="pull"
May 28 17:23:57.785924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785117    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="f19ce163-d101-45b3-a01a-0eecfa48f036" containerName="extract"
May 28 17:23:57.785924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785132    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2034537-906d-4a15-957a-89e8a803ad0a" containerName="extract"
May 28 17:23:57.785924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785143    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="09d475ae-7a22-4947-9f43-4b333358dccc" containerName="extract"
May 28 17:23:57.785924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.785154    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="b47df50c-f822-4cc5-98e8-3b4726023766" containerName="extract"
May 28 17:23:57.789754 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.789733    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.795280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.795255    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd7c94d75-9hg6p"]
May 28 17:23:57.928962 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.928923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25wxh\" (UniqueName: \"kubernetes.io/projected/654f5024-5a4e-4bce-a582-e1d915e22b38-kube-api-access-25wxh\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.928970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-service-ca\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.929001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-trusted-ca-bundle\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.929026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.929043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-oauth-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.929067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-console-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:57.929386 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:57.929186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-oauth-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.029806 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.029773    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-service-ca\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.029806 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.029813    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-trusted-ca-bundle\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030027 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.029837    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030076 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030047    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-oauth-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030129 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030115    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-console-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030218 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030191    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-oauth-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030382 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030258    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25wxh\" (UniqueName: \"kubernetes.io/projected/654f5024-5a4e-4bce-a582-e1d915e22b38-kube-api-access-25wxh\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030743 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030716    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-service-ca\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030836 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030801    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-trusted-ca-bundle\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030836 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030797    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-oauth-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.030946 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.030908    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654f5024-5a4e-4bce-a582-e1d915e22b38-console-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.032330 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.032305    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-serving-cert\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.032589 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.032570    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654f5024-5a4e-4bce-a582-e1d915e22b38-console-oauth-config\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.036803 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.036751    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25wxh\" (UniqueName: \"kubernetes.io/projected/654f5024-5a4e-4bce-a582-e1d915e22b38-kube-api-access-25wxh\") pod \"console-7bd7c94d75-9hg6p\" (UID: \"654f5024-5a4e-4bce-a582-e1d915e22b38\") " pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.100361 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.100319    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:23:58.227777 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.227747    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd7c94d75-9hg6p"]
May 28 17:23:58.228658 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:23:58.228636    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654f5024_5a4e_4bce_a582_e1d915e22b38.slice/crio-3b1e11505a7064087574d1487f4437e152a57aa2d2d9c5238f711b9411b9ec9a WatchSource:0}: Error finding container 3b1e11505a7064087574d1487f4437e152a57aa2d2d9c5238f711b9411b9ec9a: Status 404 returned error can't find the container with id 3b1e11505a7064087574d1487f4437e152a57aa2d2d9c5238f711b9411b9ec9a
May 28 17:23:58.981924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.981888    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7c94d75-9hg6p" event={"ID":"654f5024-5a4e-4bce-a582-e1d915e22b38","Type":"ContainerStarted","Data":"9261943a53478d8cbcb1985985fcc29ccaa25a4aead00e7ce80a3b74077a7193"}
May 28 17:23:58.981924 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.981928    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7c94d75-9hg6p" event={"ID":"654f5024-5a4e-4bce-a582-e1d915e22b38","Type":"ContainerStarted","Data":"3b1e11505a7064087574d1487f4437e152a57aa2d2d9c5238f711b9411b9ec9a"}
May 28 17:23:58.999993 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:23:58.999946    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bd7c94d75-9hg6p" podStartSLOduration=1.9999327770000002 podStartE2EDuration="1.999932777s" podCreationTimestamp="2026-05-28 17:23:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:23:58.997939735 +0000 UTC m=+394.072033111" watchObservedRunningTime="2026-05-28 17:23:58.999932777 +0000 UTC m=+394.074026153"
May 28 17:24:03.142133 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.142095    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ghxkj"]
May 28 17:24:03.145790 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.145767    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:03.147663 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.147638    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dxspg\""
May 28 17:24:03.153812 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.153785    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ghxkj"]
May 28 17:24:03.283723 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.283681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sljf\" (UniqueName: \"kubernetes.io/projected/dc27b570-1e2e-4e1f-934d-a5809391b47d-kube-api-access-4sljf\") pod \"authorino-operator-657f44b778-ghxkj\" (UID: \"dc27b570-1e2e-4e1f-934d-a5809391b47d\") " pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:03.384191 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.384153    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sljf\" (UniqueName: \"kubernetes.io/projected/dc27b570-1e2e-4e1f-934d-a5809391b47d-kube-api-access-4sljf\") pod \"authorino-operator-657f44b778-ghxkj\" (UID: \"dc27b570-1e2e-4e1f-934d-a5809391b47d\") " pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:03.397131 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.397077    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sljf\" (UniqueName: \"kubernetes.io/projected/dc27b570-1e2e-4e1f-934d-a5809391b47d-kube-api-access-4sljf\") pod \"authorino-operator-657f44b778-ghxkj\" (UID: \"dc27b570-1e2e-4e1f-934d-a5809391b47d\") " pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:03.457667 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.457626    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:03.598444 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:03.598418    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ghxkj"]
May 28 17:24:03.599980 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:24:03.599954    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc27b570_1e2e_4e1f_934d_a5809391b47d.slice/crio-054214142bb68e38933f9cc7a8293b9f48a4fdb213fec70fcb2974331aa3ea7a WatchSource:0}: Error finding container 054214142bb68e38933f9cc7a8293b9f48a4fdb213fec70fcb2974331aa3ea7a: Status 404 returned error can't find the container with id 054214142bb68e38933f9cc7a8293b9f48a4fdb213fec70fcb2974331aa3ea7a
May 28 17:24:04.001092 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:04.001051    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj" event={"ID":"dc27b570-1e2e-4e1f-934d-a5809391b47d","Type":"ContainerStarted","Data":"054214142bb68e38933f9cc7a8293b9f48a4fdb213fec70fcb2974331aa3ea7a"}
May 28 17:24:06.009897 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:06.009861    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj" event={"ID":"dc27b570-1e2e-4e1f-934d-a5809391b47d","Type":"ContainerStarted","Data":"57526edc1b54d82b50517235f3574d4ce8cd58b855e0bfc37bed7bbf25e5c4ef"}
May 28 17:24:06.010301 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:06.009917    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:06.027967 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:06.027862    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj" podStartSLOduration=0.858686009 podStartE2EDuration="3.027845275s" podCreationTimestamp="2026-05-28 17:24:03 +0000 UTC" firstStartedPulling="2026-05-28 17:24:03.601876758 +0000 UTC m=+398.675970112" lastFinishedPulling="2026-05-28 17:24:05.771036008 +0000 UTC m=+400.845129378" observedRunningTime="2026-05-28 17:24:06.025202349 +0000 UTC m=+401.099295719" watchObservedRunningTime="2026-05-28 17:24:06.027845275 +0000 UTC m=+401.101938652"
May 28 17:24:08.100931 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:08.100874    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:24:08.100931 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:08.100929    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:24:08.105774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:08.105748    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:24:09.030170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.030138    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd7c94d75-9hg6p"
May 28 17:24:09.089069 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.089032    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:24:09.218647 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.218612    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"]
May 28 17:24:09.226741 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.226713    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:09.228889 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.228846    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 17:24:09.229125 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.228872    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-94chd\""
May 28 17:24:09.230310 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.230284    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"]
May 28 17:24:09.341002 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.340910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqr6\" (UniqueName: \"kubernetes.io/projected/b1bc721a-e267-4d57-b381-9fd0832f7ba1-kube-api-access-gcqr6\") pod \"dns-operator-controller-manager-648d5c98bc-vkx92\" (UID: \"b1bc721a-e267-4d57-b381-9fd0832f7ba1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:09.442357 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.442319    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqr6\" (UniqueName: \"kubernetes.io/projected/b1bc721a-e267-4d57-b381-9fd0832f7ba1-kube-api-access-gcqr6\") pod \"dns-operator-controller-manager-648d5c98bc-vkx92\" (UID: \"b1bc721a-e267-4d57-b381-9fd0832f7ba1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:09.455753 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.455720    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqr6\" (UniqueName: \"kubernetes.io/projected/b1bc721a-e267-4d57-b381-9fd0832f7ba1-kube-api-access-gcqr6\") pod \"dns-operator-controller-manager-648d5c98bc-vkx92\" (UID: \"b1bc721a-e267-4d57-b381-9fd0832f7ba1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:09.538482 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.538448    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:09.679141 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:09.679114    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"]
May 28 17:24:09.680833 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:24:09.680805    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bc721a_e267_4d57_b381_9fd0832f7ba1.slice/crio-150ab4c3ed7ba8b0c84ea650c7a60545180a7c23c39450df5727bd0ba3a66be9 WatchSource:0}: Error finding container 150ab4c3ed7ba8b0c84ea650c7a60545180a7c23c39450df5727bd0ba3a66be9: Status 404 returned error can't find the container with id 150ab4c3ed7ba8b0c84ea650c7a60545180a7c23c39450df5727bd0ba3a66be9
May 28 17:24:10.031152 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:10.031118    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92" event={"ID":"b1bc721a-e267-4d57-b381-9fd0832f7ba1","Type":"ContainerStarted","Data":"150ab4c3ed7ba8b0c84ea650c7a60545180a7c23c39450df5727bd0ba3a66be9"}
May 28 17:24:12.040879 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:12.040830    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92" event={"ID":"b1bc721a-e267-4d57-b381-9fd0832f7ba1","Type":"ContainerStarted","Data":"108b10898f01e6c5884c6278c693b39916cf73a2967998303a9a86614483faae"}
May 28 17:24:12.041225 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:12.040917    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:12.063705 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:12.063661    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92" podStartSLOduration=0.81571891 podStartE2EDuration="3.063646514s" podCreationTimestamp="2026-05-28 17:24:09 +0000 UTC" firstStartedPulling="2026-05-28 17:24:09.682965378 +0000 UTC m=+404.757058746" lastFinishedPulling="2026-05-28 17:24:11.930892996 +0000 UTC m=+407.004986350" observedRunningTime="2026-05-28 17:24:12.061050033 +0000 UTC m=+407.135143425" watchObservedRunningTime="2026-05-28 17:24:12.063646514 +0000 UTC m=+407.137739890"
May 28 17:24:17.021101 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:17.021070    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-ghxkj"
May 28 17:24:23.046971 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:23.046943    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vkx92"
May 28 17:24:24.683205 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.683167    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"]
May 28 17:24:24.688217 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.688197    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.690805 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.690787    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vbr5z\""
May 28 17:24:24.700184 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.700156    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"]
May 28 17:24:24.768235 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.768202    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24pzn\" (UniqueName: \"kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.768414 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.768267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.869058 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.869020    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.869222 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.869071    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24pzn\" (UniqueName: \"kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.869438 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.869420    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.899089 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.896805    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24pzn\" (UniqueName: \"kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:24.998296 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:24.998260    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:25.131053 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.131025    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"]
May 28 17:24:25.133551 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:24:25.133519    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67cc9f7_eed5_487b_9542_cc14f25490dc.slice/crio-dd9f95d7bf3e4d2e91368f34b04b59488c8240dad1409a71f813576fe85494dd WatchSource:0}: Error finding container dd9f95d7bf3e4d2e91368f34b04b59488c8240dad1409a71f813576fe85494dd: Status 404 returned error can't find the container with id dd9f95d7bf3e4d2e91368f34b04b59488c8240dad1409a71f813576fe85494dd
May 28 17:24:25.351896 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.351807    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"]
May 28 17:24:25.358907 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.358879    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"]
May 28 17:24:25.373441 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.373414    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:25.379312 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.379288    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.389557 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.389427    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:25.473106 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.473059    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.473320 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.473112    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sg6f\" (UniqueName: \"kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.574567 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.574526    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.574736 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.574619    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sg6f\" (UniqueName: \"kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.574984 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.574963    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.582529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.582502    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sg6f\" (UniqueName: \"kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.692883 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.692795    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:25.848246 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:25.848202    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:25.850296 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:24:25.850270    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c8557c_77d2_485e_b4e2_100399741e91.slice/crio-26e77b91e680b3b8878ac273fc082e6d543478987bb713f7f8cdc59c27a0c865 WatchSource:0}: Error finding container 26e77b91e680b3b8878ac273fc082e6d543478987bb713f7f8cdc59c27a0c865: Status 404 returned error can't find the container with id 26e77b91e680b3b8878ac273fc082e6d543478987bb713f7f8cdc59c27a0c865
May 28 17:24:26.098171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:26.098121    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" event={"ID":"59c8557c-77d2-485e-b4e2-100399741e91","Type":"ContainerStarted","Data":"26e77b91e680b3b8878ac273fc082e6d543478987bb713f7f8cdc59c27a0c865"}
May 28 17:24:29.116927 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.116889    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" event={"ID":"59c8557c-77d2-485e-b4e2-100399741e91","Type":"ContainerStarted","Data":"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"}
May 28 17:24:29.117434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.117095    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:29.118261 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.118237    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" containerName="manager" containerID="cri-o://7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070" gracePeriod=2
May 28 17:24:29.134413 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.134337    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" podStartSLOduration=1.316842021 podStartE2EDuration="4.134323738s" podCreationTimestamp="2026-05-28 17:24:25 +0000 UTC" firstStartedPulling="2026-05-28 17:24:25.852760749 +0000 UTC m=+420.926854104" lastFinishedPulling="2026-05-28 17:24:28.670242463 +0000 UTC m=+423.744335821" observedRunningTime="2026-05-28 17:24:29.131429934 +0000 UTC m=+424.205523310" watchObservedRunningTime="2026-05-28 17:24:29.134323738 +0000 UTC m=+424.208417115"
May 28 17:24:29.354231 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.354199    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:29.355745 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.355716    2566 status_manager.go:895] "Failed to get status for pod" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" is forbidden: User \"system:node:ip-10-0-138-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-128.ec2.internal' and this object"
May 28 17:24:29.406277 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.406184    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24pzn\" (UniqueName: \"kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn\") pod \"e67cc9f7-eed5-487b-9542-cc14f25490dc\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") "
May 28 17:24:29.406277 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.406257    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume\") pod \"e67cc9f7-eed5-487b-9542-cc14f25490dc\" (UID: \"e67cc9f7-eed5-487b-9542-cc14f25490dc\") "
May 28 17:24:29.406563 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.406536    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e67cc9f7-eed5-487b-9542-cc14f25490dc" (UID: "e67cc9f7-eed5-487b-9542-cc14f25490dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:24:29.408289 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.408267    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn" (OuterVolumeSpecName: "kube-api-access-24pzn") pod "e67cc9f7-eed5-487b-9542-cc14f25490dc" (UID: "e67cc9f7-eed5-487b-9542-cc14f25490dc"). InnerVolumeSpecName "kube-api-access-24pzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:24:29.507507 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.507471    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24pzn\" (UniqueName: \"kubernetes.io/projected/e67cc9f7-eed5-487b-9542-cc14f25490dc-kube-api-access-24pzn\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:29.507507 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.507503    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e67cc9f7-eed5-487b-9542-cc14f25490dc-extensions-socket-volume\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:29.535983 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:29.535945    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" path="/var/lib/kubelet/pods/e67cc9f7-eed5-487b-9542-cc14f25490dc/volumes"
May 28 17:24:30.122752 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.122716    2566 generic.go:358] "Generic (PLEG): container finished" podID="e67cc9f7-eed5-487b-9542-cc14f25490dc" containerID="7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070" exitCode=2
May 28 17:24:30.123218 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.122773    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7"
May 28 17:24:30.123218 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.122818    2566 scope.go:117] "RemoveContainer" containerID="7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070"
May 28 17:24:30.126505 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.126465    2566 status_manager.go:895] "Failed to get status for pod" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4gbv7\" is forbidden: User \"system:node:ip-10-0-138-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-128.ec2.internal' and this object"
May 28 17:24:30.131374 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.131339    2566 scope.go:117] "RemoveContainer" containerID="7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070"
May 28 17:24:30.131650 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:24:30.131627    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070\": container with ID starting with 7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070 not found: ID does not exist" containerID="7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070"
May 28 17:24:30.131715 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:30.131663    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070"} err="failed to get container status \"7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070\": rpc error: code = NotFound desc = could not find container \"7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070\": container with ID starting with 7781188212c4b429b052eab17b728b9a2d92e9e4e29a2651e7fcec25b03f9070 not found: ID does not exist"
May 28 17:24:34.109186 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.109130    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86b766c6bf-85q98" podUID="46caf0f2-e2ec-4bed-8890-340e6b23191a" containerName="console" containerID="cri-o://bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8" gracePeriod=15
May 28 17:24:34.349636 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.349614    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86b766c6bf-85q98_46caf0f2-e2ec-4bed-8890-340e6b23191a/console/0.log"
May 28 17:24:34.349749 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.349674    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:24:34.448837 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448746    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.448837 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448804    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lv7b\" (UniqueName: \"kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448849    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448894    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448935    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.448965    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449260 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449107    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert\") pod \"46caf0f2-e2ec-4bed-8890-340e6b23191a\" (UID: \"46caf0f2-e2ec-4bed-8890-340e6b23191a\") "
May 28 17:24:34.449365 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449318    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:24:34.449421 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449334    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca" (OuterVolumeSpecName: "service-ca") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:24:34.449421 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449371    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:24:34.449570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449451    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-trusted-ca-bundle\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.449570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449462    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config" (OuterVolumeSpecName: "console-config") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:24:34.449570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449470    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-oauth-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.449570 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.449506    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-service-ca\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.451058 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.451038    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b" (OuterVolumeSpecName: "kube-api-access-9lv7b") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "kube-api-access-9lv7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:24:34.451145 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.451042    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:24:34.451145 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.451081    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46caf0f2-e2ec-4bed-8890-340e6b23191a" (UID: "46caf0f2-e2ec-4bed-8890-340e6b23191a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:24:34.550832 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.550792    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-serving-cert\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.551024 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.550912    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lv7b\" (UniqueName: \"kubernetes.io/projected/46caf0f2-e2ec-4bed-8890-340e6b23191a-kube-api-access-9lv7b\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.551073 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.551036    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-oauth-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:34.551073 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:34.551058    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46caf0f2-e2ec-4bed-8890-340e6b23191a-console-config\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:35.143759 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143731    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86b766c6bf-85q98_46caf0f2-e2ec-4bed-8890-340e6b23191a/console/0.log"
May 28 17:24:35.144171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143774    2566 generic.go:358] "Generic (PLEG): container finished" podID="46caf0f2-e2ec-4bed-8890-340e6b23191a" containerID="bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8" exitCode=2
May 28 17:24:35.144171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143846    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b766c6bf-85q98"
May 28 17:24:35.144171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143868    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b766c6bf-85q98" event={"ID":"46caf0f2-e2ec-4bed-8890-340e6b23191a","Type":"ContainerDied","Data":"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"}
May 28 17:24:35.144171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143909    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b766c6bf-85q98" event={"ID":"46caf0f2-e2ec-4bed-8890-340e6b23191a","Type":"ContainerDied","Data":"27597e167ec7368809c2236ea4d51aabcf1578c675bfd85852c8d1c66e122c14"}
May 28 17:24:35.144171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.143929    2566 scope.go:117] "RemoveContainer" containerID="bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"
May 28 17:24:35.152434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.152417    2566 scope.go:117] "RemoveContainer" containerID="bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"
May 28 17:24:35.152708 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:24:35.152687    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8\": container with ID starting with bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8 not found: ID does not exist" containerID="bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"
May 28 17:24:35.152776 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.152720    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8"} err="failed to get container status \"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8\": rpc error: code = NotFound desc = could not find container \"bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8\": container with ID starting with bd9dea89a9bc75c754c3e99260e6aa8d45ed9834095abc27d3607e6504147dc8 not found: ID does not exist"
May 28 17:24:35.166017 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.165976    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:24:35.168042 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.168014    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b766c6bf-85q98"]
May 28 17:24:35.535364 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:35.535318    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46caf0f2-e2ec-4bed-8890-340e6b23191a" path="/var/lib/kubelet/pods/46caf0f2-e2ec-4bed-8890-340e6b23191a/volumes"
May 28 17:24:40.125119 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:40.125089    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:53.786536 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:53.786457    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:53.786874 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:53.786692    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" podUID="59c8557c-77d2-485e-b4e2-100399741e91" containerName="manager" containerID="cri-o://31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20" gracePeriod=10
May 28 17:24:54.037682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.037627    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:54.112105 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.112068    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sg6f\" (UniqueName: \"kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f\") pod \"59c8557c-77d2-485e-b4e2-100399741e91\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") "
May 28 17:24:54.112292 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.112182    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume\") pod \"59c8557c-77d2-485e-b4e2-100399741e91\" (UID: \"59c8557c-77d2-485e-b4e2-100399741e91\") "
May 28 17:24:54.112670 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.112645    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59c8557c-77d2-485e-b4e2-100399741e91" (UID: "59c8557c-77d2-485e-b4e2-100399741e91"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:24:54.114123 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.114104    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f" (OuterVolumeSpecName: "kube-api-access-5sg6f") pod "59c8557c-77d2-485e-b4e2-100399741e91" (UID: "59c8557c-77d2-485e-b4e2-100399741e91"). InnerVolumeSpecName "kube-api-access-5sg6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:24:54.212712 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.212674    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59c8557c-77d2-485e-b4e2-100399741e91-extensions-socket-volume\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:54.212712 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.212704    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sg6f\" (UniqueName: \"kubernetes.io/projected/59c8557c-77d2-485e-b4e2-100399741e91-kube-api-access-5sg6f\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:24:54.219858 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.219825    2566 generic.go:358] "Generic (PLEG): container finished" podID="59c8557c-77d2-485e-b4e2-100399741e91" containerID="31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20" exitCode=0
May 28 17:24:54.219999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.219895    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"
May 28 17:24:54.219999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.219908    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" event={"ID":"59c8557c-77d2-485e-b4e2-100399741e91","Type":"ContainerDied","Data":"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"}
May 28 17:24:54.219999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.219945    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg" event={"ID":"59c8557c-77d2-485e-b4e2-100399741e91","Type":"ContainerDied","Data":"26e77b91e680b3b8878ac273fc082e6d543478987bb713f7f8cdc59c27a0c865"}
May 28 17:24:54.219999 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.219959    2566 scope.go:117] "RemoveContainer" containerID="31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"
May 28 17:24:54.228411 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.228392    2566 scope.go:117] "RemoveContainer" containerID="31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"
May 28 17:24:54.228689 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:24:54.228671    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20\": container with ID starting with 31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20 not found: ID does not exist" containerID="31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"
May 28 17:24:54.228739 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.228697    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20"} err="failed to get container status \"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20\": rpc error: code = NotFound desc = could not find container \"31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20\": container with ID starting with 31a804b675a0e7cae0fd4c49d5b2603e624bd5e8852615ecf6d351b187ddec20 not found: ID does not exist"
May 28 17:24:54.239555 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.239532    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:54.246608 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:54.246587    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zwhfg"]
May 28 17:24:55.535674 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:24:55.535641    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c8557c-77d2-485e-b4e2-100399741e91" path="/var/lib/kubelet/pods/59c8557c-77d2-485e-b4e2-100399741e91/volumes"
May 28 17:25:12.739828 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.739795    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740107    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46caf0f2-e2ec-4bed-8890-340e6b23191a" containerName="console"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740118    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46caf0f2-e2ec-4bed-8890-340e6b23191a" containerName="console"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740129    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c8557c-77d2-485e-b4e2-100399741e91" containerName="manager"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740134    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c8557c-77d2-485e-b4e2-100399741e91" containerName="manager"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740142    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" containerName="manager"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740147    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" containerName="manager"
May 28 17:25:12.740195 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740194    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="59c8557c-77d2-485e-b4e2-100399741e91" containerName="manager"
May 28 17:25:12.740434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740203    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="46caf0f2-e2ec-4bed-8890-340e6b23191a" containerName="console"
May 28 17:25:12.740434 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.740212    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e67cc9f7-eed5-487b-9542-cc14f25490dc" containerName="manager"
May 28 17:25:12.743236 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.743220    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.744963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.744940    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 17:25:12.745246 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.745059    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b46pb\""
May 28 17:25:12.749913 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.749889    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:12.838170 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.838141    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:12.873613 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.873586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.873785 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.873640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq2th\" (UniqueName: \"kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.974392 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.974356    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mq2th\" (UniqueName: \"kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.974576 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.974443    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.975133 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.975106    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:12.981724 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:12.981704    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq2th\" (UniqueName: \"kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th\") pod \"limitador-limitador-7d549b5b-vjx92\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:13.003663 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.003637    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:25:13.006292 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.006275    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.013563 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.013537    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:25:13.035648 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.035612    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:25:13.054047 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.054019    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:13.176894 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.176855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-config-file\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.177057 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.176979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7r9\" (UniqueName: \"kubernetes.io/projected/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-kube-api-access-ml7r9\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.187565 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.187538    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:13.189241 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:25:13.189214    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9214c40a_a090_463e_b5de_a2f8fff5e99f.slice/crio-e744d07451ca87467343cd793bbe10b3d3db2396346cad8712bfd4b8802cf6c0 WatchSource:0}: Error finding container e744d07451ca87467343cd793bbe10b3d3db2396346cad8712bfd4b8802cf6c0: Status 404 returned error can't find the container with id e744d07451ca87467343cd793bbe10b3d3db2396346cad8712bfd4b8802cf6c0
May 28 17:25:13.278289 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.278193    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7r9\" (UniqueName: \"kubernetes.io/projected/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-kube-api-access-ml7r9\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.278289 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.278249    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-config-file\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.278843 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.278821    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-config-file\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.285747 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.285715    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7r9\" (UniqueName: \"kubernetes.io/projected/ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c-kube-api-access-ml7r9\") pod \"limitador-limitador-78c99df468-5j6nm\" (UID: \"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c\") " pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.296910 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.296882    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" event={"ID":"9214c40a-a090-463e-b5de-a2f8fff5e99f","Type":"ContainerStarted","Data":"e744d07451ca87467343cd793bbe10b3d3db2396346cad8712bfd4b8802cf6c0"}
May 28 17:25:13.317200 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.317174    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:13.441144 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:13.441115    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:25:13.442594 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:25:13.442562    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3b9662_1c4a_47be_a6f1_c60ba9d0ac8c.slice/crio-3919e367a56bf8c3f926dd966182633df5ec605e95ef31a7044cdbf9e56f8e7a WatchSource:0}: Error finding container 3919e367a56bf8c3f926dd966182633df5ec605e95ef31a7044cdbf9e56f8e7a: Status 404 returned error can't find the container with id 3919e367a56bf8c3f926dd966182633df5ec605e95ef31a7044cdbf9e56f8e7a
May 28 17:25:14.307948 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:14.307902    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm" event={"ID":"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c","Type":"ContainerStarted","Data":"3919e367a56bf8c3f926dd966182633df5ec605e95ef31a7044cdbf9e56f8e7a"}
May 28 17:25:16.317829 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.317791    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm" event={"ID":"ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c","Type":"ContainerStarted","Data":"0cbfc87e365bf42aef90fbad134ee508e8057618645021ff509cfce75c9f9748"}
May 28 17:25:16.318303 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.317846    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:16.319122 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.319100    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" event={"ID":"9214c40a-a090-463e-b5de-a2f8fff5e99f","Type":"ContainerStarted","Data":"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"}
May 28 17:25:16.319233 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.319222    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:16.331210 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.331146    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm" podStartSLOduration=1.599297558 podStartE2EDuration="4.331130436s" podCreationTimestamp="2026-05-28 17:25:12 +0000 UTC" firstStartedPulling="2026-05-28 17:25:13.444262225 +0000 UTC m=+468.518355580" lastFinishedPulling="2026-05-28 17:25:16.176095098 +0000 UTC m=+471.250188458" observedRunningTime="2026-05-28 17:25:16.330562422 +0000 UTC m=+471.404655800" watchObservedRunningTime="2026-05-28 17:25:16.331130436 +0000 UTC m=+471.405223816"
May 28 17:25:16.344569 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:16.344526    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" podStartSLOduration=1.3669806310000001 podStartE2EDuration="4.344513544s" podCreationTimestamp="2026-05-28 17:25:12 +0000 UTC" firstStartedPulling="2026-05-28 17:25:13.191280238 +0000 UTC m=+468.265373598" lastFinishedPulling="2026-05-28 17:25:16.168813143 +0000 UTC m=+471.242906511" observedRunningTime="2026-05-28 17:25:16.343048955 +0000 UTC m=+471.417142343" watchObservedRunningTime="2026-05-28 17:25:16.344513544 +0000 UTC m=+471.418606920"
May 28 17:25:27.329885 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:27.329850    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5j6nm"
May 28 17:25:27.330381 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:27.330049    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:27.388708 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:27.388669    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:27.388906 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:27.388866    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" podUID="9214c40a-a090-463e-b5de-a2f8fff5e99f" containerName="limitador" containerID="cri-o://9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd" gracePeriod=30
May 28 17:25:27.937764 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:27.937741    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:28.001756 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.001725    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq2th\" (UniqueName: \"kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th\") pod \"9214c40a-a090-463e-b5de-a2f8fff5e99f\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") "
May 28 17:25:28.001915 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.001792    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file\") pod \"9214c40a-a090-463e-b5de-a2f8fff5e99f\" (UID: \"9214c40a-a090-463e-b5de-a2f8fff5e99f\") "
May 28 17:25:28.002145 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.002114    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file" (OuterVolumeSpecName: "config-file") pod "9214c40a-a090-463e-b5de-a2f8fff5e99f" (UID: "9214c40a-a090-463e-b5de-a2f8fff5e99f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:25:28.003771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.003753    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th" (OuterVolumeSpecName: "kube-api-access-mq2th") pod "9214c40a-a090-463e-b5de-a2f8fff5e99f" (UID: "9214c40a-a090-463e-b5de-a2f8fff5e99f"). InnerVolumeSpecName "kube-api-access-mq2th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:25:28.102240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.102198    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq2th\" (UniqueName: \"kubernetes.io/projected/9214c40a-a090-463e-b5de-a2f8fff5e99f-kube-api-access-mq2th\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:25:28.102240 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.102239    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9214c40a-a090-463e-b5de-a2f8fff5e99f-config-file\") on node \"ip-10-0-138-128.ec2.internal\" DevicePath \"\""
May 28 17:25:28.371243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.371151    2566 generic.go:358] "Generic (PLEG): container finished" podID="9214c40a-a090-463e-b5de-a2f8fff5e99f" containerID="9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd" exitCode=0
May 28 17:25:28.371243 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.371223    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92"
May 28 17:25:28.371706 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.371237    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" event={"ID":"9214c40a-a090-463e-b5de-a2f8fff5e99f","Type":"ContainerDied","Data":"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"}
May 28 17:25:28.371706 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.371279    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-vjx92" event={"ID":"9214c40a-a090-463e-b5de-a2f8fff5e99f","Type":"ContainerDied","Data":"e744d07451ca87467343cd793bbe10b3d3db2396346cad8712bfd4b8802cf6c0"}
May 28 17:25:28.371706 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.371295    2566 scope.go:117] "RemoveContainer" containerID="9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"
May 28 17:25:28.380505 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.380485    2566 scope.go:117] "RemoveContainer" containerID="9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"
May 28 17:25:28.380769 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:25:28.380753    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd\": container with ID starting with 9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd not found: ID does not exist" containerID="9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"
May 28 17:25:28.380813 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.380776    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd"} err="failed to get container status \"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd\": rpc error: code = NotFound desc = could not find container \"9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd\": container with ID starting with 9fcf36563a3eb374151e4aae28043de6156f59d842a9e071d49563c1a30d80cd not found: ID does not exist"
May 28 17:25:28.391656 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.391623    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:28.396650 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:28.396629    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-vjx92"]
May 28 17:25:29.535448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:25:29.535410    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9214c40a-a090-463e-b5de-a2f8fff5e99f" path="/var/lib/kubelet/pods/9214c40a-a090-463e-b5de-a2f8fff5e99f/volumes"
May 28 17:26:24.647399 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.647284    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7cbdb474bc-ktstf"]
May 28 17:26:24.647896 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.647787    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9214c40a-a090-463e-b5de-a2f8fff5e99f" containerName="limitador"
May 28 17:26:24.647896 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.647807    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9214c40a-a090-463e-b5de-a2f8fff5e99f" containerName="limitador"
May 28 17:26:24.648014 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.647912    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9214c40a-a090-463e-b5de-a2f8fff5e99f" containerName="limitador"
May 28 17:26:24.650720 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.650698    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:24.652206 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.652182    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 17:26:24.652206 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.652197    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrmxb\""
May 28 17:26:24.656013 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.655990    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cbdb474bc-ktstf"]
May 28 17:26:24.763702 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.763666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq57\" (UniqueName: \"kubernetes.io/projected/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-kube-api-access-pwq57\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:24.763888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.763720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:24.864229 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.864191    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:24.864446 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.864295    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq57\" (UniqueName: \"kubernetes.io/projected/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-kube-api-access-pwq57\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:24.864446 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:26:24.864355    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 28 17:26:24.864446 ip-10-0-138-128 kubenswrapper[2566]: E0528 17:26:24.864437    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls podName:14acb26a-28a0-4b24-82f9-6027dd1ec1c0 nodeName:}" failed. No retries permitted until 2026-05-28 17:26:25.364420231 +0000 UTC m=+540.438513585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls") pod "maas-api-7cbdb474bc-ktstf" (UID: "14acb26a-28a0-4b24-82f9-6027dd1ec1c0") : secret "maas-api-serving-cert" not found
May 28 17:26:24.872332 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:24.872299    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq57\" (UniqueName: \"kubernetes.io/projected/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-kube-api-access-pwq57\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:25.187326 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.187292    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:26:25.368742 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.368696    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:25.371043 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.371018    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14acb26a-28a0-4b24-82f9-6027dd1ec1c0-maas-api-tls\") pod \"maas-api-7cbdb474bc-ktstf\" (UID: \"14acb26a-28a0-4b24-82f9-6027dd1ec1c0\") " pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:25.564523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.564490    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrmxb\""
May 28 17:26:25.573245 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.573219    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:25.701376 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:25.701319    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cbdb474bc-ktstf"]
May 28 17:26:25.703493 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:26:25.703463    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14acb26a_28a0_4b24_82f9_6027dd1ec1c0.slice/crio-176b7bc8f2d500a0f3dae367c905c15ac2549800ae17fea0c77dd9278db2f880 WatchSource:0}: Error finding container 176b7bc8f2d500a0f3dae367c905c15ac2549800ae17fea0c77dd9278db2f880: Status 404 returned error can't find the container with id 176b7bc8f2d500a0f3dae367c905c15ac2549800ae17fea0c77dd9278db2f880
May 28 17:26:26.593377 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:26.593321    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cbdb474bc-ktstf" event={"ID":"14acb26a-28a0-4b24-82f9-6027dd1ec1c0","Type":"ContainerStarted","Data":"176b7bc8f2d500a0f3dae367c905c15ac2549800ae17fea0c77dd9278db2f880"}
May 28 17:26:28.603234 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:28.603194    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cbdb474bc-ktstf" event={"ID":"14acb26a-28a0-4b24-82f9-6027dd1ec1c0","Type":"ContainerStarted","Data":"69d7eaa0b4437c03202dc76e4858d3446e41e00219727b0be5486fa418a40f8d"}
May 28 17:26:28.603645 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:28.603319    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:28.617872 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:28.617818    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7cbdb474bc-ktstf" podStartSLOduration=2.243579538 podStartE2EDuration="4.617801869s" podCreationTimestamp="2026-05-28 17:26:24 +0000 UTC" firstStartedPulling="2026-05-28 17:26:25.704703853 +0000 UTC m=+540.778797208" lastFinishedPulling="2026-05-28 17:26:28.078926173 +0000 UTC m=+543.153019539" observedRunningTime="2026-05-28 17:26:28.616477039 +0000 UTC m=+543.690570429" watchObservedRunningTime="2026-05-28 17:26:28.617801869 +0000 UTC m=+543.691895245"
May 28 17:26:34.612462 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:34.612432    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7cbdb474bc-ktstf"
May 28 17:26:49.084127 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:26:49.084086    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:27:09.171529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.171485    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"]
May 28 17:27:09.176249 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.176229    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.178059 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.178038    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 17:27:09.178787 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.178622    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 17:27:09.178787 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.178695    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h8hpg\""
May 28 17:27:09.178787 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.178723    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 17:27:09.181915 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.181890    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"]
May 28 17:27:09.257806 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.257770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.257988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.257860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.257988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.257886    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5cx\" (UniqueName: \"kubernetes.io/projected/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kube-api-access-6b5cx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.257988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.257918    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.257988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.257941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.258238 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.258011    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.358730 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358693    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.358730 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358732    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359039 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358767    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359039 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358786    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5cx\" (UniqueName: \"kubernetes.io/projected/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kube-api-access-6b5cx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359039 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358809    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359039 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.358833    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359273 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.359151    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359273 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.359201    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.359273 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.359231    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.361681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.361656    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.362091 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.362068    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.370639 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.370609    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5cx\" (UniqueName: \"kubernetes.io/projected/50a9bacc-6e56-4cf9-8b2b-deef26abd2ac-kube-api-access-6b5cx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wh9bs\" (UID: \"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.487573 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.487481    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:09.624333 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.624303    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"]
May 28 17:27:09.626212 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:27:09.626175    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a9bacc_6e56_4cf9_8b2b_deef26abd2ac.slice/crio-e207ccf72f7c8cd6e746ba7d00b7809eccb4be67bac61dc84ec6ef7ed5fcbdd1 WatchSource:0}: Error finding container e207ccf72f7c8cd6e746ba7d00b7809eccb4be67bac61dc84ec6ef7ed5fcbdd1: Status 404 returned error can't find the container with id e207ccf72f7c8cd6e746ba7d00b7809eccb4be67bac61dc84ec6ef7ed5fcbdd1
May 28 17:27:09.772750 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.772711    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs" event={"ID":"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac","Type":"ContainerStarted","Data":"e207ccf72f7c8cd6e746ba7d00b7809eccb4be67bac61dc84ec6ef7ed5fcbdd1"}
May 28 17:27:09.876851 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.876815    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"]
May 28 17:27:09.880443 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.880420    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.882621 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.882599    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 17:27:09.891887 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.891864    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"]
May 28 17:27:09.963938 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.963884    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.964117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.963953    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.964117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.963994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.964117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.964021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d10d702-d95b-4d62-9224-ddb31d6175b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.964117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.964066    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8dt\" (UniqueName: \"kubernetes.io/projected/4d10d702-d95b-4d62-9224-ddb31d6175b1-kube-api-access-xs8dt\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:09.964117 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:09.964105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.065233 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.065108    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.065762 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.065738    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066513 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.065824    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066590 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.066554    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d10d702-d95b-4d62-9224-ddb31d6175b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066648 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.066622    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.066503    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.066622    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8dt\" (UniqueName: \"kubernetes.io/projected/4d10d702-d95b-4d62-9224-ddb31d6175b1-kube-api-access-xs8dt\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.066963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.066939    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.067605 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.067559    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.074454 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.069481    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d10d702-d95b-4d62-9224-ddb31d6175b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.075077 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.075032    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d10d702-d95b-4d62-9224-ddb31d6175b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.077283 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.077258    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8dt\" (UniqueName: \"kubernetes.io/projected/4d10d702-d95b-4d62-9224-ddb31d6175b1-kube-api-access-xs8dt\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd\" (UID: \"4d10d702-d95b-4d62-9224-ddb31d6175b1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.191726 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.191369    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:10.194830 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.194805    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:27:10.361050 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.361025    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"]
May 28 17:27:10.363523 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:27:10.363484    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d10d702_d95b_4d62_9224_ddb31d6175b1.slice/crio-35493fb612d1fb6918e8c00aa8927499f004854793bd6b4b86f0e47a95bd2952 WatchSource:0}: Error finding container 35493fb612d1fb6918e8c00aa8927499f004854793bd6b4b86f0e47a95bd2952: Status 404 returned error can't find the container with id 35493fb612d1fb6918e8c00aa8927499f004854793bd6b4b86f0e47a95bd2952
May 28 17:27:10.777970 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:10.777935    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd" event={"ID":"4d10d702-d95b-4d62-9224-ddb31d6175b1","Type":"ContainerStarted","Data":"35493fb612d1fb6918e8c00aa8927499f004854793bd6b4b86f0e47a95bd2952"}
May 28 17:27:13.479847 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:13.479810    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:27:15.807168 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:15.807131    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs" event={"ID":"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac","Type":"ContainerStarted","Data":"8baf7a3f14c4506351cbb4caea7a7bad2f534189327e4e63568898a93c7eb98b"}
May 28 17:27:15.808588 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:15.808561    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd" event={"ID":"4d10d702-d95b-4d62-9224-ddb31d6175b1","Type":"ContainerStarted","Data":"31a8c59414466d41df0f727548b2113811f9887ca42bd6842a81bfcb5d838312"}
May 28 17:27:20.830161 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:20.830126    2566 generic.go:358] "Generic (PLEG): container finished" podID="50a9bacc-6e56-4cf9-8b2b-deef26abd2ac" containerID="8baf7a3f14c4506351cbb4caea7a7bad2f534189327e4e63568898a93c7eb98b" exitCode=0
May 28 17:27:20.830709 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:20.830202    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs" event={"ID":"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac","Type":"ContainerDied","Data":"8baf7a3f14c4506351cbb4caea7a7bad2f534189327e4e63568898a93c7eb98b"}
May 28 17:27:20.832297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:20.831884    2566 generic.go:358] "Generic (PLEG): container finished" podID="4d10d702-d95b-4d62-9224-ddb31d6175b1" containerID="31a8c59414466d41df0f727548b2113811f9887ca42bd6842a81bfcb5d838312" exitCode=0
May 28 17:27:20.832297 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:20.831918    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd" event={"ID":"4d10d702-d95b-4d62-9224-ddb31d6175b1","Type":"ContainerDied","Data":"31a8c59414466d41df0f727548b2113811f9887ca42bd6842a81bfcb5d838312"}
May 28 17:27:22.847988 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.847952    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs" event={"ID":"50a9bacc-6e56-4cf9-8b2b-deef26abd2ac","Type":"ContainerStarted","Data":"e0ac67f9fed8baf2923b540d255d098c72741eb0a1d739a517063806c8250c2b"}
May 28 17:27:22.848435 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.848213    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:22.849593 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.849571    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd" event={"ID":"4d10d702-d95b-4d62-9224-ddb31d6175b1","Type":"ContainerStarted","Data":"247a448c5fb7978a5bf450f017383a68d460e6b1ad933add36fb4072e25dd37f"}
May 28 17:27:22.849781 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.849765    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:22.864392 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.864321    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs" podStartSLOduration=1.434002842 podStartE2EDuration="13.864307085s" podCreationTimestamp="2026-05-28 17:27:09 +0000 UTC" firstStartedPulling="2026-05-28 17:27:09.628368109 +0000 UTC m=+584.702461477" lastFinishedPulling="2026-05-28 17:27:22.058672362 +0000 UTC m=+597.132765720" observedRunningTime="2026-05-28 17:27:22.862454292 +0000 UTC m=+597.936547670" watchObservedRunningTime="2026-05-28 17:27:22.864307085 +0000 UTC m=+597.938400463"
May 28 17:27:22.878187 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:22.878117    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd" podStartSLOduration=2.190690574 podStartE2EDuration="13.878096061s" podCreationTimestamp="2026-05-28 17:27:09 +0000 UTC" firstStartedPulling="2026-05-28 17:27:10.365817814 +0000 UTC m=+585.439911169" lastFinishedPulling="2026-05-28 17:27:22.053223296 +0000 UTC m=+597.127316656" observedRunningTime="2026-05-28 17:27:22.876552941 +0000 UTC m=+597.950646319" watchObservedRunningTime="2026-05-28 17:27:22.878096061 +0000 UTC m=+597.952189440"
May 28 17:27:25.449861 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:25.449831    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:27:25.450444 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:25.450425    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:27:25.892324 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:25.892286    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:27:33.873147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:33.873116    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd"
May 28 17:27:33.879329 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:33.873978    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wh9bs"
May 28 17:27:44.883212 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:27:44.883114    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:28:38.892063 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:28:38.892023    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:28:43.485631 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:28:43.485592    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:28:49.889147 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:28:49.889107    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:29:00.687334 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:29:00.687294    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:29:09.143569 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:29:09.143529    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:29:20.081958 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:29:20.081862    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:29:29.177982 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:29:29.177942    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:29:39.382096 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:29:39.382064    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:30:13.877891 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:30:13.877853    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:30:18.682082 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:30:18.682046    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:30:53.787538 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:30:53.787456    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:31:08.980031 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:31:08.979992    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:31:47.085883 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:31:47.085845    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:32:04.177804 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:32:04.177765    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:32:18.182665 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:32:18.182586    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:32:25.482908 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:32:25.482882    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:32:25.484510 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:32:25.484489    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:32:34.380529 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:32:34.380492    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:33:30.780548 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:33:30.780512    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:33:40.383771 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:33:40.383736    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:33:56.789486 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:33:56.789397    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:34:05.590729 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:34:05.590684    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:34:22.288507 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:34:22.288463    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:34:30.591448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:34:30.591407    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:02.990899 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:02.990858    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:12.183310 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:12.183268    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:19.994485 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:19.994396    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:28.479015 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:28.478973    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:36.881863 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:36.881821    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:35:54.084862 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:35:54.084825    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:36:05.590729 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:36:05.590688    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:36:51.385207 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:36:51.385116    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:36:56.294280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:36:56.294228    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:04.389659 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:04.389620    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:13.582261 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:13.582212    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:22.888323 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:22.888284    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:25.512079 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:25.512047    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:37:25.515676 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:25.515655    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:37:31.586612 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:31.586573    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:39.286797 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:39.286760    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:44.584025 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:44.583982    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:48.696152 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:48.696113    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:37:56.685507 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:37:56.685468    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:04.885716 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:04.885671    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:14.383020 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:14.382980    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:23.605459 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:23.605378    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:32.879116 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:32.879075    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:40.987126 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:40.987085    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:49.388861 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:49.388821    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:38:58.283782 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:38:58.283742    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:39:07.288257 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:39:07.288219    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:39:15.683901 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:39:15.683861    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:41:12.898083 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.898048    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"]
May 28 17:41:12.901424 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.901407    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:12.904056 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.904033    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vbr5z\""
May 28 17:41:12.911081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.911056    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"]
May 28 17:41:12.912185 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.912159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697c169-0f3f-488d-b7f8-76fdd910cb86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:12.912266 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:12.912205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhmmc\" (UniqueName: \"kubernetes.io/projected/c697c169-0f3f-488d-b7f8-76fdd910cb86-kube-api-access-xhmmc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.013066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.013029    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697c169-0f3f-488d-b7f8-76fdd910cb86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.013066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.013069    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhmmc\" (UniqueName: \"kubernetes.io/projected/c697c169-0f3f-488d-b7f8-76fdd910cb86-kube-api-access-xhmmc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.013461 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.013439    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697c169-0f3f-488d-b7f8-76fdd910cb86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.021822 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.021801    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhmmc\" (UniqueName: \"kubernetes.io/projected/c697c169-0f3f-488d-b7f8-76fdd910cb86-kube-api-access-xhmmc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8bzt\" (UID: \"c697c169-0f3f-488d-b7f8-76fdd910cb86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.212738 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.212655    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:13.348042 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.348013    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"]
May 28 17:41:13.349959 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:41:13.349933    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc697c169_0f3f_488d_b7f8_76fdd910cb86.slice/crio-31cd1fe80701350f41fc31ff0188a655be755141effeab7653f17a6ebae30369 WatchSource:0}: Error finding container 31cd1fe80701350f41fc31ff0188a655be755141effeab7653f17a6ebae30369: Status 404 returned error can't find the container with id 31cd1fe80701350f41fc31ff0188a655be755141effeab7653f17a6ebae30369
May 28 17:41:13.352523 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:13.352504    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:41:14.072951 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:14.072909    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt" event={"ID":"c697c169-0f3f-488d-b7f8-76fdd910cb86","Type":"ContainerStarted","Data":"7fedd3a5b3f271f15dcfd351792dfa8239150b879dab837c09e4f6bde9c87c91"}
May 28 17:41:14.072951 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:14.072953    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt" event={"ID":"c697c169-0f3f-488d-b7f8-76fdd910cb86","Type":"ContainerStarted","Data":"31cd1fe80701350f41fc31ff0188a655be755141effeab7653f17a6ebae30369"}
May 28 17:41:14.073473 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:14.073041    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:14.091450 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:14.091405    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt" podStartSLOduration=2.09139089 podStartE2EDuration="2.09139089s" podCreationTimestamp="2026-05-28 17:41:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:41:14.089831744 +0000 UTC m=+1429.163925120" watchObservedRunningTime="2026-05-28 17:41:14.09139089 +0000 UTC m=+1429.165484266"
May 28 17:41:25.079191 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:25.079156    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8bzt"
May 28 17:41:32.687301 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:32.687262    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:41:37.785135 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:41:37.785092    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:04.184527 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:04.184488    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:11.390211 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:11.390172    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:19.582609 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:19.582568    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:25.545070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:25.545043    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:42:25.549149 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:25.549125    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:42:30.385733 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:30.385691    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:39.185136 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:39.185095    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:50.487067 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:50.486982    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:42:58.286264 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:42:58.286218    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:43:08.984647 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:43:08.984611    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:43:17.489280 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:43:17.489238    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:43:28.287215 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:43:28.287178    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:43:37.438965 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:43:37.438923    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:44:09.986064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:44:09.986023    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:44:53.493836 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:44:53.493801    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:01.291572 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:01.291531    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:10.282417 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:10.282380    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:18.594638 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:18.594598    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:27.892487 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:27.892444    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:40.983723 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:40.983684    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:48.985188 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:48.985102    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:45:55.986338 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:45:55.986299    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:05.291233 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:05.291191    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:13.488463 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:13.488423    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:22.383909 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:22.383872    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:33.183826 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:33.183791    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:50.885079 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:50.885041    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:46:58.987654 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:46:58.987615    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:08.486762 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:08.486728    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:15.681509 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:15.681423    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:25.576122 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:25.576088    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:47:25.582729 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:25.582709    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:47:32.895930 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:32.895897    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:41.181514 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:41.181470    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:50.287282 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:50.287243    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:47:58.381904 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:47:58.381865    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:48:07.584307 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:48:07.584266    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:48:16.083599 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:48:16.083558    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:48:25.289269 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:48:25.289234    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:48:38.781555 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:48:38.781501    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:48:47.488066 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:48:47.487976    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:00.888888 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:00.888851    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:10.084257 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:10.084212    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:18.082901 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:18.082860    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:27.188734 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:27.188691    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:35.187682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:35.187645    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:49:51.778520 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:49:51.778484    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:50:00.089960 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:50:00.089921    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:50:08.390873 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:50:08.390835    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:50:16.890705 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:50:16.890620    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:50:39.785632 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:50:39.785593    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:50:53.279997 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:50:53.279955    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5j6nm"]
May 28 17:51:01.428490 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:01.428458    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-2c7j7_ad6e2ded-622a-49e3-a269-c8e3078d845c/manager/0.log"
May 28 17:51:01.557077 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:01.557050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cbdb474bc-ktstf_14acb26a-28a0-4b24-82f9-6027dd1ec1c0/maas-api/0.log"
May 28 17:51:02.007615 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:02.007574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9pjkz_b254e869-ffbe-4990-9b78-1a569114057a/manager/1.log"
May 28 17:51:02.124000 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:02.123971    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bc6886474-md55t_82b80e89-7817-4b22-9f52-e1d3e3e97fea/manager/0.log"
May 28 17:51:03.259937 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.259912    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/util/0.log"
May 28 17:51:03.266564 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.266547    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/pull/0.log"
May 28 17:51:03.273108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.273081    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/extract/0.log"
May 28 17:51:03.381738 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.381709    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/util/0.log"
May 28 17:51:03.387302 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.387284    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/pull/0.log"
May 28 17:51:03.392460 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.392444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/extract/0.log"
May 28 17:51:03.507642 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.507575    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/extract/0.log"
May 28 17:51:03.513808 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.513761    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/util/0.log"
May 28 17:51:03.520328 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.520305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/pull/0.log"
May 28 17:51:03.645081 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.645051    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/util/0.log"
May 28 17:51:03.651917 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.651892    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/pull/0.log"
May 28 17:51:03.658550 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.658532    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/extract/0.log"
May 28 17:51:03.898029 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:03.897948    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ghxkj_dc27b570-1e2e-4e1f-934d-a5809391b47d/manager/0.log"
May 28 17:51:04.006774 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:04.006744    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vkx92_b1bc721a-e267-4d57-b381-9fd0832f7ba1/manager/0.log"
May 28 17:51:04.234482 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:04.234390    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7796r_b2d58115-bc11-41d9-8ad2-ead8ca373b7a/registry-server/0.log"
May 28 17:51:04.354166 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:04.354136    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-c8bzt_c697c169-0f3f-488d-b7f8-76fdd910cb86/manager/0.log"
May 28 17:51:04.475408 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:04.475378    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5j6nm_ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c/limitador/0.log"
May 28 17:51:05.048624 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:05.048592    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gbxxf_60f2f335-bdeb-4545-a68c-76f199b32df7/discovery/0.log"
May 28 17:51:05.258930 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:05.258898    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c878b64bb-jl45m_1e3aaa1e-ea15-433f-be22-ac0e5aaea53e/kube-auth-proxy/0.log"
May 28 17:51:05.948413 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:05.948382    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd_4d10d702-d95b-4d62-9224-ddb31d6175b1/storage-initializer/0.log"
May 28 17:51:05.955608 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:05.955585    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-dsvbd_4d10d702-d95b-4d62-9224-ddb31d6175b1/main/0.log"
May 28 17:51:06.183064 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:06.183030    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-wh9bs_50a9bacc-6e56-4cf9-8b2b-deef26abd2ac/storage-initializer/0.log"
May 28 17:51:06.189108 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:06.189075    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-wh9bs_50a9bacc-6e56-4cf9-8b2b-deef26abd2ac/main/0.log"
May 28 17:51:13.249179 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:13.249150    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bw65t_984c363b-2852-4e12-b879-c18aa50487d6/global-pull-secret-syncer/0.log"
May 28 17:51:13.425390 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:13.425327    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r8rtm_9ad79674-5349-4825-8218-5daf5f1e31dc/konnectivity-agent/0.log"
May 28 17:51:13.486383 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:13.486336    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-128.ec2.internal_2544b04d8b83fb05baa4b5e8cc4db64e/haproxy/0.log"
May 28 17:51:17.068681 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.068643    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/extract/0.log"
May 28 17:51:17.091310 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.091282    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/util/0.log"
May 28 17:51:17.116106 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.116082    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blmkj_f19ce163-d101-45b3-a01a-0eecfa48f036/pull/0.log"
May 28 17:51:17.143448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.143423    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/extract/0.log"
May 28 17:51:17.162012 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.161984    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/util/0.log"
May 28 17:51:17.183232 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.183204    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06ffxd_b47df50c-f822-4cc5-98e8-3b4726023766/pull/0.log"
May 28 17:51:17.204448 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.204425    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/extract/0.log"
May 28 17:51:17.224092 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.224061    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/util/0.log"
May 28 17:51:17.246963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.246936    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739p7db_c2034537-906d-4a15-957a-89e8a803ad0a/pull/0.log"
May 28 17:51:17.273624 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.273593    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/extract/0.log"
May 28 17:51:17.297568 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.297541    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/util/0.log"
May 28 17:51:17.319421 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.319329    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17d8jz_09d475ae-7a22-4947-9f43-4b333358dccc/pull/0.log"
May 28 17:51:17.660550 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.660473    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ghxkj_dc27b570-1e2e-4e1f-934d-a5809391b47d/manager/0.log"
May 28 17:51:17.685963 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.685923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vkx92_b1bc721a-e267-4d57-b381-9fd0832f7ba1/manager/0.log"
May 28 17:51:17.752080 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.752039    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7796r_b2d58115-bc11-41d9-8ad2-ead8ca373b7a/registry-server/0.log"
May 28 17:51:17.812372 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.812146    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-c8bzt_c697c169-0f3f-488d-b7f8-76fdd910cb86/manager/0.log"
May 28 17:51:17.833826 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:17.833796    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5j6nm_ef3b9662-1c4a-47be-a6f1-c60ba9d0ac8c/limitador/0.log"
May 28 17:51:19.654287 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:19.654244    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5ltq_ed319788-1913-408b-bcf0-7099ce8f7718/node-exporter/0.log"
May 28 17:51:19.672304 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:19.672276    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5ltq_ed319788-1913-408b-bcf0-7099ce8f7718/kube-rbac-proxy/0.log"
May 28 17:51:19.693608 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:19.693579    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5ltq_ed319788-1913-408b-bcf0-7099ce8f7718/init-textfile/0.log"
May 28 17:51:20.072432 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:20.072400    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-xjj58_97efe349-7f23-40cc-8fa3-3f7ca9ff6d7c/prometheus-operator-admission-webhook/0.log"
May 28 17:51:22.115177 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.115143    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"]
May 28 17:51:22.119576 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.119552    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.121480 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.121457    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjd62\"/\"kube-root-ca.crt\""
May 28 17:51:22.121609 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.121457    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjd62\"/\"default-dockercfg-q975s\""
May 28 17:51:22.121682 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.121622    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjd62\"/\"openshift-service-ca.crt\""
May 28 17:51:22.123731 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.123704    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"]
May 28 17:51:22.188975 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.188940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-lib-modules\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.189171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.188987    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-podres\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.189171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.189072    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-sys\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.189171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.189097    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxj8\" (UniqueName: \"kubernetes.io/projected/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-kube-api-access-srxj8\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.189171 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.189129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-proc\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290426 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290385    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-lib-modules\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290446    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-podres\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290510    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-sys\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290542    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srxj8\" (UniqueName: \"kubernetes.io/projected/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-kube-api-access-srxj8\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290584    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-proc\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290589    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-lib-modules\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290620 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290607    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-sys\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290839 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-podres\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.290839 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.290660    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-proc\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.297699 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.297680    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxj8\" (UniqueName: \"kubernetes.io/projected/3975cbe1-1f9b-4942-b681-5c96a69d9a2a-kube-api-access-srxj8\") pod \"perf-node-gather-daemonset-blrtz\" (UID: \"3975cbe1-1f9b-4942-b681-5c96a69d9a2a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.315159 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.315123    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd7c94d75-9hg6p_654f5024-5a4e-4bce-a582-e1d915e22b38/console/0.log"
May 28 17:51:22.430755 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.430666    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:22.563278 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.563250    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"]
May 28 17:51:22.564828 ip-10-0-138-128 kubenswrapper[2566]: W0528 17:51:22.564802    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3975cbe1_1f9b_4942_b681_5c96a69d9a2a.slice/crio-f49918312f328271793f1d22cfe3d4a1bd02b6c8319b38635a485504cc40b876 WatchSource:0}: Error finding container f49918312f328271793f1d22cfe3d4a1bd02b6c8319b38635a485504cc40b876: Status 404 returned error can't find the container with id f49918312f328271793f1d22cfe3d4a1bd02b6c8319b38635a485504cc40b876
May 28 17:51:22.566327 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:22.566306    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:51:23.489242 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.489198    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz" event={"ID":"3975cbe1-1f9b-4942-b681-5c96a69d9a2a","Type":"ContainerStarted","Data":"e503b78387b718abf192e7751c43c2d1262a8e1c5df940236c6d392c7d174260"}
May 28 17:51:23.489242 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.489240    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz" event={"ID":"3975cbe1-1f9b-4942-b681-5c96a69d9a2a","Type":"ContainerStarted","Data":"f49918312f328271793f1d22cfe3d4a1bd02b6c8319b38635a485504cc40b876"}
May 28 17:51:23.489701 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.489337    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:23.504223 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.504169    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz" podStartSLOduration=1.504155322 podStartE2EDuration="1.504155322s" podCreationTimestamp="2026-05-28 17:51:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:51:23.502265711 +0000 UTC m=+2038.576359065" watchObservedRunningTime="2026-05-28 17:51:23.504155322 +0000 UTC m=+2038.578248698"
May 28 17:51:23.588775 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.588749    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqmtt_792d6291-e90a-49c3-bb5f-cfa1212b70b5/dns/0.log"
May 28 17:51:23.606653 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.606629    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqmtt_792d6291-e90a-49c3-bb5f-cfa1212b70b5/kube-rbac-proxy/0.log"
May 28 17:51:23.723992 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:23.723963    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fb46x_e8753a0f-344d-4ff4-a7be-41985cef29aa/dns-node-resolver/0.log"
May 28 17:51:24.208947 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:24.208909    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f67b9fd9b-pw6cc_e9223010-421c-4685-92b9-7f6de5318dd8/registry/0.log"
May 28 17:51:24.246941 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:24.246905    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhqfw_82d34df2-3f34-44a8-8384-8de3380ff168/node-ca/0.log"
May 28 17:51:25.112674 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:25.112640    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gbxxf_60f2f335-bdeb-4545-a68c-76f199b32df7/discovery/0.log"
May 28 17:51:25.152438 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:25.152407    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c878b64bb-jl45m_1e3aaa1e-ea15-433f-be22-ac0e5aaea53e/kube-auth-proxy/0.log"
May 28 17:51:25.866714 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:25.866687    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmfbw_8761fc9d-66e1-404c-b253-bb77be4d93fa/serve-healthcheck-canary/0.log"
May 28 17:51:26.372899 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:26.372872    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tpt5_fc6ea918-d083-4d73-ae44-428bcfcac67e/kube-rbac-proxy/0.log"
May 28 17:51:26.391134 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:26.391102    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tpt5_fc6ea918-d083-4d73-ae44-428bcfcac67e/exporter/0.log"
May 28 17:51:26.411070 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:26.411046    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tpt5_fc6ea918-d083-4d73-ae44-428bcfcac67e/extractor/0.log"
May 28 17:51:28.241770 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:28.241737    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-2c7j7_ad6e2ded-622a-49e3-a269-c8e3078d845c/manager/0.log"
May 28 17:51:28.269625 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:28.269590    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cbdb474bc-ktstf_14acb26a-28a0-4b24-82f9-6027dd1ec1c0/maas-api/0.log"
May 28 17:51:28.441282 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:28.441252    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9pjkz_b254e869-ffbe-4990-9b78-1a569114057a/manager/0.log"
May 28 17:51:28.453600 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:28.453578    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9pjkz_b254e869-ffbe-4990-9b78-1a569114057a/manager/1.log"
May 28 17:51:28.472495 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:28.472464    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bc6886474-md55t_82b80e89-7817-4b22-9f52-e1d3e3e97fea/manager/0.log"
May 28 17:51:29.502861 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:29.502835    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-blrtz"
May 28 17:51:29.647496 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:29.647465    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-45ttj_2baae415-b937-455c-a36b-a0a3a9ffd229/openshift-lws-operator/0.log"
May 28 17:51:33.807738 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:33.807708    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-2cwpz_ef6ed60d-d4d9-4bad-ab97-8a20a10751f1/migrator/0.log"
May 28 17:51:33.825218 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:33.825186    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-2cwpz_ef6ed60d-d4d9-4bad-ab97-8a20a10751f1/graceful-termination/0.log"
May 28 17:51:35.323587 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.323559    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/kube-multus-additional-cni-plugins/0.log"
May 28 17:51:35.342509 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.342477    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/egress-router-binary-copy/0.log"
May 28 17:51:35.360269 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.360246    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/cni-plugins/0.log"
May 28 17:51:35.377232 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.377208    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/bond-cni-plugin/0.log"
May 28 17:51:35.395456 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.395417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/routeoverride-cni/0.log"
May 28 17:51:35.414728 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.414705    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/whereabouts-cni-bincopy/0.log"
May 28 17:51:35.432722 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.432696    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56974_37f40b18-1e03-49b9-be25-0bbea41ded20/whereabouts-cni/0.log"
May 28 17:51:35.596399 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.596281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kpvk8_a5a56189-5660-45b6-bb3b-415e4d04468e/kube-multus/0.log"
May 28 17:51:35.715182 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.715154    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t79nx_75c6beb6-f10a-4b8d-9928-c0ea7ee8a523/network-metrics-daemon/0.log"
May 28 17:51:35.732455 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:35.732429    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t79nx_75c6beb6-f10a-4b8d-9928-c0ea7ee8a523/kube-rbac-proxy/0.log"
May 28 17:51:36.504111 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.504080    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-controller/0.log"
May 28 17:51:36.518928 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.518901    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/0.log"
May 28 17:51:36.527664 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.527641    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovn-acl-logging/1.log"
May 28 17:51:36.543533 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.543510    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/kube-rbac-proxy-node/0.log"
May 28 17:51:36.562558 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.562526    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/kube-rbac-proxy-ovn-metrics/0.log"
May 28 17:51:36.580551 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.580518    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/northd/0.log"
May 28 17:51:36.597313 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.597283    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/nbdb/0.log"
May 28 17:51:36.614814 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.614790    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/sbdb/0.log"
May 28 17:51:36.718415 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:36.718380    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mq42g_6133c0a4-4772-45fb-b258-54d47720a54c/ovnkube-controller/0.log"
May 28 17:51:38.300104 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:38.300071    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gw7ps_51433d92-c37d-4282-985c-1543b2c88987/network-check-target-container/0.log"
May 28 17:51:39.261645 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:39.261617    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jwcgx_6cffb8bf-b894-4f0c-9b29-5ff297851e23/iptables-alerter/0.log"
May 28 17:51:39.955768 ip-10-0-138-128 kubenswrapper[2566]: I0528 17:51:39.955736    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-f4bbm_80ba09bc-13d4-437e-a0ca-3f3677cd91a1/tuned/0.log"