May 29 16:54:26.266484 ip-10-0-128-169 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 29 16:54:26.266497 ip-10-0-128-169 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 29 16:54:26.266508 ip-10-0-128-169 systemd[1]: kubelet.service: Failed with result 'resources'.
May 29 16:54:26.266765 ip-10-0-128-169 systemd[1]: Failed to start Kubernetes Kubelet.
May 29 16:54:36.428160 ip-10-0-128-169 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 29 16:54:36.428178 ip-10-0-128-169 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c245092090f2431389a7012e1d5c44d6 --
May 29 16:57:00.578122 ip-10-0-128-169 systemd[1]: Starting Kubernetes Kubelet...
May 29 16:57:01.087630 ip-10-0-128-169 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 16:57:01.087630 ip-10-0-128-169 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 16:57:01.087630 ip-10-0-128-169 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 16:57:01.087630 ip-10-0-128-169 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 16:57:01.087630 ip-10-0-128-169 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 16:57:01.088735 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.088612    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 16:57:01.092878 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092860    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 16:57:01.092878 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092875    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 16:57:01.092878 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092880    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092884    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092888    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092891    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092894    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092896    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092899    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092902    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092905    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092908    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092910    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092913    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092921    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092923    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092927    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092932    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092935    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092937    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092940    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092943    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 16:57:01.092979 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092945    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092948    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092951    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092954    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092956    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092959    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092962    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092964    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092967    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092969    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092972    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092974    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092977    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092979    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092983    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092986    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092989    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092992    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092995    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.092997    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 16:57:01.093462 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093000    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093002    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093005    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093007    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093009    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093012    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093014    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093016    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093020    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093022    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093025    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093028    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093030    2564 feature_gate.go:328] unrecognized feature gate: Example
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093033    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093036    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093038    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093041    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093043    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093047    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093049    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 16:57:01.094012 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093052    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093054    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093057    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093059    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093063    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093066    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093069    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093071    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093074    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093078    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093082    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093085    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093087    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093090    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093093    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093096    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093098    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093102    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093104    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 16:57:01.094505 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093107    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093110    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093112    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093115    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093117    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093500    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093505    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093507    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093510    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093513    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093515    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093518    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093521    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093524    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093527    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093529    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093532    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093535    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093537    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093540    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 16:57:01.094989 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093543    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093546    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093548    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093551    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093554    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093557    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093559    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093562    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093564    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093567    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093569    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093572    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093575    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093577    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093579    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093582    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093585    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093587    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093590    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093592    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 16:57:01.095456 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093595    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093597    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093600    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093603    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093606    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093608    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093611    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093613    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093616    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093618    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093621    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093624    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093627    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093629    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093632    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093634    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093637    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093640    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093642    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093644    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 16:57:01.095966 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093647    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093649    2564 feature_gate.go:328] unrecognized feature gate: Example
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093652    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093654    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093656    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093659    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093662    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093664    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093667    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093669    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093673    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093676    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093680    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093683    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093685    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093689    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093692    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093697    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093700    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 16:57:01.096448 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093703    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093706    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093708    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093711    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093714    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093717    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093720    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093722    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093725    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093727    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093730    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.093732    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094684    2564 flags.go:64] FLAG: --address="0.0.0.0"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094699    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094706    2564 flags.go:64] FLAG: --anonymous-auth="true"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094710    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094715    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094718    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094722    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094726    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094730    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 16:57:01.096920 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094733    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094736    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094739    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094743    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094746    2564 flags.go:64] FLAG: --cgroup-root=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094749    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094753    2564 flags.go:64] FLAG: --client-ca-file=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094756    2564 flags.go:64] FLAG: --cloud-config=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094758    2564 flags.go:64] FLAG: --cloud-provider="external"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094762    2564 flags.go:64] FLAG: --cluster-dns="[]"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094767    2564 flags.go:64] FLAG: --cluster-domain=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094770    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094773    2564 flags.go:64] FLAG: --config-dir=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094776    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094779    2564 flags.go:64] FLAG: --container-log-max-files="5"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094783    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094787    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094790    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094793    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094796    2564 flags.go:64] FLAG: --contention-profiling="false"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094799    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094802    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094805    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094808    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094831    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 16:57:01.097424 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094836    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094841    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094844    2564 flags.go:64] FLAG: --enable-load-reader="false"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094847    2564 flags.go:64] FLAG: --enable-server="true"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094850    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094854    2564 flags.go:64] FLAG: --event-burst="100"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094858    2564 flags.go:64] FLAG: --event-qps="50"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094861    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094864    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094867    2564 flags.go:64] FLAG: --eviction-hard=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094870    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094873    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094876    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094880    2564 flags.go:64] FLAG: --eviction-soft=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094883    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094886    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094889    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094892    2564 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094895    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094898    2564 flags.go:64] FLAG: --fail-swap-on="true"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094901    2564 flags.go:64] FLAG: --feature-gates=""
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094905    2564 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094908    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094911    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094915    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094918    2564 flags.go:64] FLAG: --healthz-port="10248"
May 29 16:57:01.098132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094922    2564 flags.go:64] FLAG: --help="false"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094925    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094928    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094931    2564 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094934    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094938    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094941    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094944    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094947    2564 flags.go:64] FLAG: --image-service-endpoint=""
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094950    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094953    2564 flags.go:64] FLAG: --kube-api-burst="100"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094955    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094959    2564 flags.go:64] FLAG: --kube-api-qps="50"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094961    2564 flags.go:64] FLAG: --kube-reserved=""
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094964    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094967    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094970    2564 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094973    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094976    2564 flags.go:64] FLAG: --lock-file=""
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094978    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094981    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094984    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094990    2564 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 16:57:01.098801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094994    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.094997    2564 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095000    2564 flags.go:64] FLAG: --logging-format="text"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095003    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095006    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095009    2564 flags.go:64] FLAG: --manifest-url=""
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095012    2564 flags.go:64] FLAG: --manifest-url-header=""
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095017    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095020    2564 flags.go:64] FLAG: --max-open-files="1000000"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095024    2564 flags.go:64] FLAG: --max-pods="110"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095027    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095030    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095033    2564 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095037    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095040    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095043    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095046    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095053    2564 flags.go:64] FLAG: --node-status-max-images="50"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095056    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095059    2564 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095062    2564 flags.go:64] FLAG: --pod-cidr=""
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095064    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095070    2564 flags.go:64] FLAG: --pod-manifest-path=""
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095073    2564 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 16:57:01.099379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095076    2564 flags.go:64] FLAG: --pods-per-core="0"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095080    2564 flags.go:64] FLAG: --port="10250"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095083    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095085    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a5c59668b762008"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095089    2564 flags.go:64] FLAG: --qos-reserved=""
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095091    2564 flags.go:64] FLAG: --read-only-port="10255"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095094    2564 flags.go:64] FLAG: --register-node="true"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095097    2564 flags.go:64] FLAG: --register-schedulable="true"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095100    2564 flags.go:64] FLAG: --register-with-taints=""
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095104    2564 flags.go:64] FLAG: --registry-burst="10"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095107    2564 flags.go:64] FLAG: --registry-qps="5"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095110    2564 flags.go:64] FLAG: --reserved-cpus=""
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095112    2564 flags.go:64] FLAG: --reserved-memory=""
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095116    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095119    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095122    2564 flags.go:64] FLAG: --rotate-certificates="false"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095125    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095128    2564 flags.go:64] FLAG: --runonce="false"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095131    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095134    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095137    2564 flags.go:64] FLAG: --seccomp-default="false"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095143    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095146    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095149    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095153    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095156    2564 flags.go:64] FLAG: --storage-driver-password="root"
May 29 16:57:01.099974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095159    2564 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095162    2564 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095165    2564 flags.go:64] FLAG: --storage-driver-user="root"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095168    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095171    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095173    2564 flags.go:64] FLAG: --system-cgroups=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095176    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095182    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095185    2564 flags.go:64] FLAG: --tls-cert-file=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095188    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095192    2564 flags.go:64] FLAG: --tls-min-version=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095195    2564 flags.go:64] FLAG: --tls-private-key-file=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095198    2564 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095201    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095206    2564 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095209    2564 flags.go:64] FLAG: --v="2"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095213    2564 flags.go:64] FLAG: --version="false"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095217    2564 flags.go:64] FLAG: --vmodule=""
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095221    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.095224    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096150    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096156    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096159    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096162    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 16:57:01.100593 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096165    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096168    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096171    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096176    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096180    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096183    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096186    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096189    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096192    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096195    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096198    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096200    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096203    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096206    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096210    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096214    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096217    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096220    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096223    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 16:57:01.101188 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096226    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096228    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096231    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096235    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096238    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096241    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096243    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096246    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096248    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096251    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096254    2564 feature_gate.go:328] unrecognized feature gate: Example
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096257    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096260    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096262    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096265    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096268    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096271    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096273    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096276    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096278    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 29 16:57:01.101686 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096281    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096283    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096286    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096288    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096291    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096293    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096296    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096298    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096300    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096303    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096305    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096308    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096311    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096314    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096316    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096320    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096323    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096325    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096328    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096330    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 16:57:01.102215 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096333    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096335    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096338    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096340    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096343    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096346    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096348    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096352    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096354    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096357    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096359    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096362    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096364    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096367    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096369    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096372    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096375    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096377    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096380    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 16:57:01.102754 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096382    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 16:57:01.103258 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096384    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 16:57:01.103258 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096387    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 16:57:01.103258 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.096390    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 16:57:01.103258 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.097100    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 16:57:01.106323 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.106296    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
May 29 16:57:01.106323 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.106319    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106371    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106377    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106380    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106383    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106387    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106389    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106393    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106396    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106398    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106401    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106404    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106406    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106409    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106412    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106414    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106418    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106420    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106423    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106427    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 16:57:01.106459 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106431    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106434    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106437    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106439    2564 feature_gate.go:328] unrecognized feature gate: Example
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106442    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106445    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106447    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106450    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106453    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106455    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106458    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106461    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106465    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106468    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106471    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106474    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106476    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106479    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106482    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 16:57:01.106982 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106484    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106487    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106489    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106492    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106495    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106497    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106500    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106502    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106505    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106508    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106510    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106513    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106515    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106518    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106521    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106523    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106526    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106529    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106532    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106534    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 16:57:01.107452 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106537    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106539    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106542    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106544    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106547    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106549    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106552    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106555    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106557    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106560    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106562    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106565    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106567    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106572    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106577    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106580    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106583    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106586    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106589    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 16:57:01.107975 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106591    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106594    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106596    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106599    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106602    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106604    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106606    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106609    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106612    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.106618    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106712    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106717    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106720    2564 feature_gate.go:328] unrecognized feature gate: Example
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106723    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106726    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106729    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 16:57:01.108439 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106731    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106734    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106737    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106739    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106742    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106746    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106750    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106753    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106756    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106758    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106761    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106764    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106766    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106769    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106771    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106774    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106777    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106779    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106782    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106784    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 16:57:01.108910 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106787    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106789    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106792    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106795    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106797    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106800    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106803    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106805    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106808    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106810    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106813    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106829    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106833    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106835    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106837    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106840    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106842    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106845    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106848    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106851    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 16:57:01.109406 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106853    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106856    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106859    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106862    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106864    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106867    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106869    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106872    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106874    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106877    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106879    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106883    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106886    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106889    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106892    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106895    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106898    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106901    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106903    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 16:57:01.109899 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106906    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106908    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106911    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106913    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106916    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106918    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106921    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106923    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106926    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106929    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106931    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106934    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106937    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106940    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106942    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106945    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106948    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106950    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106953    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106955    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 16:57:01.110395 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:01.106958    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 16:57:01.110948 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.106963    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 16:57:01.110948 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.107895    2564 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 16:57:01.110948 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.110327    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 16:57:01.111543 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.111529    2564 server.go:1019] "Starting client certificate rotation"
May 29 16:57:01.111651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.111635    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 16:57:01.111704 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.111687    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 16:57:01.139659 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.139636    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 16:57:01.145133 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.145103    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 16:57:01.158832 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.158803    2564 log.go:25] "Validated CRI v1 runtime API"
May 29 16:57:01.166862 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.166845    2564 log.go:25] "Validated CRI v1 image API"
May 29 16:57:01.169253 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.169238    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 16:57:01.171860 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.171839    2564 fs.go:135] Filesystem UUIDs: map[0748a002-a8f5-478a-a87a-4b2b6db4ef4c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e382491d-4d1d-4745-8161-5301e66fd9e0:/dev/nvme0n1p3]
May 29 16:57:01.171934 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.171859    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 16:57:01.174511 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.174489    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 16:57:01.176919 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.176792    2564 manager.go:217] Machine: {Timestamp:2026-05-29 16:57:01.176300141 +0000 UTC m=+0.465091636 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101283 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b94fb65d8a52f749c786941651d05 SystemUUID:ec2b94fb-65d8-a52f-749c-786941651d05 BootID:c2450920-90f2-4313-89a7-012e1d5c44d6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:1a:d4:c9:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:1a:d4:c9:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:e8:f7:78:07:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 16:57:01.177722 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.177712    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 16:57:01.177878 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.177864    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 16:57:01.179225 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.179199    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 16:57:01.179385 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.179226    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-169.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 16:57:01.179428 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.179395    2564 topology_manager.go:138] "Creating topology manager with none policy"
May 29 16:57:01.179428 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.179404    2564 container_manager_linux.go:306] "Creating device plugin manager"
May 29 16:57:01.179428 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.179415    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 16:57:01.181244 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.181233    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 16:57:01.183451 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.183440    2564 state_mem.go:36] "Initialized new in-memory state store"
May 29 16:57:01.183561 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.183552    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 16:57:01.186201 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.186190    2564 kubelet.go:491] "Attempting to sync node with API server"
May 29 16:57:01.186241 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.186211    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 16:57:01.186241 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.186225    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 16:57:01.186241 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.186234    2564 kubelet.go:397] "Adding apiserver pod source"
May 29 16:57:01.186355 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.186244    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 16:57:01.187465 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.187452    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 16:57:01.187510 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.187471    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 16:57:01.190949 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.190933    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
May 29 16:57:01.193536 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.193479    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lbdsq"
May 29 16:57:01.196300 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.196282    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 16:57:01.199023 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.199004    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lbdsq"
May 29 16:57:01.199971 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.199954    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.199977    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.199986    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.199995    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200007    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200016    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200025    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200033    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200043    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200052    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 16:57:01.200065 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200065    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 16:57:01.200395 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.200075    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 16:57:01.201315 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.201296    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 16:57:01.201364 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.201295    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 16:57:01.201956 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.201944    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 16:57:01.202004 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.201961    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 16:57:01.205101 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.205084    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 16:57:01.205190 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.205127    2564 server.go:1295] "Started kubelet"
May 29 16:57:01.205239 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.205190    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 16:57:01.205293 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.205238    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 16:57:01.205355 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.205342    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 16:57:01.205921 ip-10-0-128-169 systemd[1]: Started Kubernetes Kubelet.
May 29 16:57:01.207096 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.207078    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 16:57:01.207365 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.207352    2564 server.go:317] "Adding debug handlers to kubelet server"
May 29 16:57:01.214656 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.214570    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 16:57:01.214656 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.214612    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 16:57:01.214769 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.214722    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 16:57:01.214769 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.214733    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 16:57:01.214860 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.214787    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 16:57:01.215099 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.215085    2564 reconstruct.go:97] "Volume reconstruction finished"
May 29 16:57:01.215099 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.215098    2564 reconciler.go:26] "Reconciler: start to sync state"
May 29 16:57:01.215876 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.215852    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.216141 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.216106    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 16:57:01.216227 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216174    2564 factory.go:153] Registering CRI-O factory
May 29 16:57:01.216227 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216185    2564 factory.go:223] Registration of the crio container factory successfully
May 29 16:57:01.216332 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216229    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 16:57:01.216332 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216235    2564 factory.go:55] Registering systemd factory
May 29 16:57:01.216332 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216241    2564 factory.go:223] Registration of the systemd container factory successfully
May 29 16:57:01.216332 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216253    2564 factory.go:103] Registering Raw factory
May 29 16:57:01.216332 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216264    2564 manager.go:1196] Started watching for new ooms in manager
May 29 16:57:01.216571 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216550    2564 manager.go:319] Starting recovery of all containers
May 29 16:57:01.216989 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.216965    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:01.217794 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.217775    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-169.ec2.internal" not found
May 29 16:57:01.220183 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.220154    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-169.ec2.internal\" not found" node="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.228261 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.228245    2564 manager.go:324] Recovery completed
May 29 16:57:01.232159 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.232146    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.232417 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.232402    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-169.ec2.internal" not found
May 29 16:57:01.234301 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234286    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.234360 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234314    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.234360 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234327    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.234750 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234738    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 16:57:01.234811 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234750    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 16:57:01.234811 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.234770    2564 state_mem.go:36] "Initialized new in-memory state store"
May 29 16:57:01.238619 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.238605    2564 policy_none.go:49] "None policy: Start"
May 29 16:57:01.238687 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.238624    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 16:57:01.238687 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.238638    2564 state_mem.go:35] "Initializing new in-memory state store"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276026    2564 manager.go:341] "Starting Device Plugin manager"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.276059    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276072    2564 server.go:85] "Starting device plugin registration server"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276318    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276329    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276437    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276511    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.276521    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.276935    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 16:57:01.288348 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.276966    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.288744 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.288731    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-169.ec2.internal" not found
May 29 16:57:01.308901 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.308864    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 16:57:01.310036 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.310005    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 16:57:01.310036 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.310028    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 16:57:01.310205 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.310044    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 16:57:01.310205 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.310050    2564 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 16:57:01.310205 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.310132    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 16:57:01.314986 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.314968    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:01.377339 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.377266    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.378411 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.378395    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.378502 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.378423    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.378502 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.378438    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.378502 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.378467    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.386073 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.386059    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.386119 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.386080    2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-169.ec2.internal\": node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.409866 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.409843    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.410843 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.410812    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"]
May 29 16:57:01.410898 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.410889    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.411744 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.411730    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.411807 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.411757    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.411807 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.411766    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.412870 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.412858    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.412953 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.412941    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.413000 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.412966    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.413542 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413523    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.413612 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413557    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.413612 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413567    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.413612 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413523    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.413699 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413625    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.413699 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.413636    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.414600 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.414587    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.414645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.414610    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 16:57:01.415308 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.415297    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientMemory"
May 29 16:57:01.415369 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.415319    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasNoDiskPressure"
May 29 16:57:01.415369 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.415328    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeHasSufficientPID"
May 29 16:57:01.416627 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.416612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.416675 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.416636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.416675 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.416654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485500250b020aa044bcc7d57132650-config\") pod \"kube-apiserver-proxy-ip-10-0-128-169.ec2.internal\" (UID: \"9485500250b020aa044bcc7d57132650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.439494 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.439474    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-169.ec2.internal\" not found" node="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.444125 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.444107    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-169.ec2.internal\" not found" node="ip-10-0-128-169.ec2.internal"
May 29 16:57:01.510153 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.510115    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.516744 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.516795 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516759    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.516795 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516786    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485500250b020aa044bcc7d57132650-config\") pod \"kube-apiserver-proxy-ip-10-0-128-169.ec2.internal\" (UID: \"9485500250b020aa044bcc7d57132650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.516888 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516806    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.516888 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516833    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd3bf23caf19f5c55431e5e9f8ce2b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal\" (UID: \"6fd3bf23caf19f5c55431e5e9f8ce2b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.516888 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.516856    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9485500250b020aa044bcc7d57132650-config\") pod \"kube-apiserver-proxy-ip-10-0-128-169.ec2.internal\" (UID: \"9485500250b020aa044bcc7d57132650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.610609 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.610567    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.711388 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.711328    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.741879 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.741855    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.747449 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:01.747427    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:01.812165 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.812130    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:01.912717 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:01.912677    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.013295 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.013213    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.066720 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.066687    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:02.111628 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.111593    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 16:57:02.112202 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.111748    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 16:57:02.112202 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.111754    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 16:57:02.112202 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.111754    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 16:57:02.114001 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.113981    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.200988 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.200785    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 16:52:01 +0000 UTC" deadline="2027-10-31 00:03:55.133534757 +0000 UTC"
May 29 16:57:02.200988 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.200984    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12463h6m52.932554143s"
May 29 16:57:02.214943 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.214919    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.215045 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.214965    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 16:57:02.236027 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.236001    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 16:57:02.256349 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.256323    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxg68"
May 29 16:57:02.264235 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.264181    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxg68"
May 29 16:57:02.272422 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:02.272390    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9485500250b020aa044bcc7d57132650.slice/crio-f9892f6903a690aa9c060ae04646cfe6945378ea2d40c6b1b77a5d819a5d45a8 WatchSource:0}: Error finding container f9892f6903a690aa9c060ae04646cfe6945378ea2d40c6b1b77a5d819a5d45a8: Status 404 returned error can't find the container with id f9892f6903a690aa9c060ae04646cfe6945378ea2d40c6b1b77a5d819a5d45a8
May 29 16:57:02.272719 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:02.272696    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd3bf23caf19f5c55431e5e9f8ce2b1.slice/crio-0bb8dd954a9e4a34db6158c61e39d3d0ff54ee8c10187802e495956f44b2b0d3 WatchSource:0}: Error finding container 0bb8dd954a9e4a34db6158c61e39d3d0ff54ee8c10187802e495956f44b2b0d3: Status 404 returned error can't find the container with id 0bb8dd954a9e4a34db6158c61e39d3d0ff54ee8c10187802e495956f44b2b0d3
May 29 16:57:02.277485 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.277467    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 16:57:02.312883 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.312837    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal" event={"ID":"6fd3bf23caf19f5c55431e5e9f8ce2b1","Type":"ContainerStarted","Data":"0bb8dd954a9e4a34db6158c61e39d3d0ff54ee8c10187802e495956f44b2b0d3"}
May 29 16:57:02.313619 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.313594    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal" event={"ID":"9485500250b020aa044bcc7d57132650","Type":"ContainerStarted","Data":"f9892f6903a690aa9c060ae04646cfe6945378ea2d40c6b1b77a5d819a5d45a8"}
May 29 16:57:02.315780 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.315765    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.416308 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.416277    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.516781 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.516695    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.617244 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:02.617208    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-169.ec2.internal\" not found"
May 29 16:57:02.669259 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.669234    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:02.716716 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.716673    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal"
May 29 16:57:02.728804 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.728630    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 16:57:02.733544 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.733433    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal"
May 29 16:57:02.741800 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:02.741777    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 16:57:03.186653 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.186622    2564 apiserver.go:52] "Watching apiserver"
May 29 16:57:03.194715 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.194691    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 16:57:03.197100 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.197077    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-x2qm4","kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l5wp6","openshift-image-registry/node-ca-n4ftb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal","openshift-multus/multus-h6gp6","openshift-network-diagnostics/network-check-target-zxzjd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw","openshift-multus/multus-additional-cni-plugins-4454q","openshift-multus/network-metrics-daemon-tnvp5","openshift-network-operator/iptables-alerter-8zd2r","openshift-ovn-kubernetes/ovnkube-node-gpcnk"]
May 29 16:57:03.200426 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.200404    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.202447 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.202426    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.203133 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.203116    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dd9jr\""
May 29 16:57:03.203296 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.203278    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 16:57:03.203373 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.203352    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 16:57:03.204753 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.204734    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 16:57:03.204860 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.204751    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 16:57:03.205026 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.204991    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vwtrk\""
May 29 16:57:03.206486 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.206465    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.208600 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.208584    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 16:57:03.208686 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.208671    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.208898 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.208884    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vszf7\""
May 29 16:57:03.209181 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.209141    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 16:57:03.209181 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.209164    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 16:57:03.210851 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.210831    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:03.210953 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.210909    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:03.210953 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.210934    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.211648 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.211607    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 16:57:03.211784 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.211762    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 16:57:03.212159 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.211948    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xfdzr\""
May 29 16:57:03.213660 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.212474    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 16:57:03.213660 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.213247    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jftcr\""
May 29 16:57:03.213660 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.213506    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 16:57:03.213877 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.213718    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 16:57:03.213990 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.213950    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 16:57:03.214168 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.214139    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.214309 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.214296    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 16:57:03.216610 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.216444    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5cdvw\""
May 29 16:57:03.216808 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.216651    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 16:57:03.217006 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.216990    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 16:57:03.218643 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.218623    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.218743 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.218688    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:03.218743 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.218723    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.221031 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.221003    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.221118 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.221100    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 16:57:03.221334 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.221104    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 16:57:03.221477 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.221456    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 16:57:03.221606 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.221592    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6q7wv\""
May 29 16:57:03.223547 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.223412    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 16:57:03.223547 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.223465    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 16:57:03.223720 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.223699    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 16:57:03.223872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.223760    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 16:57:03.224069 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.224046    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2kt7n\""
May 29 16:57:03.224145 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.224089    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 16:57:03.224145 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.224102    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 16:57:03.227482 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-os-release\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.227573 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.227573 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vsjl\" (UniqueName: \"kubernetes.io/projected/fb86016f-39e5-4927-afe9-c80719fb871a-kube-api-access-4vsjl\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.227573 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9qn\" (UniqueName: \"kubernetes.io/projected/4ea16f49-88cb-4987-ba18-a6c3c534282a-kube-api-access-mt9qn\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.227734 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.227734 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f826046-df52-40ef-9ec8-f6c69d5feee8-agent-certs\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.227734 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-socket-dir-parent\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.227734 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-binary-copy\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysconfig\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccad1c35-c7c6-4a39-b213-f27b3b66157d-serviceca\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-system-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cni-binary-copy\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.227944 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.227916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-registration-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-sys-fs\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-multus\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-socket-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-var-lib-kubelet\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-netns\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.228230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-systemd\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-lib-modules\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92b22\" (UniqueName: \"kubernetes.io/projected/f1383b6f-d930-4d19-999c-41339e2b8d70-kube-api-access-92b22\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-conf\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228399    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-run\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cnibin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-bin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtf9c\" (UniqueName: \"kubernetes.io/projected/66bab7e7-d445-4ab1-a2e1-3724d95c057b-kube-api-access-jtf9c\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tllvl\" (UniqueName: \"kubernetes.io/projected/5f8acb76-1e23-4c98-912f-4f8903fd374c-kube-api-access-tllvl\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-kubernetes\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-etc-tuned\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.228602 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-kubelet\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-system-cni-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f826046-df52-40ef-9ec8-f6c69d5feee8-konnectivity-ca\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccad1c35-c7c6-4a39-b213-f27b3b66157d-host\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnhcs\" (UniqueName: \"kubernetes.io/projected/ccad1c35-c7c6-4a39-b213-f27b3b66157d-kube-api-access-mnhcs\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-hostroot\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-k8s-cni-cncf-io\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-multus-certs\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-device-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-cnibin\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-tmp\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.228977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-daemon-config\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-modprobe-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-host\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-etc-kubernetes\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-sys\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.229136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-os-release\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.229711 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.229130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-conf-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.264806 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.264775    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 16:52:02 +0000 UTC" deadline="2028-02-15 22:14:26.902600532 +0000 UTC"
May 29 16:57:03.264806 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.264802    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15053h17m23.637801485s"
May 29 16:57:03.315445 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.315415    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 16:57:03.329419 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329386    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tllvl\" (UniqueName: \"kubernetes.io/projected/5f8acb76-1e23-4c98-912f-4f8903fd374c-kube-api-access-tllvl\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.329419 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329420    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-kubernetes\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-systemd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329536    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-etc-tuned\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329577    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-kubelet\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-netns\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.329652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329639    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-system-cni-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329666    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329692    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f826046-df52-40ef-9ec8-f6c69d5feee8-konnectivity-ca\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329727    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccad1c35-c7c6-4a39-b213-f27b3b66157d-host\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-system-cni-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329842    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnhcs\" (UniqueName: \"kubernetes.io/projected/ccad1c35-c7c6-4a39-b213-f27b3b66157d-kube-api-access-mnhcs\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329868    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-hostroot\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329886    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccad1c35-c7c6-4a39-b213-f27b3b66157d-host\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329911    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-bin\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.329940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-kubelet\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329952    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-hostroot\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329961    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-k8s-cni-cncf-io\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329964    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.329995    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-multus-certs\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330035    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-kubernetes\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8455e44-93a2-4e2c-880d-a5a232390556-iptables-alerter-script\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330073    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-k8s-cni-cncf-io\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-ovn\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-netd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330131    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-multus-certs\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovn-node-metrics-cert\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330195    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-device-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330220    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-cnibin\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330247    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-tmp\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330264    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-device-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330271    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-daemon-config\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330296    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-modprobe-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.330398 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-cnibin\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330321    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-host\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-etc-kubernetes\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330365    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-host\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-slash\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330399    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-sys\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330409    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-etc-kubernetes\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330404    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-modprobe-d\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330422    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-os-release\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-config\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330471    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-sys\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330484    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-os-release\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330489    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-conf-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330526    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-os-release\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330556    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330554    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-conf-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330581    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vsjl\" (UniqueName: \"kubernetes.io/projected/fb86016f-39e5-4927-afe9-c80719fb871a-kube-api-access-4vsjl\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330607    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9qn\" (UniqueName: \"kubernetes.io/projected/4ea16f49-88cb-4987-ba18-a6c3c534282a-kube-api-access-mt9qn\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.331226 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330617    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-os-release\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330619    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-systemd-units\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330670    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-etc-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330699    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f826046-df52-40ef-9ec8-f6c69d5feee8-agent-certs\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330751    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-socket-dir-parent\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330775    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-env-overrides\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-script-lib\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330870    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-binary-copy\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330893    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330938    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysconfig\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330962    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccad1c35-c7c6-4a39-b213-f27b3b66157d-serviceca\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.330984    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-system-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331003    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cni-binary-copy\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8455e44-93a2-4e2c-880d-a5a232390556-host-slash\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.332074 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btcz\" (UniqueName: \"kubernetes.io/projected/c8455e44-93a2-4e2c-880d-a5a232390556-kube-api-access-2btcz\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-registration-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331091    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-sys-fs\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331113    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331134    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-multus\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmht\" (UniqueName: \"kubernetes.io/projected/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-kube-api-access-vsmht\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331207    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-socket-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331231    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331252    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-var-lib-kubelet\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331277    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-netns\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-kubelet\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331321    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f826046-df52-40ef-9ec8-f6c69d5feee8-konnectivity-ca\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-node-log\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331356    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331375    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331401    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-systemd\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.332858 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331451    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-systemd\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331502    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-socket-dir-parent\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331572    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-registration-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331629    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-sys-fs\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331620    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-daemon-config\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331649    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysconfig\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331702    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-system-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.331719    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-multus-cni-dir\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332019    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-binary-copy\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332159    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1383b6f-d930-4d19-999c-41339e2b8d70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332242    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cni-binary-copy\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332320    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-var-lib-kubelet\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332367    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-run-netns\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332379    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1383b6f-d930-4d19-999c-41339e2b8d70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332404    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-lib-modules\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332433    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-multus\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.333566 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332432    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.332502    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332506    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92b22\" (UniqueName: \"kubernetes.io/projected/f1383b6f-d930-4d19-999c-41339e2b8d70-kube-api-access-92b22\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332533    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-conf\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332540    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccad1c35-c7c6-4a39-b213-f27b3b66157d-serviceca\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332560    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-run\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332584    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cnibin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.332615    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:03.832583538 +0000 UTC m=+3.121375024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332628    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-cnibin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332642    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-lib-modules\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332647    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-bin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66bab7e7-d445-4ab1-a2e1-3724d95c057b-host-var-lib-cni-bin\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332686    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtf9c\" (UniqueName: \"kubernetes.io/projected/66bab7e7-d445-4ab1-a2e1-3724d95c057b-kube-api-access-jtf9c\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-var-lib-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-log-socket\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332757    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8acb76-1e23-4c98-912f-4f8903fd374c-socket-dir\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.334367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332921    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-etc-sysctl-conf\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.335197 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.332966    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb86016f-39e5-4927-afe9-c80719fb871a-run\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.335197 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.333564    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-tmp\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.335197 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.333629    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb86016f-39e5-4927-afe9-c80719fb871a-etc-tuned\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.335197 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.333912    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f826046-df52-40ef-9ec8-f6c69d5feee8-agent-certs\") pod \"konnectivity-agent-x2qm4\" (UID: \"6f826046-df52-40ef-9ec8-f6c69d5feee8\") " pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.337314 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.337292    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:03.337406 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.337319    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:03.337406 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.337330    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:03.337406 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.337382    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:03.837368242 +0000 UTC m=+3.126159744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:03.340265 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.340210    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnhcs\" (UniqueName: \"kubernetes.io/projected/ccad1c35-c7c6-4a39-b213-f27b3b66157d-kube-api-access-mnhcs\") pod \"node-ca-n4ftb\" (UID: \"ccad1c35-c7c6-4a39-b213-f27b3b66157d\") " pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.340585 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.340558    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9qn\" (UniqueName: \"kubernetes.io/projected/4ea16f49-88cb-4987-ba18-a6c3c534282a-kube-api-access-mt9qn\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.340769 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.340742    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tllvl\" (UniqueName: \"kubernetes.io/projected/5f8acb76-1e23-4c98-912f-4f8903fd374c-kube-api-access-tllvl\") pod \"aws-ebs-csi-driver-node-dw9zw\" (UID: \"5f8acb76-1e23-4c98-912f-4f8903fd374c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.341470 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.341446    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vsjl\" (UniqueName: \"kubernetes.io/projected/fb86016f-39e5-4927-afe9-c80719fb871a-kube-api-access-4vsjl\") pod \"tuned-l5wp6\" (UID: \"fb86016f-39e5-4927-afe9-c80719fb871a\") " pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.341747 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.341726    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92b22\" (UniqueName: \"kubernetes.io/projected/f1383b6f-d930-4d19-999c-41339e2b8d70-kube-api-access-92b22\") pod \"multus-additional-cni-plugins-4454q\" (UID: \"f1383b6f-d930-4d19-999c-41339e2b8d70\") " pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.342632 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.342611    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtf9c\" (UniqueName: \"kubernetes.io/projected/66bab7e7-d445-4ab1-a2e1-3724d95c057b-kube-api-access-jtf9c\") pod \"multus-h6gp6\" (UID: \"66bab7e7-d445-4ab1-a2e1-3724d95c057b\") " pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.433894 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433864    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-slash\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.433894 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433900    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-config\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433926    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-systemd-units\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433952    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-etc-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433989    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-env-overrides\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.433997    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-slash\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434008    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-systemd-units\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434011    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-script-lib\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434063    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-etc-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8455e44-93a2-4e2c-880d-a5a232390556-host-slash\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2btcz\" (UniqueName: \"kubernetes.io/projected/c8455e44-93a2-4e2c-880d-a5a232390556-kube-api-access-2btcz\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.434140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434126    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8455e44-93a2-4e2c-880d-a5a232390556-host-slash\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434166    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmht\" (UniqueName: \"kubernetes.io/projected/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-kube-api-access-vsmht\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434210    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-kubelet\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434235    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-node-log\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434234    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434278    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-node-log\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434297    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434317    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-kubelet\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434333    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-var-lib-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434357    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-log-socket\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434382    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-systemd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434387    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-var-lib-openvswitch\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434411    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434413    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-log-socket\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434435    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-netns\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.434589 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434422    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-systemd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434462    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-bin\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434487    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8455e44-93a2-4e2c-880d-a5a232390556-iptables-alerter-script\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434504    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-run-netns\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434514    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-bin\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434511    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-ovn\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434547    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-config\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434584    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-netd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434610    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovn-node-metrics-cert\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434624    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-run-ovn\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434632    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-host-cni-netd\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434657    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-env-overrides\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovnkube-script-lib\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.435242 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.434946    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8455e44-93a2-4e2c-880d-a5a232390556-iptables-alerter-script\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.437125 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.437074    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-ovn-node-metrics-cert\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.441748 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.441726    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btcz\" (UniqueName: \"kubernetes.io/projected/c8455e44-93a2-4e2c-880d-a5a232390556-kube-api-access-2btcz\") pod \"iptables-alerter-8zd2r\" (UID: \"c8455e44-93a2-4e2c-880d-a5a232390556\") " pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.442141 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.442124    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmht\" (UniqueName: \"kubernetes.io/projected/5204caf5-e98b-4d5a-b23d-9f6c64fde9ce-kube-api-access-vsmht\") pod \"ovnkube-node-gpcnk\" (UID: \"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.511077 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.511038    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:03.520078 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.520048    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l5wp6"
May 29 16:57:03.528772 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.528751    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4ftb"
May 29 16:57:03.533137 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.533121    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6gp6"
May 29 16:57:03.539793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.539771    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw"
May 29 16:57:03.546315 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.546295    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4454q"
May 29 16:57:03.553812 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.553782    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zd2r"
May 29 16:57:03.559474 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.559451    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:03.585726 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.585693    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:03.646910 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.646879    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:03.836938 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.836861    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:03.837103 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.836961    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:03.837103 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.837033    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:04.837011833 +0000 UTC m=+4.125803315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:03.909559 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.909390    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8acb76_1e23_4c98_912f_4f8903fd374c.slice/crio-7fe7819d014200d9fa57f75a03b0948d59566c2ae1fe4bc98ea7d6b7516d9c81 WatchSource:0}: Error finding container 7fe7819d014200d9fa57f75a03b0948d59566c2ae1fe4bc98ea7d6b7516d9c81: Status 404 returned error can't find the container with id 7fe7819d014200d9fa57f75a03b0948d59566c2ae1fe4bc98ea7d6b7516d9c81
May 29 16:57:03.912607 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.912586    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5204caf5_e98b_4d5a_b23d_9f6c64fde9ce.slice/crio-37548d6bcb9b0286b39a8b752c89eda5566aede1ae906f29bc29b64d37dc98f1 WatchSource:0}: Error finding container 37548d6bcb9b0286b39a8b752c89eda5566aede1ae906f29bc29b64d37dc98f1: Status 404 returned error can't find the container with id 37548d6bcb9b0286b39a8b752c89eda5566aede1ae906f29bc29b64d37dc98f1
May 29 16:57:03.913950 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.913850    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1383b6f_d930_4d19_999c_41339e2b8d70.slice/crio-f256bf8696980e4ccd823be3fe625a3ced3497a49fef8b01c6b45f1aca14d1e7 WatchSource:0}: Error finding container f256bf8696980e4ccd823be3fe625a3ced3497a49fef8b01c6b45f1aca14d1e7: Status 404 returned error can't find the container with id f256bf8696980e4ccd823be3fe625a3ced3497a49fef8b01c6b45f1aca14d1e7
May 29 16:57:03.914383 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.914361    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb86016f_39e5_4927_afe9_c80719fb871a.slice/crio-e54b3515322c27d9b39556f47d96f21c5eb33ab042cf4cf14d69abbe33f858fe WatchSource:0}: Error finding container e54b3515322c27d9b39556f47d96f21c5eb33ab042cf4cf14d69abbe33f858fe: Status 404 returned error can't find the container with id e54b3515322c27d9b39556f47d96f21c5eb33ab042cf4cf14d69abbe33f858fe
May 29 16:57:03.915345 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.915322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccad1c35_c7c6_4a39_b213_f27b3b66157d.slice/crio-de64f7d563e2c5c52ed92ed50b64ffe9737e9a433df9024dd26085a42b0d6618 WatchSource:0}: Error finding container de64f7d563e2c5c52ed92ed50b64ffe9737e9a433df9024dd26085a42b0d6618: Status 404 returned error can't find the container with id de64f7d563e2c5c52ed92ed50b64ffe9737e9a433df9024dd26085a42b0d6618
May 29 16:57:03.916809 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.916452    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bab7e7_d445_4ab1_a2e1_3724d95c057b.slice/crio-000fd52d5406f4cdaeec51a5b6c03e19ecac495a6ffd2fd0a4a45e327700142b WatchSource:0}: Error finding container 000fd52d5406f4cdaeec51a5b6c03e19ecac495a6ffd2fd0a4a45e327700142b: Status 404 returned error can't find the container with id 000fd52d5406f4cdaeec51a5b6c03e19ecac495a6ffd2fd0a4a45e327700142b
May 29 16:57:03.918417 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.917297    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f826046_df52_40ef_9ec8_f6c69d5feee8.slice/crio-f4f361637b6c200d5fcc4e33a4e2222388d302051573c0a5e232af803efd721a WatchSource:0}: Error finding container f4f361637b6c200d5fcc4e33a4e2222388d302051573c0a5e232af803efd721a: Status 404 returned error can't find the container with id f4f361637b6c200d5fcc4e33a4e2222388d302051573c0a5e232af803efd721a
May 29 16:57:03.918417 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:03.918348    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8455e44_93a2_4e2c_880d_a5a232390556.slice/crio-4e92d6a0784452652ab18aa35e8807d1aa078d6e664f0327fa052dbe5b2c5bd9 WatchSource:0}: Error finding container 4e92d6a0784452652ab18aa35e8807d1aa078d6e664f0327fa052dbe5b2c5bd9: Status 404 returned error can't find the container with id 4e92d6a0784452652ab18aa35e8807d1aa078d6e664f0327fa052dbe5b2c5bd9
May 29 16:57:03.937868 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:03.937806    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:03.938022 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.937999    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:03.938100 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.938026    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:03.938100 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.938040    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:03.938185 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:03.938102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:04.938084767 +0000 UTC m=+4.226876266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:04.265280 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.265242    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 16:52:02 +0000 UTC" deadline="2028-02-20 17:27:40.045912156 +0000 UTC"
May 29 16:57:04.265280 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.265276    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15168h30m35.780640025s"
May 29 16:57:04.310810 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.310775    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:04.310993 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.310968    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:04.311193 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.310775    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:04.311315 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.311288    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:04.320842 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.320557    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal" event={"ID":"9485500250b020aa044bcc7d57132650","Type":"ContainerStarted","Data":"9fd04722b53e894b5d2843d0f264c03d0291bd2474267602b881827aa7ad60b2"}
May 29 16:57:04.322659 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.322633    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2qm4" event={"ID":"6f826046-df52-40ef-9ec8-f6c69d5feee8","Type":"ContainerStarted","Data":"f4f361637b6c200d5fcc4e33a4e2222388d302051573c0a5e232af803efd721a"}
May 29 16:57:04.324148 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.324110    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l5wp6" event={"ID":"fb86016f-39e5-4927-afe9-c80719fb871a","Type":"ContainerStarted","Data":"e54b3515322c27d9b39556f47d96f21c5eb33ab042cf4cf14d69abbe33f858fe"}
May 29 16:57:04.326673 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.326112    2564 generic.go:358] "Generic (PLEG): container finished" podID="6fd3bf23caf19f5c55431e5e9f8ce2b1" containerID="79ddd9c774fd3af39b714904725ca6d8c27d1498f1a07d4fc96be16a539b11c0" exitCode=0
May 29 16:57:04.326673 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.326642    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal" event={"ID":"6fd3bf23caf19f5c55431e5e9f8ce2b1","Type":"ContainerDied","Data":"79ddd9c774fd3af39b714904725ca6d8c27d1498f1a07d4fc96be16a539b11c0"}
May 29 16:57:04.327942 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.327899    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zd2r" event={"ID":"c8455e44-93a2-4e2c-880d-a5a232390556","Type":"ContainerStarted","Data":"4e92d6a0784452652ab18aa35e8807d1aa078d6e664f0327fa052dbe5b2c5bd9"}
May 29 16:57:04.330229 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.330010    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6gp6" event={"ID":"66bab7e7-d445-4ab1-a2e1-3724d95c057b","Type":"ContainerStarted","Data":"000fd52d5406f4cdaeec51a5b6c03e19ecac495a6ffd2fd0a4a45e327700142b"}
May 29 16:57:04.331427 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.331378    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4ftb" event={"ID":"ccad1c35-c7c6-4a39-b213-f27b3b66157d","Type":"ContainerStarted","Data":"de64f7d563e2c5c52ed92ed50b64ffe9737e9a433df9024dd26085a42b0d6618"}
May 29 16:57:04.333294 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.333234    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerStarted","Data":"f256bf8696980e4ccd823be3fe625a3ced3497a49fef8b01c6b45f1aca14d1e7"}
May 29 16:57:04.335678 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.335348    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-169.ec2.internal" podStartSLOduration=2.335332889 podStartE2EDuration="2.335332889s" podCreationTimestamp="2026-05-29 16:57:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:57:04.334402412 +0000 UTC m=+3.623193918" watchObservedRunningTime="2026-05-29 16:57:04.335332889 +0000 UTC m=+3.624124394"
May 29 16:57:04.336583 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.336516    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"37548d6bcb9b0286b39a8b752c89eda5566aede1ae906f29bc29b64d37dc98f1"}
May 29 16:57:04.338163 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.338107    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw" event={"ID":"5f8acb76-1e23-4c98-912f-4f8903fd374c","Type":"ContainerStarted","Data":"7fe7819d014200d9fa57f75a03b0948d59566c2ae1fe4bc98ea7d6b7516d9c81"}
May 29 16:57:04.845402 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.844748    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:04.845402 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.844938    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:04.845402 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.845011    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:06.844991566 +0000 UTC m=+6.133783052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:04.869037 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.868735    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 16:57:04.945636 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:04.945596    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:04.945808 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.945774    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:04.945808 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.945795    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:04.945808 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.945809    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:04.946027 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:04.945888    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:06.945866603 +0000 UTC m=+6.234658104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:05.384990 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:05.384727    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal" event={"ID":"6fd3bf23caf19f5c55431e5e9f8ce2b1","Type":"ContainerStarted","Data":"64436946de31aee11b641b50dca4d494f2c2da7c2ff456b20989199d3728ab03"}
May 29 16:57:06.310504 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:06.310462    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:06.310709 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.310618    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:06.311103 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:06.311083    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:06.311255 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.311189    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:06.861179 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:06.861138    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:06.861694 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.861296    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:06.861694 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.861372    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:10.861351603 +0000 UTC m=+10.150143090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:06.962699 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:06.962068    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:06.962699 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.962272    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:06.962699 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.962292    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:06.962699 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.962305    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:06.962699 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:06.962364    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:10.962346195 +0000 UTC m=+10.251137680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:08.311245 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:08.311210    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:08.311245 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:08.311246    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:08.311749 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:08.311343    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:08.311749 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:08.311443    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:10.310925 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:10.310846    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:10.310925 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:10.310867    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:10.311446 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.311003    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:10.311446 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.311222    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:10.895279 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:10.895245    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:10.895453 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.895344    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:10.895453 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.895407    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.89539038 +0000 UTC m=+18.184181866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:10.996343 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:10.996309    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:10.996523 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.996487    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:10.996523 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.996507    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:10.996523 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.996517    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:10.996668 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:10.996575    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.996559072 +0000 UTC m=+18.285350559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:12.310652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:12.310610    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:12.311101 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:12.310611    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:12.311101 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:12.310740    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:12.311101 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:12.310792    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:14.310912 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:14.310877    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:14.310912 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:14.310904    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:14.311423 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:14.311014    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:14.311423 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:14.311121    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:16.310273 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.310243    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:16.310700 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.310286    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:16.310700 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:16.310383    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:16.310700 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:16.310495    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:16.765367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.765268    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-169.ec2.internal" podStartSLOduration=14.765254604 podStartE2EDuration="14.765254604s" podCreationTimestamp="2026-05-29 16:57:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:57:05.401620145 +0000 UTC m=+4.690411650" watchObservedRunningTime="2026-05-29 16:57:16.765254604 +0000 UTC m=+16.054046107"
May 29 16:57:16.765919 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.765893    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-7zvrk"]
May 29 16:57:16.768995 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.768973    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.771916 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.771895    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 16:57:16.772030 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.771898    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fxlbd\""
May 29 16:57:16.772980 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.772959    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 16:57:16.836420 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.836386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-tmp-dir\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.836576 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.836483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nf4\" (UniqueName: \"kubernetes.io/projected/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-kube-api-access-b8nf4\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.836640 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.836576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-hosts-file\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.937745 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.937714    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-hosts-file\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.937907 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.937764    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-tmp-dir\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.937907 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.937805    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nf4\" (UniqueName: \"kubernetes.io/projected/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-kube-api-access-b8nf4\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.937907 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.937878    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-hosts-file\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.938125 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.938106    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-tmp-dir\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:16.947783 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:16.947757    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nf4\" (UniqueName: \"kubernetes.io/projected/c82230fb-cf66-48c6-96fe-2ad5e2c425c5-kube-api-access-b8nf4\") pod \"node-resolver-7zvrk\" (UID: \"c82230fb-cf66-48c6-96fe-2ad5e2c425c5\") " pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:17.079231 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:17.079197    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zvrk"
May 29 16:57:18.310367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:18.310338    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:18.310993 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:18.310338    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:18.310993 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:18.310463    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:18.310993 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:18.310504    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:18.951057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:18.951018    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:18.951237 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:18.951180    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:18.951296 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:18.951253    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:57:34.951231396 +0000 UTC m=+34.240022883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:19.052008 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:19.051961    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:19.052180 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:19.052127    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:19.052180 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:19.052173    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:19.052309 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:19.052188    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:19.052309 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:19.052284    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:57:35.052237627 +0000 UTC m=+34.341029114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:20.311026 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:20.310990    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:20.311449 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:20.311110    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:20.311449 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:20.311177    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:20.311449 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:20.311301    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:21.588489 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:21.588439    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82230fb_cf66_48c6_96fe_2ad5e2c425c5.slice/crio-b3f7e3e4d5ac36665e63a54e5939c085976cb0cbcefc9a960bb6c03e04844fa5 WatchSource:0}: Error finding container b3f7e3e4d5ac36665e63a54e5939c085976cb0cbcefc9a960bb6c03e04844fa5: Status 404 returned error can't find the container with id b3f7e3e4d5ac36665e63a54e5939c085976cb0cbcefc9a960bb6c03e04844fa5
May 29 16:57:22.310686 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.310519    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:22.310778 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.310523    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:22.310854 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:22.310769    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:22.310904 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:22.310878    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:22.417741 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.417720    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 16:57:22.418167 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418133    2564 generic.go:358] "Generic (PLEG): container finished" podID="5204caf5-e98b-4d5a-b23d-9f6c64fde9ce" containerID="a0adc2c4695f30b3649b9775242b6fce2ec88c8a13cc2fa69dea8fb906015f6c" exitCode=1
May 29 16:57:22.418269 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418226    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"d8a3b8f2affb6b5b260495fbf0d9fc5bbb5d8780602986124925b8877dd1b8e6"}
May 29 16:57:22.418269 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418250    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"5655bf52d9f786fd4de660059b2aff7df51f4dc83e59a0d10918d9fd113ccba1"}
May 29 16:57:22.418269 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418261    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"f2274ae96d813b13a021afed3ae6d9d92867c92f33f1cab72f1cf25d27bd752e"}
May 29 16:57:22.418418 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418272    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"ce125f2ac409547d0cf80de5b773e532c056e6f26eb30286c69d0221f0aaded7"}
May 29 16:57:22.418418 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418281    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerDied","Data":"a0adc2c4695f30b3649b9775242b6fce2ec88c8a13cc2fa69dea8fb906015f6c"}
May 29 16:57:22.418418 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.418292    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"6e760070f41d1c6a19f70c148eb6275af71c3ff7d958bbddaa2c3785809a2253"}
May 29 16:57:22.419933 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.419900    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw" event={"ID":"5f8acb76-1e23-4c98-912f-4f8903fd374c","Type":"ContainerStarted","Data":"f280ce6166796d787ae5eacbc7b7368a4003d8049841100e5375000456e6a887"}
May 29 16:57:22.421556 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.421532    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zvrk" event={"ID":"c82230fb-cf66-48c6-96fe-2ad5e2c425c5","Type":"ContainerStarted","Data":"3e058d9653745f1bfd0bf81e292934e4bc64203a832a087f537a5ac6fcb2a99f"}
May 29 16:57:22.421651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.421566    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zvrk" event={"ID":"c82230fb-cf66-48c6-96fe-2ad5e2c425c5","Type":"ContainerStarted","Data":"b3f7e3e4d5ac36665e63a54e5939c085976cb0cbcefc9a960bb6c03e04844fa5"}
May 29 16:57:22.423230 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.423208    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2qm4" event={"ID":"6f826046-df52-40ef-9ec8-f6c69d5feee8","Type":"ContainerStarted","Data":"11aaa00e7032b371e905b8d5f12875d9d6916735e95a6d1da329946ca8173fdc"}
May 29 16:57:22.424505 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.424478    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l5wp6" event={"ID":"fb86016f-39e5-4927-afe9-c80719fb871a","Type":"ContainerStarted","Data":"712b52f7f9c2c4dee4b4c3287815b248d921a0e8eac081de904e51b5456f2e2d"}
May 29 16:57:22.426383 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.426363    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6gp6" event={"ID":"66bab7e7-d445-4ab1-a2e1-3724d95c057b","Type":"ContainerStarted","Data":"0ddf0d617c5845daac532d28dfdd1d446e46dfe02ae09991fad75bb9a3e9814e"}
May 29 16:57:22.428046 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.427964    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4ftb" event={"ID":"ccad1c35-c7c6-4a39-b213-f27b3b66157d","Type":"ContainerStarted","Data":"e47d64208b1a7cbc68f3f3db925ffdd11b7be02903561f5ada9a625e716be330"}
May 29 16:57:22.429975 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.429951    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="f326734ac830e08a7d35e47d08e3a001de18f97e6bf1293f79eb95c4271fcdeb" exitCode=0
May 29 16:57:22.430076 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.429987    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"f326734ac830e08a7d35e47d08e3a001de18f97e6bf1293f79eb95c4271fcdeb"}
May 29 16:57:22.437447 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.437403    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zvrk" podStartSLOduration=6.437388468 podStartE2EDuration="6.437388468s" podCreationTimestamp="2026-05-29 16:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:57:22.436891488 +0000 UTC m=+21.725682992" watchObservedRunningTime="2026-05-29 16:57:22.437388468 +0000 UTC m=+21.726179972"
May 29 16:57:22.450664 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.450619    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n4ftb" podStartSLOduration=3.821686837 podStartE2EDuration="21.450604455s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.917620014 +0000 UTC m=+3.206411512" lastFinishedPulling="2026-05-29 16:57:21.546537641 +0000 UTC m=+20.835329130" observedRunningTime="2026-05-29 16:57:22.450430418 +0000 UTC m=+21.739221951" watchObservedRunningTime="2026-05-29 16:57:22.450604455 +0000 UTC m=+21.739395959"
May 29 16:57:22.487845 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.487792    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-h6gp6" podStartSLOduration=3.823340638 podStartE2EDuration="21.487780261s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.919707131 +0000 UTC m=+3.208498629" lastFinishedPulling="2026-05-29 16:57:21.584146752 +0000 UTC m=+20.872938252" observedRunningTime="2026-05-29 16:57:22.487697864 +0000 UTC m=+21.776489370" watchObservedRunningTime="2026-05-29 16:57:22.487780261 +0000 UTC m=+21.776571764"
May 29 16:57:22.519938 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.519891    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x2qm4" podStartSLOduration=8.593830237 podStartE2EDuration="21.519874507s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.920381914 +0000 UTC m=+3.209173395" lastFinishedPulling="2026-05-29 16:57:16.846426176 +0000 UTC m=+16.135217665" observedRunningTime="2026-05-29 16:57:22.502387718 +0000 UTC m=+21.791179221" watchObservedRunningTime="2026-05-29 16:57:22.519874507 +0000 UTC m=+21.808666012"
May 29 16:57:22.520062 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:22.520004    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l5wp6" podStartSLOduration=3.851952377 podStartE2EDuration="21.519998287s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.916031736 +0000 UTC m=+3.204823232" lastFinishedPulling="2026-05-29 16:57:21.584077657 +0000 UTC m=+20.872869142" observedRunningTime="2026-05-29 16:57:22.519399992 +0000 UTC m=+21.808191508" watchObservedRunningTime="2026-05-29 16:57:22.519998287 +0000 UTC m=+21.808789791"
May 29 16:57:23.122346 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.122318    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 16:57:23.288599 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.288452    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T16:57:23.122339305Z","UUID":"a8a842c0-7aa5-4e61-a77a-d238bc405930","Handler":null,"Name":"","Endpoint":""}
May 29 16:57:23.291600 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.291565    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 16:57:23.291734 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.291613    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 16:57:23.433456 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.433369    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zd2r" event={"ID":"c8455e44-93a2-4e2c-880d-a5a232390556","Type":"ContainerStarted","Data":"66a33ec58efebb203aaac035bc79595c1e790fcb80d5220af6fdff32b4469f0b"}
May 29 16:57:23.435394 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:23.435350    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw" event={"ID":"5f8acb76-1e23-4c98-912f-4f8903fd374c","Type":"ContainerStarted","Data":"edba609ae7545c841e437fb69c4981e71b59b75b542117d41640b9456b87ac0d"}
May 29 16:57:24.310618 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:24.310581    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:24.311106 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:24.310665    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:24.311106 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:24.310775    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:24.311106 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:24.310873    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:25.442671 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.442642    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 16:57:25.443274 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.443085    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"c35d22d6e5b8d0f86a8c49329b1df61a3e8c2df98bd3f77c500720fec4373dfe"}
May 29 16:57:25.445015 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.444985    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw" event={"ID":"5f8acb76-1e23-4c98-912f-4f8903fd374c","Type":"ContainerStarted","Data":"d1bdcf5b8510e2c3a1919732ff2aeae3c50665be02d5730a609691e03743c300"}
May 29 16:57:25.462205 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.462169    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8zd2r" podStartSLOduration=6.839367804 podStartE2EDuration="24.462152335s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.923768925 +0000 UTC m=+3.212560410" lastFinishedPulling="2026-05-29 16:57:21.546553457 +0000 UTC m=+20.835344941" observedRunningTime="2026-05-29 16:57:23.447891864 +0000 UTC m=+22.736683369" watchObservedRunningTime="2026-05-29 16:57:25.462152335 +0000 UTC m=+24.750943837"
May 29 16:57:25.462733 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.462701    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw9zw" podStartSLOduration=4.022046966 podStartE2EDuration="24.46269365s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.911490428 +0000 UTC m=+3.200281909" lastFinishedPulling="2026-05-29 16:57:24.352137093 +0000 UTC m=+23.640928593" observedRunningTime="2026-05-29 16:57:25.462120975 +0000 UTC m=+24.750912480" watchObservedRunningTime="2026-05-29 16:57:25.46269365 +0000 UTC m=+24.751485150"
May 29 16:57:25.816162 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.816134    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:25.816958 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:25.816940    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:26.310629 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:26.310598    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:26.310796 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:26.310599    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:26.310796 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:26.310715    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:26.310909 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:26.310795    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:26.447093 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:26.447062    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:26.447581 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:26.447444    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x2qm4"
May 29 16:57:27.449894 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.449667    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="0107a501c1e571d91f6b34b1f86cfa8cd00af7dad6a34cda9ea1fa75db7e9117" exitCode=0
May 29 16:57:27.450361 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.449750    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"0107a501c1e571d91f6b34b1f86cfa8cd00af7dad6a34cda9ea1fa75db7e9117"}
May 29 16:57:27.453044 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453028    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 16:57:27.453408 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453382    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"fbcbaa6b1a0746dabe9388d603d6da7dee5242ba538ec19f7571223613b74930"}
May 29 16:57:27.453633 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453612    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:27.453719 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453643    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:27.453719 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453655    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:27.453797 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.453780    2564 scope.go:117] "RemoveContainer" containerID="a0adc2c4695f30b3649b9775242b6fce2ec88c8a13cc2fa69dea8fb906015f6c"
May 29 16:57:27.469584 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.469559    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:27.469974 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:27.469959    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:57:28.311301 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.311135    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:28.311447 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.311148    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:28.311447 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:28.311371    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:28.311546 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:28.311476    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:28.456702 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.456670    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="8b6c56b49a6339a498c52a7ec955c4e084832b13a2862660df515ddb44f6c154" exitCode=0
May 29 16:57:28.457076 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.456745    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"8b6c56b49a6339a498c52a7ec955c4e084832b13a2862660df515ddb44f6c154"}
May 29 16:57:28.461410 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.461382    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 16:57:28.461950 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.461928    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" event={"ID":"5204caf5-e98b-4d5a-b23d-9f6c64fde9ce","Type":"ContainerStarted","Data":"e0a31f6ed1b80106f619d27a2bfcb27e7d04d65f2b99136bd02a9ee026346fc1"}
May 29 16:57:28.507916 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.507849    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk" podStartSLOduration=9.782440072 podStartE2EDuration="27.507811984s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.914316729 +0000 UTC m=+3.203108214" lastFinishedPulling="2026-05-29 16:57:21.639688643 +0000 UTC m=+20.928480126" observedRunningTime="2026-05-29 16:57:28.507170975 +0000 UTC m=+27.795962490" watchObservedRunningTime="2026-05-29 16:57:28.507811984 +0000 UTC m=+27.796603489"
May 29 16:57:28.665025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.664978    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxzjd"]
May 29 16:57:28.665194 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.665083    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:28.665249 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:28.665178    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:28.666211 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.666186    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tnvp5"]
May 29 16:57:28.666321 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:28.666275    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:28.666395 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:28.666378    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:29.465377 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:29.465291    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="84f8dc8b046a2cd7665be4657cc4947af9d6762c35871cfa9eb014bba1bcb767" exitCode=0
May 29 16:57:29.465902 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:29.465363    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"84f8dc8b046a2cd7665be4657cc4947af9d6762c35871cfa9eb014bba1bcb767"}
May 29 16:57:30.311229 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:30.311192    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:30.311399 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:30.311192    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:30.311399 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:30.311325    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:30.311399 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:30.311387    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:30.795871 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:30.795847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zvrk_c82230fb-cf66-48c6-96fe-2ad5e2c425c5/dns-node-resolver/0.log"
May 29 16:57:31.979586 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:31.979381    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4ftb_ccad1c35-c7c6-4a39-b213-f27b3b66157d/node-ca/0.log"
May 29 16:57:32.310957 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:32.310925    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:32.311119 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:32.311033    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:32.311192 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:32.311121    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:32.311263 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:32.311241    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:34.310447 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.310408    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:34.310797 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.310408    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:34.310797 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.310560    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxzjd" podUID="766ab962-d470-4853-82bb-d065c29e62ed"
May 29 16:57:34.310797 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.310598    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnvp5" podUID="4ea16f49-88cb-4987-ba18-a6c3c534282a"
May 29 16:57:34.558996 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.558973    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-169.ec2.internal" event="NodeReady"
May 29 16:57:34.559162 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.559110    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 16:57:34.629886 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.629789    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kqdxd"]
May 29 16:57:34.684518 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.684491    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wnfnm"]
May 29 16:57:34.684691 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.684595    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.687161 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.687137    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 16:57:34.687287 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.687176    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 16:57:34.687287 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.687142    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwwt6\""
May 29 16:57:34.697391 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.697367    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqdxd"]
May 29 16:57:34.697581 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.697566    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnfnm"]
May 29 16:57:34.697646 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.697589    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vmm9p"]
May 29 16:57:34.697707 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.697587    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.700173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.700026    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 16:57:34.700173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.700155    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 16:57:34.700489 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.700471    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 16:57:34.700592 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.700577    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 16:57:34.700658 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.700581    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kt6kk\""
May 29 16:57:34.713908 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.713853    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vmm9p"]
May 29 16:57:34.714008 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.713911    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:34.716485 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.716465    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 16:57:34.716586 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.716528    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 16:57:34.716586 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.716540    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 16:57:34.716849 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.716832    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fgcrt\""
May 29 16:57:34.770886 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.770847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.771057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.770906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.771057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.770948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-crio-socket\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.771057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.770973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.771057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.771041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjsj\" (UniqueName: \"kubernetes.io/projected/72202cdd-3c3e-408e-ba40-6620c2697719-kube-api-access-lfjsj\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.771254 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.771084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvkmr\" (UniqueName: \"kubernetes.io/projected/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-api-access-qvkmr\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.771254 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.771112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72202cdd-3c3e-408e-ba40-6620c2697719-tmp-dir\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.771254 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.771136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-data-volume\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.771254 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.771237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72202cdd-3c3e-408e-ba40-6620c2697719-config-volume\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.871793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871712    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.871793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28j9r\" (UniqueName: \"kubernetes.io/projected/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-kube-api-access-28j9r\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-crio-socket\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871836    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871867    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjsj\" (UniqueName: \"kubernetes.io/projected/72202cdd-3c3e-408e-ba40-6620c2697719-kube-api-access-lfjsj\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.871881    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871920    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvkmr\" (UniqueName: \"kubernetes.io/projected/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-api-access-qvkmr\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.871970 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.871958    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls podName:c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:35.371936593 +0000 UTC m=+34.660728077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wnfnm" (UID: "c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5") : secret "insights-runtime-extractor-tls" not found
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.871978    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72202cdd-3c3e-408e-ba40-6620c2697719-tmp-dir\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872005    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-data-volume\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872049    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72202cdd-3c3e-408e-ba40-6620c2697719-config-volume\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872102    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.872179    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 16:57:34.872314 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.872215    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls podName:72202cdd-3c3e-408e-ba40-6620c2697719 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:35.372203305 +0000 UTC m=+34.660994788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls") pod "dns-default-kqdxd" (UID: "72202cdd-3c3e-408e-ba40-6620c2697719") : secret "dns-default-metrics-tls" not found
May 29 16:57:34.872593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872418    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72202cdd-3c3e-408e-ba40-6620c2697719-tmp-dir\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.872593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872469    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-data-volume\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.872593 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-crio-socket\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.872733 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872677    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.872772 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.872739    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72202cdd-3c3e-408e-ba40-6620c2697719-config-volume\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.882598 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.882578    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvkmr\" (UniqueName: \"kubernetes.io/projected/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-kube-api-access-qvkmr\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:34.882700 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.882614    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjsj\" (UniqueName: \"kubernetes.io/projected/72202cdd-3c3e-408e-ba40-6620c2697719-kube-api-access-lfjsj\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:34.972579 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.972544    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:34.972738 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.972622    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:34.972738 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.972659    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28j9r\" (UniqueName: \"kubernetes.io/projected/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-kube-api-access-28j9r\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:34.972738 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.972699    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 16:57:34.972855 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.972759    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:34.972855 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.972769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert podName:c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:35.472754269 +0000 UTC m=+34.761545750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert") pod "ingress-canary-vmm9p" (UID: "c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47") : secret "canary-serving-cert" not found
May 29 16:57:34.972855 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:34.972835    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs podName:4ea16f49-88cb-4987-ba18-a6c3c534282a nodeName:}" failed. No retries permitted until 2026-05-29 16:58:06.972804052 +0000 UTC m=+66.261595550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs") pod "network-metrics-daemon-tnvp5" (UID: "4ea16f49-88cb-4987-ba18-a6c3c534282a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 16:57:34.981588 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:34.981566    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28j9r\" (UniqueName: \"kubernetes.io/projected/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-kube-api-access-28j9r\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:35.073128 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.073102    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:35.073272 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.073211    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 16:57:35.073272 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.073224    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 16:57:35.073272 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.073232    2564 projected.go:194] Error preparing data for projected volume kube-api-access-kxgk6 for pod openshift-network-diagnostics/network-check-target-zxzjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:35.073368 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.073279    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6 podName:766ab962-d470-4853-82bb-d065c29e62ed nodeName:}" failed. No retries permitted until 2026-05-29 16:58:07.073266085 +0000 UTC m=+66.362057567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxgk6" (UniqueName: "kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6") pod "network-check-target-zxzjd" (UID: "766ab962-d470-4853-82bb-d065c29e62ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 16:57:35.316764 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.316734    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"]
May 29 16:57:35.332081 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.332054    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"]
May 29 16:57:35.332210 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.332156    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"
May 29 16:57:35.335013 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.334979    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ngbsg\""
May 29 16:57:35.335156 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.335041    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 29 16:57:35.335156 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.334982    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 29 16:57:35.375208 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.375182    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:35.375320 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.375215    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:35.375320 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.375297    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 29 16:57:35.375320 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.375302    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 16:57:35.375436 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.375343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls podName:c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:36.375330421 +0000 UTC m=+35.664121903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wnfnm" (UID: "c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5") : secret "insights-runtime-extractor-tls" not found
May 29 16:57:35.375436 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.375355    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls podName:72202cdd-3c3e-408e-ba40-6620c2697719 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:36.375349522 +0000 UTC m=+35.664141004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls") pod "dns-default-kqdxd" (UID: "72202cdd-3c3e-408e-ba40-6620c2697719") : secret "dns-default-metrics-tls" not found
May 29 16:57:35.475736 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.475709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srt85\" (UniqueName: \"kubernetes.io/projected/9cf68903-3db2-422f-97c5-40c06c42a37c-kube-api-access-srt85\") pod \"migrator-96c6f749-qrhpc\" (UID: \"9cf68903-3db2-422f-97c5-40c06c42a37c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"
May 29 16:57:35.475867 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.475763    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:35.475934 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.475872    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 16:57:35.475934 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:35.475930    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert podName:c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:36.475912472 +0000 UTC m=+35.764703958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert") pod "ingress-canary-vmm9p" (UID: "c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47") : secret "canary-serving-cert" not found
May 29 16:57:35.577042 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.577020    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srt85\" (UniqueName: \"kubernetes.io/projected/9cf68903-3db2-422f-97c5-40c06c42a37c-kube-api-access-srt85\") pod \"migrator-96c6f749-qrhpc\" (UID: \"9cf68903-3db2-422f-97c5-40c06c42a37c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"
May 29 16:57:35.586641 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.586616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srt85\" (UniqueName: \"kubernetes.io/projected/9cf68903-3db2-422f-97c5-40c06c42a37c-kube-api-access-srt85\") pod \"migrator-96c6f749-qrhpc\" (UID: \"9cf68903-3db2-422f-97c5-40c06c42a37c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"
May 29 16:57:35.630371 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.630335    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"]
May 29 16:57:35.640988 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.640957    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"
May 29 16:57:35.651436 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.651414    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"]
May 29 16:57:35.651537 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.651520    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"
May 29 16:57:35.654193 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.654169    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 16:57:35.654302 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.654199    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 16:57:35.654302 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.654201    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v87xm\""
May 29 16:57:35.778283 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.778247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shl2\" (UniqueName: \"kubernetes.io/projected/e96595bd-d108-49cb-bdca-f28c7bb74491-kube-api-access-5shl2\") pod \"network-check-source-56d84b9f44-b5nnj\" (UID: \"e96595bd-d108-49cb-bdca-f28c7bb74491\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"
May 29 16:57:35.798561 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.798402    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc"]
May 29 16:57:35.802057 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:35.802029    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf68903_3db2_422f_97c5_40c06c42a37c.slice/crio-9d44194495584e4d0ecd2d75088b07afd86eb3bd8ac7512c59007e211543bef3 WatchSource:0}: Error finding container 9d44194495584e4d0ecd2d75088b07afd86eb3bd8ac7512c59007e211543bef3: Status 404 returned error can't find the container with id 9d44194495584e4d0ecd2d75088b07afd86eb3bd8ac7512c59007e211543bef3
May 29 16:57:35.879110 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.879028    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5shl2\" (UniqueName: \"kubernetes.io/projected/e96595bd-d108-49cb-bdca-f28c7bb74491-kube-api-access-5shl2\") pod \"network-check-source-56d84b9f44-b5nnj\" (UID: \"e96595bd-d108-49cb-bdca-f28c7bb74491\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"
May 29 16:57:35.888395 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.888354    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shl2\" (UniqueName: \"kubernetes.io/projected/e96595bd-d108-49cb-bdca-f28c7bb74491-kube-api-access-5shl2\") pod \"network-check-source-56d84b9f44-b5nnj\" (UID: \"e96595bd-d108-49cb-bdca-f28c7bb74491\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"
May 29 16:57:35.962664 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:35.962630    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"
May 29 16:57:36.074928 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.074897    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj"]
May 29 16:57:36.077465 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:36.077440    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96595bd_d108_49cb_bdca_f28c7bb74491.slice/crio-238eaae1e89f9e9cb94a2c1c41aa49e430c0a90d6cab65eb51f683d3be8efd14 WatchSource:0}: Error finding container 238eaae1e89f9e9cb94a2c1c41aa49e430c0a90d6cab65eb51f683d3be8efd14: Status 404 returned error can't find the container with id 238eaae1e89f9e9cb94a2c1c41aa49e430c0a90d6cab65eb51f683d3be8efd14
May 29 16:57:36.310443 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.310417    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:57:36.310590 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.310417    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:57:36.313158 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.313133    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 16:57:36.313277 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.313193    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fng4t\""
May 29 16:57:36.313277 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.313261    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gvkkc\""
May 29 16:57:36.382955 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.382935    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:36.383460 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.382966    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:36.383460 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.383068    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 16:57:36.383460 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.383068    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 29 16:57:36.383460 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.383157    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls podName:72202cdd-3c3e-408e-ba40-6620c2697719 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:38.38313894 +0000 UTC m=+37.671930422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls") pod "dns-default-kqdxd" (UID: "72202cdd-3c3e-408e-ba40-6620c2697719") : secret "dns-default-metrics-tls" not found
May 29 16:57:36.383460 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.383227    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls podName:c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:38.3832117 +0000 UTC m=+37.672003186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wnfnm" (UID: "c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5") : secret "insights-runtime-extractor-tls" not found
May 29 16:57:36.482000 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.481964    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="928dc0dc9271dadd17593e15e8d522fead5132d0bb791f811f2e22c083380379" exitCode=0
May 29 16:57:36.482191 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.482056    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"928dc0dc9271dadd17593e15e8d522fead5132d0bb791f811f2e22c083380379"}
May 29 16:57:36.483389 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.483230    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:36.483389 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.483338    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 16:57:36.483508 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:36.483400    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert podName:c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:38.483379253 +0000 UTC m=+37.772170738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert") pod "ingress-canary-vmm9p" (UID: "c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47") : secret "canary-serving-cert" not found
May 29 16:57:36.483508 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.483482    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj" event={"ID":"e96595bd-d108-49cb-bdca-f28c7bb74491","Type":"ContainerStarted","Data":"238eaae1e89f9e9cb94a2c1c41aa49e430c0a90d6cab65eb51f683d3be8efd14"}
May 29 16:57:36.484646 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:36.484624    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc" event={"ID":"9cf68903-3db2-422f-97c5-40c06c42a37c","Type":"ContainerStarted","Data":"9d44194495584e4d0ecd2d75088b07afd86eb3bd8ac7512c59007e211543bef3"}
May 29 16:57:37.488607 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:37.488581    2564 generic.go:358] "Generic (PLEG): container finished" podID="f1383b6f-d930-4d19-999c-41339e2b8d70" containerID="d8705070bb1aae1b37531dea0a5be15d2a71f201b66dbe06afd9233cfc61c2af" exitCode=0
May 29 16:57:37.489035 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:37.488632    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerDied","Data":"d8705070bb1aae1b37531dea0a5be15d2a71f201b66dbe06afd9233cfc61c2af"}
May 29 16:57:38.402192 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.401976    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:38.402353 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.402222    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:38.402353 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.402168    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 16:57:38.402353 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.402327    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls podName:72202cdd-3c3e-408e-ba40-6620c2697719 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:42.402310777 +0000 UTC m=+41.691102260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls") pod "dns-default-kqdxd" (UID: "72202cdd-3c3e-408e-ba40-6620c2697719") : secret "dns-default-metrics-tls" not found
May 29 16:57:38.402501 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.402371    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 29 16:57:38.402501 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.402424    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls podName:c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:42.402407682 +0000 UTC m=+41.691199200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wnfnm" (UID: "c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5") : secret "insights-runtime-extractor-tls" not found
May 29 16:57:38.494320 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.494238    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4454q" event={"ID":"f1383b6f-d930-4d19-999c-41339e2b8d70","Type":"ContainerStarted","Data":"fc86085bc5df0dfb6699fbefe1ff462a2829f260cfdf47d9feeffc06fea4a41d"}
May 29 16:57:38.495947 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.495917    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc" event={"ID":"9cf68903-3db2-422f-97c5-40c06c42a37c","Type":"ContainerStarted","Data":"bb4a5271eb138efe8967beba7e4596dc362ff0b199d7bbe7ea0810d6443e6e8f"}
May 29 16:57:38.496081 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.495954    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc" event={"ID":"9cf68903-3db2-422f-97c5-40c06c42a37c","Type":"ContainerStarted","Data":"5b1aeea4be2f5934046c518d12d583fe9106c2222dd4f8d1cc1a300e6f5a3eb8"}
May 29 16:57:38.503562 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.503536    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:38.503669 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.503653    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 16:57:38.503737 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:38.503725    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert podName:c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:42.503706689 +0000 UTC m=+41.792498174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert") pod "ingress-canary-vmm9p" (UID: "c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47") : secret "canary-serving-cert" not found
May 29 16:57:38.518751 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.518703    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4454q" podStartSLOduration=5.996765837 podStartE2EDuration="37.518691312s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:57:03.917110481 +0000 UTC m=+3.205901963" lastFinishedPulling="2026-05-29 16:57:35.439035956 +0000 UTC m=+34.727827438" observedRunningTime="2026-05-29 16:57:38.517400517 +0000 UTC m=+37.806192062" watchObservedRunningTime="2026-05-29 16:57:38.518691312 +0000 UTC m=+37.807482817"
May 29 16:57:38.532710 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.532665    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-qrhpc" podStartSLOduration=1.860547025 podStartE2EDuration="3.532651037s" podCreationTimestamp="2026-05-29 16:57:35 +0000 UTC" firstStartedPulling="2026-05-29 16:57:35.803953452 +0000 UTC m=+35.092744934" lastFinishedPulling="2026-05-29 16:57:37.476057336 +0000 UTC m=+36.764848946" observedRunningTime="2026-05-29 16:57:38.53204599 +0000 UTC m=+37.820837495" watchObservedRunningTime="2026-05-29 16:57:38.532651037 +0000 UTC m=+37.821442541"
May 29 16:57:38.709256 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.709186    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-k4qk9"]
May 29 16:57:38.723146 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.723118    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-k4qk9"]
May 29 16:57:38.723321 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.723262    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.726878 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.726473    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 29 16:57:38.726878 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.726525    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-swqt9\""
May 29 16:57:38.726878 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.726542    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 29 16:57:38.726878 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.726599    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 29 16:57:38.727154 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.726888    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 29 16:57:38.806474 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.806443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-key\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.806621 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.806576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9qj\" (UniqueName: \"kubernetes.io/projected/ebaee03f-3545-426c-95cb-a522ae5cac51-kube-api-access-gq9qj\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.806685 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.806633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-cabundle\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.907883 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.907847    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9qj\" (UniqueName: \"kubernetes.io/projected/ebaee03f-3545-426c-95cb-a522ae5cac51-kube-api-access-gq9qj\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.908041 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.907930    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-cabundle\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.908041 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.907993    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-key\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.908721 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.908699    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-cabundle\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.911908 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.911884    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebaee03f-3545-426c-95cb-a522ae5cac51-signing-key\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:38.917679 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:38.917657    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9qj\" (UniqueName: \"kubernetes.io/projected/ebaee03f-3545-426c-95cb-a522ae5cac51-kube-api-access-gq9qj\") pod \"service-ca-685df94d57-k4qk9\" (UID: \"ebaee03f-3545-426c-95cb-a522ae5cac51\") " pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:39.035408 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:39.035375    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-k4qk9"
May 29 16:57:39.444149 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:39.444118    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-k4qk9"]
May 29 16:57:39.549472 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:39.549444    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaee03f_3545_426c_95cb_a522ae5cac51.slice/crio-952d72b954b9787d9e8b70badcb8dfdb93e57b2ad1858409b76a68bb462bbdfd WatchSource:0}: Error finding container 952d72b954b9787d9e8b70badcb8dfdb93e57b2ad1858409b76a68bb462bbdfd: Status 404 returned error can't find the container with id 952d72b954b9787d9e8b70badcb8dfdb93e57b2ad1858409b76a68bb462bbdfd
May 29 16:57:40.501691 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:40.501455    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj" event={"ID":"e96595bd-d108-49cb-bdca-f28c7bb74491","Type":"ContainerStarted","Data":"1dd47d24676aa7188e8d9ec2df698d049d10e193951aeeb54c10f1f67f500e55"}
May 29 16:57:40.502654 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:40.502619    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-k4qk9" event={"ID":"ebaee03f-3545-426c-95cb-a522ae5cac51","Type":"ContainerStarted","Data":"952d72b954b9787d9e8b70badcb8dfdb93e57b2ad1858409b76a68bb462bbdfd"}
May 29 16:57:40.519208 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:40.519144    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-b5nnj" podStartSLOduration=2.023023687 podStartE2EDuration="5.519131132s" podCreationTimestamp="2026-05-29 16:57:35 +0000 UTC" firstStartedPulling="2026-05-29 16:57:36.079268407 +0000 UTC m=+35.368059893" lastFinishedPulling="2026-05-29 16:57:39.575375842 +0000 UTC m=+38.864167338" observedRunningTime="2026-05-29 16:57:40.518684492 +0000 UTC m=+39.807475994" watchObservedRunningTime="2026-05-29 16:57:40.519131132 +0000 UTC m=+39.807922635"
May 29 16:57:42.432956 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:42.432923    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:42.432956 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:42.432966    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:42.433355 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.433062    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 29 16:57:42.433355 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.433064    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 16:57:42.433355 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.433116    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls podName:c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:50.433101602 +0000 UTC m=+49.721893083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wnfnm" (UID: "c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5") : secret "insights-runtime-extractor-tls" not found
May 29 16:57:42.433355 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.433128    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls podName:72202cdd-3c3e-408e-ba40-6620c2697719 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:50.433122178 +0000 UTC m=+49.721913660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls") pod "dns-default-kqdxd" (UID: "72202cdd-3c3e-408e-ba40-6620c2697719") : secret "dns-default-metrics-tls" not found
May 29 16:57:42.507136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:42.507106    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-k4qk9" event={"ID":"ebaee03f-3545-426c-95cb-a522ae5cac51","Type":"ContainerStarted","Data":"042b8cb70f403ae0748299c90344d391752e02311bc2efdbcbb5145bc4990983"}
May 29 16:57:42.526635 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:42.526595    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-k4qk9" podStartSLOduration=2.395470529 podStartE2EDuration="4.526582927s" podCreationTimestamp="2026-05-29 16:57:38 +0000 UTC" firstStartedPulling="2026-05-29 16:57:39.564719086 +0000 UTC m=+38.853510568" lastFinishedPulling="2026-05-29 16:57:41.69583147 +0000 UTC m=+40.984622966" observedRunningTime="2026-05-29 16:57:42.525814436 +0000 UTC m=+41.814605943" watchObservedRunningTime="2026-05-29 16:57:42.526582927 +0000 UTC m=+41.815374430"
May 29 16:57:42.534168 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:42.534145    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:42.534288 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.534272    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 16:57:42.534329 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:57:42.534324    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert podName:c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:50.534311691 +0000 UTC m=+49.823103178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert") pod "ingress-canary-vmm9p" (UID: "c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47") : secret "canary-serving-cert" not found
May 29 16:57:50.497054 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.497016    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:50.497675 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.497188    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:50.500143 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.500122    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72202cdd-3c3e-408e-ba40-6620c2697719-metrics-tls\") pod \"dns-default-kqdxd\" (UID: \"72202cdd-3c3e-408e-ba40-6620c2697719\") " pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:50.500143 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.500136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnfnm\" (UID: \"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5\") " pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:50.596516 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.596479    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:50.598326 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.598299    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:50.600598 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.600577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47-cert\") pod \"ingress-canary-vmm9p\" (UID: \"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47\") " pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:50.608713 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.608689    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnfnm"
May 29 16:57:50.624431 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.624399    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vmm9p"
May 29 16:57:50.759071 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.758987    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqdxd"]
May 29 16:57:50.767370 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.767347    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnfnm"]
May 29 16:57:50.770248 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:50.770213    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a0b66d_c3b0_4ec1_91ae_ac03affbcbf5.slice/crio-b7d662117debec0b09e81e809ed9efa811dc29d18ae8b45364182e3ab05225ff WatchSource:0}: Error finding container b7d662117debec0b09e81e809ed9efa811dc29d18ae8b45364182e3ab05225ff: Status 404 returned error can't find the container with id b7d662117debec0b09e81e809ed9efa811dc29d18ae8b45364182e3ab05225ff
May 29 16:57:50.779470 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:50.779447    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vmm9p"]
May 29 16:57:50.782309 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:57:50.782287    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0947d5d_7b57_447d_9bf9_7c0fc1b1cb47.slice/crio-7254b7d1d3c9b5cb93379f8175fc40deacf4b775818f62d73455abada28cdfda WatchSource:0}: Error finding container 7254b7d1d3c9b5cb93379f8175fc40deacf4b775818f62d73455abada28cdfda: Status 404 returned error can't find the container with id 7254b7d1d3c9b5cb93379f8175fc40deacf4b775818f62d73455abada28cdfda
May 29 16:57:51.527052 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:51.527011    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnfnm" event={"ID":"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5","Type":"ContainerStarted","Data":"2928b4c5568214d5b7cd62e449a0b7de60c2a6b16752bee852dad9ad02317310"}
May 29 16:57:51.527492 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:51.527058    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnfnm" event={"ID":"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5","Type":"ContainerStarted","Data":"b7d662117debec0b09e81e809ed9efa811dc29d18ae8b45364182e3ab05225ff"}
May 29 16:57:51.528435 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:51.528401    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vmm9p" event={"ID":"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47","Type":"ContainerStarted","Data":"7254b7d1d3c9b5cb93379f8175fc40deacf4b775818f62d73455abada28cdfda"}
May 29 16:57:51.529559 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:51.529535    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqdxd" event={"ID":"72202cdd-3c3e-408e-ba40-6620c2697719","Type":"ContainerStarted","Data":"ee5642de784c2e73eaf20c2222843f9aa1569349b5c8d5a7da267e4632e968e4"}
May 29 16:57:53.535679 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:53.535609    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnfnm" event={"ID":"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5","Type":"ContainerStarted","Data":"86b3e845c922300d0f9e87c0062fc729ff16403fc40e2de0bf01fe3180a0339b"}
May 29 16:57:53.536895 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:53.536872    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqdxd" event={"ID":"72202cdd-3c3e-408e-ba40-6620c2697719","Type":"ContainerStarted","Data":"ccb94919922277bc7f8a576affe701022a7f10e1c241b18f9586e2ff147ce66d"}
May 29 16:57:54.541298 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:54.541259    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vmm9p" event={"ID":"c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47","Type":"ContainerStarted","Data":"80fd5126455fd775391b9f7b5753b4dafd6e656f0679c2e2a3acc1a919d12193"}
May 29 16:57:54.543088 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:54.543062    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqdxd" event={"ID":"72202cdd-3c3e-408e-ba40-6620c2697719","Type":"ContainerStarted","Data":"72f9edd6b651a80453de167b2dad265f630c058bd83d019161d5fc4c53e75092"}
May 29 16:57:54.543224 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:54.543179    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kqdxd"
May 29 16:57:54.557228 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:54.557179    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vmm9p" podStartSLOduration=17.762050605 podStartE2EDuration="20.557166402s" podCreationTimestamp="2026-05-29 16:57:34 +0000 UTC" firstStartedPulling="2026-05-29 16:57:50.783878708 +0000 UTC m=+50.072670191" lastFinishedPulling="2026-05-29 16:57:53.578994507 +0000 UTC m=+52.867785988" observedRunningTime="2026-05-29 16:57:54.556059362 +0000 UTC m=+53.844850867" watchObservedRunningTime="2026-05-29 16:57:54.557166402 +0000 UTC m=+53.845957906"
May 29 16:57:54.572596 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:54.572553    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kqdxd" podStartSLOduration=18.111809494 podStartE2EDuration="20.572541884s" podCreationTimestamp="2026-05-29 16:57:34 +0000 UTC" firstStartedPulling="2026-05-29 16:57:50.763672818 +0000 UTC m=+50.052464299" lastFinishedPulling="2026-05-29 16:57:53.224405208 +0000 UTC m=+52.513196689" observedRunningTime="2026-05-29 16:57:54.57194466 +0000 UTC m=+53.860736165" watchObservedRunningTime="2026-05-29 16:57:54.572541884 +0000 UTC m=+53.861333388"
May 29 16:57:55.547235 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:55.547206    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnfnm" event={"ID":"c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5","Type":"ContainerStarted","Data":"0e75cf00cce7c96fdbb247dc9304db38f7c0b525925275d43748f329f758a728"}
May 29 16:57:56.570207 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:56.570158    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wnfnm" podStartSLOduration=18.060230071 podStartE2EDuration="22.570143281s" podCreationTimestamp="2026-05-29 16:57:34 +0000 UTC" firstStartedPulling="2026-05-29 16:57:50.921137585 +0000 UTC m=+50.209929066" lastFinishedPulling="2026-05-29 16:57:55.431050795 +0000 UTC m=+54.719842276" observedRunningTime="2026-05-29 16:57:56.568814383 +0000 UTC m=+55.857605900" watchObservedRunningTime="2026-05-29 16:57:56.570143281 +0000 UTC m=+55.858934794"
May 29 16:57:59.475949 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:57:59.475920    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpcnk"
May 29 16:58:04.549989 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:04.549959    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kqdxd"
May 29 16:58:07.016507 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.016475    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:58:07.019218 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.019200    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 16:58:07.029405 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.029382    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea16f49-88cb-4987-ba18-a6c3c534282a-metrics-certs\") pod \"network-metrics-daemon-tnvp5\" (UID: \"4ea16f49-88cb-4987-ba18-a6c3c534282a\") " pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:58:07.117343 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.117313    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:58:07.119770 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.119740    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgk6\" (UniqueName: \"kubernetes.io/projected/766ab962-d470-4853-82bb-d065c29e62ed-kube-api-access-kxgk6\") pod \"network-check-target-zxzjd\" (UID: \"766ab962-d470-4853-82bb-d065c29e62ed\") " pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:58:07.222555 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.222533    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fng4t\""
May 29 16:58:07.226990 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.226971    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gvkkc\""
May 29 16:58:07.230985 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.230972    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnvp5"
May 29 16:58:07.235103 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.235089    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:58:07.362419 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.362390    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tnvp5"]
May 29 16:58:07.365076 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:07.365045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea16f49_88cb_4987_ba18_a6c3c534282a.slice/crio-16644677bb57f5ae5fa889fe4ec7877eac6a815c78a1ef5b344481a398864645 WatchSource:0}: Error finding container 16644677bb57f5ae5fa889fe4ec7877eac6a815c78a1ef5b344481a398864645: Status 404 returned error can't find the container with id 16644677bb57f5ae5fa889fe4ec7877eac6a815c78a1ef5b344481a398864645
May 29 16:58:07.378595 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.378570    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxzjd"]
May 29 16:58:07.380967 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:07.380945    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766ab962_d470_4853_82bb_d065c29e62ed.slice/crio-69bf22fa087f783fe76e06e7612a280061a1281ad86e1fd8d5ec069cb2280500 WatchSource:0}: Error finding container 69bf22fa087f783fe76e06e7612a280061a1281ad86e1fd8d5ec069cb2280500: Status 404 returned error can't find the container with id 69bf22fa087f783fe76e06e7612a280061a1281ad86e1fd8d5ec069cb2280500
May 29 16:58:07.577567 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.577527    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxzjd" event={"ID":"766ab962-d470-4853-82bb-d065c29e62ed","Type":"ContainerStarted","Data":"979b252f4a5461219028cd31a1dcf3cee649ea515be304343e99c24a0fb13a38"}
May 29 16:58:07.577567 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.577569    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxzjd" event={"ID":"766ab962-d470-4853-82bb-d065c29e62ed","Type":"ContainerStarted","Data":"69bf22fa087f783fe76e06e7612a280061a1281ad86e1fd8d5ec069cb2280500"}
May 29 16:58:07.577779 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.577652    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:58:07.578631 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:07.578605    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnvp5" event={"ID":"4ea16f49-88cb-4987-ba18-a6c3c534282a","Type":"ContainerStarted","Data":"16644677bb57f5ae5fa889fe4ec7877eac6a815c78a1ef5b344481a398864645"}
May 29 16:58:08.582938 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:08.582852    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnvp5" event={"ID":"4ea16f49-88cb-4987-ba18-a6c3c534282a","Type":"ContainerStarted","Data":"74609333ddc35b454c9c031233d1b6a9f171cf2f4667d3471d15446f833e414f"}
May 29 16:58:08.582938 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:08.582892    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnvp5" event={"ID":"4ea16f49-88cb-4987-ba18-a6c3c534282a","Type":"ContainerStarted","Data":"d31927c1a2cb74e49148c4fe858992162ccdca6cca5df7c42ba130b40e80f190"}
May 29 16:58:08.599450 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:08.599373    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tnvp5" podStartSLOduration=66.659538321 podStartE2EDuration="1m7.599356943s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="2026-05-29 16:58:07.366686965 +0000 UTC m=+66.655478451" lastFinishedPulling="2026-05-29 16:58:08.306505589 +0000 UTC m=+67.595297073" observedRunningTime="2026-05-29 16:58:08.598941446 +0000 UTC m=+67.887732951" watchObservedRunningTime="2026-05-29 16:58:08.599356943 +0000 UTC m=+67.888148439"
May 29 16:58:08.599737 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:08.599713    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zxzjd" podStartSLOduration=67.599707771 podStartE2EDuration="1m7.599707771s" podCreationTimestamp="2026-05-29 16:57:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:58:07.592299279 +0000 UTC m=+66.881090779" watchObservedRunningTime="2026-05-29 16:58:08.599707771 +0000 UTC m=+67.888499275"
May 29 16:58:16.188189 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.188155    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-xdmsn"]
May 29 16:58:16.191537 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.191521    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:16.194127 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.194094    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 16:58:16.194343 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.194328    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 16:58:16.194440 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.194425    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gvqhf\""
May 29 16:58:16.199548 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.199526    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-xdmsn"]
May 29 16:58:16.277956 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.277929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j48f\" (UniqueName: \"kubernetes.io/projected/55909d0e-c658-41f4-9be2-88b9a875fe2e-kube-api-access-2j48f\") pod \"downloads-c65b8dc4b-xdmsn\" (UID: \"55909d0e-c658-41f4-9be2-88b9a875fe2e\") " pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:16.379140 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.379111    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48f\" (UniqueName: \"kubernetes.io/projected/55909d0e-c658-41f4-9be2-88b9a875fe2e-kube-api-access-2j48f\") pod \"downloads-c65b8dc4b-xdmsn\" (UID: \"55909d0e-c658-41f4-9be2-88b9a875fe2e\") " pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:16.387783 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.387754    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j48f\" (UniqueName: \"kubernetes.io/projected/55909d0e-c658-41f4-9be2-88b9a875fe2e-kube-api-access-2j48f\") pod \"downloads-c65b8dc4b-xdmsn\" (UID: \"55909d0e-c658-41f4-9be2-88b9a875fe2e\") " pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:16.501667 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.501585    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:16.625852 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:16.625810    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-xdmsn"]
May 29 16:58:16.628221 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:16.628184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55909d0e_c658_41f4_9be2_88b9a875fe2e.slice/crio-cceae52ff075b65d4409175909d80a05e88ed6feb9245353d5b91567dd100ffb WatchSource:0}: Error finding container cceae52ff075b65d4409175909d80a05e88ed6feb9245353d5b91567dd100ffb: Status 404 returned error can't find the container with id cceae52ff075b65d4409175909d80a05e88ed6feb9245353d5b91567dd100ffb
May 29 16:58:17.606983 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:17.606943    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-xdmsn" event={"ID":"55909d0e-c658-41f4-9be2-88b9a875fe2e","Type":"ContainerStarted","Data":"cceae52ff075b65d4409175909d80a05e88ed6feb9245353d5b91567dd100ffb"}
May 29 16:58:23.586599 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.586555    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"]
May 29 16:58:23.590655 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.590635    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:23.593564 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.593542    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 29 16:58:23.593697 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.593599    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t4bz6\""
May 29 16:58:23.602122 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.602101    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"]
May 29 16:58:23.628060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.628022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vqjpb\" (UID: \"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:23.728612 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:23.728576    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vqjpb\" (UID: \"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:23.728799 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:23.728702    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 29 16:58:23.728899 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:23.728802    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates podName:b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c nodeName:}" failed. No retries permitted until 2026-05-29 16:58:24.228778963 +0000 UTC m=+83.517570459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-vqjpb" (UID: "b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c") : secret "prometheus-operator-admission-webhook-tls" not found
May 29 16:58:24.233295 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.233270    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vqjpb\" (UID: \"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:24.235617 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.235588    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vqjpb\" (UID: \"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:24.502372 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.502278    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:24.510584 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.509947    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:58:24.515061 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.515000    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.518092 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.518071    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 16:58:24.518939 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.518408    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 16:58:24.518939 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.518428    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 16:58:24.518939 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.518493    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:58:24.518939 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.518647    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 16:58:24.519279 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.519192    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5lnvn\""
May 29 16:58:24.519379 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.519192    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 16:58:24.636574 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.636574 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.637010 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhb6\" (UniqueName: \"kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.637010 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.637010 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.637010 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.636708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.642367 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.642347    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"]
May 29 16:58:24.644978 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:24.644952    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24dd6a6_e1a1_4fa7_a63c_6ced2c025f5c.slice/crio-51eb3457eda1082e29048e9e009a6b9581ec3aa74cdc4131c8a656d532e08a91 WatchSource:0}: Error finding container 51eb3457eda1082e29048e9e009a6b9581ec3aa74cdc4131c8a656d532e08a91: Status 404 returned error can't find the container with id 51eb3457eda1082e29048e9e009a6b9581ec3aa74cdc4131c8a656d532e08a91
May 29 16:58:24.737393 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhb6\" (UniqueName: \"kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.737575 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737411    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.737575 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737438    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.737575 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737466    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.737575 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737519    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.737575 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.737554    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.738362 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.738307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.738490 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.738468    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.738560 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.738473    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.740132 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.740107    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.740443 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.740421    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.748041 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.748018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhb6\" (UniqueName: \"kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6\") pod \"console-5fb7fc7779-qcq5b\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") " pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.837937 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.837878    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:24.974009 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:24.973976    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:58:24.977107 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:24.977077    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c504d14_877f_4eed_b50e_958d9e6264d4.slice/crio-d93983da7eec828b3247a9db9125d8211a81ffc2fe466adc1bfbc20b003b8a19 WatchSource:0}: Error finding container d93983da7eec828b3247a9db9125d8211a81ffc2fe466adc1bfbc20b003b8a19: Status 404 returned error can't find the container with id d93983da7eec828b3247a9db9125d8211a81ffc2fe466adc1bfbc20b003b8a19
May 29 16:58:25.630853 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:25.630798    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb" event={"ID":"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c","Type":"ContainerStarted","Data":"51eb3457eda1082e29048e9e009a6b9581ec3aa74cdc4131c8a656d532e08a91"}
May 29 16:58:25.632881 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:25.632843    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb7fc7779-qcq5b" event={"ID":"5c504d14-877f-4eed-b50e-958d9e6264d4","Type":"ContainerStarted","Data":"d93983da7eec828b3247a9db9125d8211a81ffc2fe466adc1bfbc20b003b8a19"}
May 29 16:58:26.637725 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:26.637682    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb" event={"ID":"b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c","Type":"ContainerStarted","Data":"d179f8dbd680c9f0ec1c146417a339dc15ea49a30dd8b939a01f610e4a0dddef"}
May 29 16:58:26.638227 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:26.637962    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:26.643349 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:26.643319    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb"
May 29 16:58:26.656220 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:26.656175    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vqjpb" podStartSLOduration=2.170319385 podStartE2EDuration="3.656157428s" podCreationTimestamp="2026-05-29 16:58:23 +0000 UTC" firstStartedPulling="2026-05-29 16:58:24.647393065 +0000 UTC m=+83.936184562" lastFinishedPulling="2026-05-29 16:58:26.133231109 +0000 UTC m=+85.422022605" observedRunningTime="2026-05-29 16:58:26.655280098 +0000 UTC m=+85.944071603" watchObservedRunningTime="2026-05-29 16:58:26.656157428 +0000 UTC m=+85.944948931"
May 29 16:58:27.643581 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.643537    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-446js"]
May 29 16:58:27.646512 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.646493    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.649556 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.649533    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 16:58:27.649681 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.649533    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 16:58:27.651073 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.651051    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 29 16:58:27.651192 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.651054    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 16:58:27.651192 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.651093    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 29 16:58:27.651192 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.651061    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mv285\""
May 29 16:58:27.654795 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.654766    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-446js"]
May 29 16:58:27.762954 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.762908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.763136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.763018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.763136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.763059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28hq\" (UniqueName: \"kubernetes.io/projected/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-kube-api-access-s28hq\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.763136 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.763114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.864229 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.864195    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s28hq\" (UniqueName: \"kubernetes.io/projected/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-kube-api-access-s28hq\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.864229 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.864239    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.864478 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.864264    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.864478 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.864313    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.864478 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:27.864382    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 29 16:58:27.864478 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:27.864467    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls podName:ae2760b4-90d4-4cd5-9ed5-0436bbf2f015 nodeName:}" failed. No retries permitted until 2026-05-29 16:58:28.364445257 +0000 UTC m=+87.653236744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-446js" (UID: "ae2760b4-90d4-4cd5-9ed5-0436bbf2f015") : secret "prometheus-operator-tls" not found
May 29 16:58:27.865044 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.865019    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.866966 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.866940    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:27.872975 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:27.872950    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28hq\" (UniqueName: \"kubernetes.io/projected/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-kube-api-access-s28hq\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:28.368362 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:28.368314    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:28.371052 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:28.371027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2760b4-90d4-4cd5-9ed5-0436bbf2f015-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-446js\" (UID: \"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:28.557397 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:28.557355    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js"
May 29 16:58:34.769373 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:34.769342    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-446js"]
May 29 16:58:34.772044 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:34.772017    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2760b4_90d4_4cd5_9ed5_0436bbf2f015.slice/crio-2a71f36202dd801cdfa11ac8cac88e95520f90f928850a23f59731cfea9117b0 WatchSource:0}: Error finding container 2a71f36202dd801cdfa11ac8cac88e95520f90f928850a23f59731cfea9117b0: Status 404 returned error can't find the container with id 2a71f36202dd801cdfa11ac8cac88e95520f90f928850a23f59731cfea9117b0
May 29 16:58:35.664501 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.664012    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb7fc7779-qcq5b" event={"ID":"5c504d14-877f-4eed-b50e-958d9e6264d4","Type":"ContainerStarted","Data":"bb36a089797909eb763686011962c2eea32eecf6e1d13838cdd12816c72153d5"}
May 29 16:58:35.665867 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.665834    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js" event={"ID":"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015","Type":"ContainerStarted","Data":"2a71f36202dd801cdfa11ac8cac88e95520f90f928850a23f59731cfea9117b0"}
May 29 16:58:35.668243 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.668202    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-xdmsn" event={"ID":"55909d0e-c658-41f4-9be2-88b9a875fe2e","Type":"ContainerStarted","Data":"49278521a6e3f18300d8ca71ebee080a19c596880890bdd05cf94fab04f65fea"}
May 29 16:58:35.668812 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.668769    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:35.681452 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.681282    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5fb7fc7779-qcq5b" podStartSLOduration=2.012967308 podStartE2EDuration="11.681265097s" podCreationTimestamp="2026-05-29 16:58:24 +0000 UTC" firstStartedPulling="2026-05-29 16:58:24.979329507 +0000 UTC m=+84.268120989" lastFinishedPulling="2026-05-29 16:58:34.647627287 +0000 UTC m=+93.936418778" observedRunningTime="2026-05-29 16:58:35.681158497 +0000 UTC m=+94.969950003" watchObservedRunningTime="2026-05-29 16:58:35.681265097 +0000 UTC m=+94.970056604"
May 29 16:58:35.683161 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.683124    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-xdmsn"
May 29 16:58:35.700756 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:35.700706    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-xdmsn" podStartSLOduration=1.640539515 podStartE2EDuration="19.700688441s" podCreationTimestamp="2026-05-29 16:58:16 +0000 UTC" firstStartedPulling="2026-05-29 16:58:16.629975154 +0000 UTC m=+75.918766641" lastFinishedPulling="2026-05-29 16:58:34.690124081 +0000 UTC m=+93.978915567" observedRunningTime="2026-05-29 16:58:35.700003208 +0000 UTC m=+94.988794716" watchObservedRunningTime="2026-05-29 16:58:35.700688441 +0000 UTC m=+94.989479948"
May 29 16:58:36.673057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:36.673019    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js" event={"ID":"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015","Type":"ContainerStarted","Data":"780d2002aa6842f1c567608e7a6dd33b8677558607986e0cbc233e0b94a82484"}
May 29 16:58:36.673057 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:36.673062    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js" event={"ID":"ae2760b4-90d4-4cd5-9ed5-0436bbf2f015","Type":"ContainerStarted","Data":"da3632f90d7b37742777d33c193bb1d9632095c4e08d01aa5bb3ce37782f88d7"}
May 29 16:58:36.689873 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:36.689806    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-446js" podStartSLOduration=8.36897998 podStartE2EDuration="9.689788822s" podCreationTimestamp="2026-05-29 16:58:27 +0000 UTC" firstStartedPulling="2026-05-29 16:58:34.774136159 +0000 UTC m=+94.062927645" lastFinishedPulling="2026-05-29 16:58:36.094945004 +0000 UTC m=+95.383736487" observedRunningTime="2026-05-29 16:58:36.688730337 +0000 UTC m=+95.977521842" watchObservedRunningTime="2026-05-29 16:58:36.689788822 +0000 UTC m=+95.978580373"
May 29 16:58:38.585677 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:38.585637    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zxzjd"
May 29 16:58:38.993724 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:38.993643    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-npslf"]
May 29 16:58:39.021940 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.021912    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.024897 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.024877    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 16:58:39.025249 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.025234    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 16:58:39.025770 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.025749    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dt92w\""
May 29 16:58:39.026348 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.026034    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 16:58:39.153460 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-sys\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn92n\" (UniqueName: \"kubernetes.io/projected/289785ab-73c8-496b-850a-558aa45cb4e8-kube-api-access-sn92n\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-metrics-client-ca\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-root\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153651 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-textfile\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153989 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-wtmp\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.153989 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.153710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.254338 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254250    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.254581 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254563    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-sys\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.254691 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254676    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.254799 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254787    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sn92n\" (UniqueName: \"kubernetes.io/projected/289785ab-73c8-496b-850a-558aa45cb4e8-kube-api-access-sn92n\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.254933 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254919    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255027 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255012    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-metrics-client-ca\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255119 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255106    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-root\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255213 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255201    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-textfile\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255307 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255296    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-wtmp\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255406 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.254873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-sys\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255500 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255468    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255630 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:39.255257    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 29 16:58:39.255630 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255513    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-root\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255630 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:39.255573    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls podName:289785ab-73c8-496b-850a-558aa45cb4e8 nodeName:}" failed. No retries permitted until 2026-05-29 16:58:39.755551203 +0000 UTC m=+99.044342704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls") pod "node-exporter-npslf" (UID: "289785ab-73c8-496b-850a-558aa45cb4e8") : secret "node-exporter-tls" not found
May 29 16:58:39.255796 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-wtmp\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255796 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255709    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/289785ab-73c8-496b-850a-558aa45cb4e8-metrics-client-ca\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.255935 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.255892    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-textfile\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.259624 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.259602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.267245 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.267221    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn92n\" (UniqueName: \"kubernetes.io/projected/289785ab-73c8-496b-850a-558aa45cb4e8-kube-api-access-sn92n\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.758933 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.758895    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.761679 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.761656    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/289785ab-73c8-496b-850a-558aa45cb4e8-node-exporter-tls\") pod \"node-exporter-npslf\" (UID: \"289785ab-73c8-496b-850a-558aa45cb4e8\") " pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.935699 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:39.935664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-npslf"
May 29 16:58:39.947002 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:39.946970    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289785ab_73c8_496b_850a_558aa45cb4e8.slice/crio-82d2696a8bd2c1a00e4a117203d27e8eb74c19c29b88c63aa3734dcb97fa3fe0 WatchSource:0}: Error finding container 82d2696a8bd2c1a00e4a117203d27e8eb74c19c29b88c63aa3734dcb97fa3fe0: Status 404 returned error can't find the container with id 82d2696a8bd2c1a00e4a117203d27e8eb74c19c29b88c63aa3734dcb97fa3fe0
May 29 16:58:40.056743 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.056702    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 16:58:40.083515 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.083479    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 16:58:40.083681 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.083664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.086623 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.086594    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 16:58:40.086763 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.086640    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 16:58:40.086763 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.086698    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9fpsb\""
May 29 16:58:40.086994 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.086974    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 16:58:40.087804 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.087769    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 16:58:40.087937 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.087916    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 16:58:40.088043 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.087985    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 16:58:40.088043 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.088004    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 16:58:40.088190 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.087921    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 16:58:40.088190 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.088137    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 16:58:40.161801 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.161763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.161995 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.161879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.161995 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.161927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.161995 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.161952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7tm\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162173 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162431 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162431 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162431 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.162431 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.162308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263454 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263414    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263633 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263467    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263633 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263498    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263633 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263522    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7tm\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263633 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263601    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263636    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263662    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: E0529 16:58:40.263726    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle podName:0c57c718-a8e1-4a6b-9f0e-9767c6464fea nodeName:}" failed. No retries permitted until 2026-05-29 16:58:40.763698845 +0000 UTC m=+100.052490341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea") : configmap references non-existent config key: ca-bundle.crt
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263762    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263813    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.263872 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263871    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.264170 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.264170 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.263947    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.264170 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.264019    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.264359 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.264328    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.267015 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.266992    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.267539 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.267167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.267539 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.267506    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.267893 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.267872    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.268382 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.268353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.268529 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.268487    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.269496 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.269459    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.269617 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.269594    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.282905 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.282881    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.293839 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.293801    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.312408 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.312345    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7tm\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.685219 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.685129    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-npslf" event={"ID":"289785ab-73c8-496b-850a-558aa45cb4e8","Type":"ContainerStarted","Data":"82d2696a8bd2c1a00e4a117203d27e8eb74c19c29b88c63aa3734dcb97fa3fe0"}
May 29 16:58:40.768915 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.768498    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.769656 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.769603    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:40.995903 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:40.995804    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 16:58:41.436193 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:41.436159    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 16:58:41.438232 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:41.438194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c57c718_a8e1_4a6b_9f0e_9767c6464fea.slice/crio-1e2825052b454db11d9badd698f6ce14dfff017af36e9e9684e7375cf8c1ba78 WatchSource:0}: Error finding container 1e2825052b454db11d9badd698f6ce14dfff017af36e9e9684e7375cf8c1ba78: Status 404 returned error can't find the container with id 1e2825052b454db11d9badd698f6ce14dfff017af36e9e9684e7375cf8c1ba78
May 29 16:58:41.689358 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:41.689314    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"1e2825052b454db11d9badd698f6ce14dfff017af36e9e9684e7375cf8c1ba78"}
May 29 16:58:42.694267 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:42.694229    2564 generic.go:358] "Generic (PLEG): container finished" podID="289785ab-73c8-496b-850a-558aa45cb4e8" containerID="f84b442b4aceaab5e796ee758403619aabee741d77a026124b8cbadb19ca803b" exitCode=0
May 29 16:58:42.694749 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:42.694272    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-npslf" event={"ID":"289785ab-73c8-496b-850a-558aa45cb4e8","Type":"ContainerDied","Data":"f84b442b4aceaab5e796ee758403619aabee741d77a026124b8cbadb19ca803b"}
May 29 16:58:43.406553 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.406519    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79d998c4cd-dp9b7"]
May 29 16:58:43.436947 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.436918    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79d998c4cd-dp9b7"]
May 29 16:58:43.437113 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.437033    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.440414 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.440386    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 29 16:58:43.440617 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.440591    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-k7ujepk0na7u\""
May 29 16:58:43.440901 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.440856    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xf2mv\""
May 29 16:58:43.441115 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.441099    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 29 16:58:43.441212 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.441138    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 29 16:58:43.441325 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.441302    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 29 16:58:43.570619 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.570585    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:58:43.595982 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.595895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-client-certs\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.595982 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.595937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1aa260c5-4bfb-4979-894b-e5bffd861831-audit-log\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.595982 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.595967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpm9\" (UniqueName: \"kubernetes.io/projected/1aa260c5-4bfb-4979-894b-e5bffd861831-kube-api-access-8fpm9\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.596206 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.596059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-metrics-server-audit-profiles\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.596206 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.596092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-client-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.596206 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.596117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.596206 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.596188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-tls\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.696542 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696510    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-metrics-server-audit-profiles\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696554    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-client-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696582    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696623    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-tls\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696662    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-client-certs\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696692    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1aa260c5-4bfb-4979-894b-e5bffd861831-audit-log\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697025 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.696717    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpm9\" (UniqueName: \"kubernetes.io/projected/1aa260c5-4bfb-4979-894b-e5bffd861831-kube-api-access-8fpm9\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697469 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.697419    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1aa260c5-4bfb-4979-894b-e5bffd861831-audit-log\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697569 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.697548    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.697648 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.697623    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1aa260c5-4bfb-4979-894b-e5bffd861831-metrics-server-audit-profiles\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.699381 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.699357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-client-ca-bundle\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.699585 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.699567    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-client-certs\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.699649 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.699626    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1aa260c5-4bfb-4979-894b-e5bffd861831-secret-metrics-server-tls\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.699991 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.699970    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-npslf" event={"ID":"289785ab-73c8-496b-850a-558aa45cb4e8","Type":"ContainerStarted","Data":"bb0cc99cfdbee36b2b4943ebd0c5ba2f1fd8abdb04a513f4cfe08caf4db8b5e3"}
May 29 16:58:43.700063 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.700001    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-npslf" event={"ID":"289785ab-73c8-496b-850a-558aa45cb4e8","Type":"ContainerStarted","Data":"6de358d946906ebe76cb66398d138bf4fcd97ab145e48e3a8691734ba1f0ceb5"}
May 29 16:58:43.701276 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.701253    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3" exitCode=0
May 29 16:58:43.701359 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.701288    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3"}
May 29 16:58:43.715143 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.715123    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpm9\" (UniqueName: \"kubernetes.io/projected/1aa260c5-4bfb-4979-894b-e5bffd861831-kube-api-access-8fpm9\") pod \"metrics-server-79d998c4cd-dp9b7\" (UID: \"1aa260c5-4bfb-4979-894b-e5bffd861831\") " pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.730129 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.730082    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-npslf" podStartSLOduration=3.938368625 podStartE2EDuration="5.730068834s" podCreationTimestamp="2026-05-29 16:58:38 +0000 UTC" firstStartedPulling="2026-05-29 16:58:39.949712394 +0000 UTC m=+99.238503881" lastFinishedPulling="2026-05-29 16:58:41.741412595 +0000 UTC m=+101.030204090" observedRunningTime="2026-05-29 16:58:43.728625311 +0000 UTC m=+103.017416815" watchObservedRunningTime="2026-05-29 16:58:43.730068834 +0000 UTC m=+103.018860337"
May 29 16:58:43.747164 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.747140    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:58:43.898279 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.898251    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79d998c4cd-dp9b7"]
May 29 16:58:43.899070 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:43.899045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa260c5_4bfb_4979_894b_e5bffd861831.slice/crio-ffeb688d97a3972c2afe021005ae66714cb2f8463183b9563ba5236567e080f7 WatchSource:0}: Error finding container ffeb688d97a3972c2afe021005ae66714cb2f8463183b9563ba5236567e080f7: Status 404 returned error can't find the container with id ffeb688d97a3972c2afe021005ae66714cb2f8463183b9563ba5236567e080f7
May 29 16:58:43.956142 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.956105    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"]
May 29 16:58:43.989030 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.988999    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"]
May 29 16:58:43.989178 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.989140    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:43.993552 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.993527    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 29 16:58:43.993695 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:43.993598    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-gtpl9\""
May 29 16:58:44.100366 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.100335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8cb47f36-5c33-4c4a-a33b-c57f80821195-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-d8j9t\" (UID: \"8cb47f36-5c33-4c4a-a33b-c57f80821195\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:44.201190 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.201103    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8cb47f36-5c33-4c4a-a33b-c57f80821195-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-d8j9t\" (UID: \"8cb47f36-5c33-4c4a-a33b-c57f80821195\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:44.203676 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.203646    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8cb47f36-5c33-4c4a-a33b-c57f80821195-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-d8j9t\" (UID: \"8cb47f36-5c33-4c4a-a33b-c57f80821195\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:44.211749 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.211723    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"]
May 29 16:58:44.232641 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.232615    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.233256 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.233234    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"]
May 29 16:58:44.235455 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.235430    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 29 16:58:44.235560 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.235443    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 29 16:58:44.235560 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.235516    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vkrqp\""
May 29 16:58:44.235851 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.235814    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 29 16:58:44.236033 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.236002    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 29 16:58:44.236307 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.236290    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 29 16:58:44.240886 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.240869    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 29 16:58:44.299913 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.299887    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:44.301731 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.301792 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.301792 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.301885 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-metrics-client-ca\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.301935 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-federate-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.301969 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rw4\" (UniqueName: \"kubernetes.io/projected/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-kube-api-access-l4rw4\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.302002 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.301971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.302059 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.302047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403440    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403497    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403530    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403557    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403587    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-metrics-client-ca\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-federate-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403673    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rw4\" (UniqueName: \"kubernetes.io/projected/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-kube-api-access-l4rw4\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.403701    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.404233    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.404497 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.404409    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-metrics-client-ca\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.405364 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.405334    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.407080 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.407054    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.407533 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.407496    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-federate-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.407653 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.407590    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-telemeter-client-tls\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.409619 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.409592    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-secret-telemeter-client\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.412189 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.412169    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rw4\" (UniqueName: \"kubernetes.io/projected/28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2-kube-api-access-l4rw4\") pod \"telemeter-client-5bcd779d6d-jhs7r\" (UID: \"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2\") " pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.433945 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.433888    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"]
May 29 16:58:44.437362 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:44.437330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb47f36_5c33_4c4a_a33b_c57f80821195.slice/crio-91cb4de593a57e4b7753fe3d7b8967220bad09523af270b84904365813179b51 WatchSource:0}: Error finding container 91cb4de593a57e4b7753fe3d7b8967220bad09523af270b84904365813179b51: Status 404 returned error can't find the container with id 91cb4de593a57e4b7753fe3d7b8967220bad09523af270b84904365813179b51
May 29 16:58:44.543078 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.542989    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"
May 29 16:58:44.698674 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.698645    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r"]
May 29 16:58:44.700391 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:44.700362    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28769c3e_e3bb_4dd9_a73e_c0d53aaa61b2.slice/crio-4a1c8ca9e047a03801555324aba37456eaa17bafe1ade945cb2c5450fb02db7f WatchSource:0}: Error finding container 4a1c8ca9e047a03801555324aba37456eaa17bafe1ade945cb2c5450fb02db7f: Status 404 returned error can't find the container with id 4a1c8ca9e047a03801555324aba37456eaa17bafe1ade945cb2c5450fb02db7f
May 29 16:58:44.712123 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.712089    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7" event={"ID":"1aa260c5-4bfb-4979-894b-e5bffd861831","Type":"ContainerStarted","Data":"ffeb688d97a3972c2afe021005ae66714cb2f8463183b9563ba5236567e080f7"}
May 29 16:58:44.713236 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.713202    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r" event={"ID":"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2","Type":"ContainerStarted","Data":"4a1c8ca9e047a03801555324aba37456eaa17bafe1ade945cb2c5450fb02db7f"}
May 29 16:58:44.714352 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.714321    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t" event={"ID":"8cb47f36-5c33-4c4a-a33b-c57f80821195","Type":"ContainerStarted","Data":"91cb4de593a57e4b7753fe3d7b8967220bad09523af270b84904365813179b51"}
May 29 16:58:44.838979 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:44.838948    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:58:47.727485 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.727403    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t" event={"ID":"8cb47f36-5c33-4c4a-a33b-c57f80821195","Type":"ContainerStarted","Data":"01ac435a9e504c34561f96a704c64486a07a5c1d7540ecf91073d6fc0065ad5d"}
May 29 16:58:47.727966 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.727522    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:47.730811 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.730783    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"}
May 29 16:58:47.730958 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.730814    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"}
May 29 16:58:47.730958 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.730851    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"}
May 29 16:58:47.730958 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.730863    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"}
May 29 16:58:47.730958 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.730875    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"}
May 29 16:58:47.732373 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.732352    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7" event={"ID":"1aa260c5-4bfb-4979-894b-e5bffd861831","Type":"ContainerStarted","Data":"ac85f00f33f6f829787ebc0d5f1818b81a75eee7a50b36bc9cefe4576e1905c3"}
May 29 16:58:47.733205 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.733182    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t"
May 29 16:58:47.744571 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.744538    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-d8j9t" podStartSLOduration=2.088403814 podStartE2EDuration="4.744525884s" podCreationTimestamp="2026-05-29 16:58:43 +0000 UTC" firstStartedPulling="2026-05-29 16:58:44.439377535 +0000 UTC m=+103.728169026" lastFinishedPulling="2026-05-29 16:58:47.0954996 +0000 UTC m=+106.384291096" observedRunningTime="2026-05-29 16:58:47.743896532 +0000 UTC m=+107.032688037" watchObservedRunningTime="2026-05-29 16:58:47.744525884 +0000 UTC m=+107.033317382"
May 29 16:58:47.763763 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:47.763725    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7" podStartSLOduration=1.572516982 podStartE2EDuration="4.763714109s" podCreationTimestamp="2026-05-29 16:58:43 +0000 UTC" firstStartedPulling="2026-05-29 16:58:43.900981046 +0000 UTC m=+103.189772528" lastFinishedPulling="2026-05-29 16:58:47.092178174 +0000 UTC m=+106.380969655" observedRunningTime="2026-05-29 16:58:47.76227809 +0000 UTC m=+107.051069594" watchObservedRunningTime="2026-05-29 16:58:47.763714109 +0000 UTC m=+107.052505612"
May 29 16:58:48.736163 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:48.736130    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r" event={"ID":"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2","Type":"ContainerStarted","Data":"5f8787966f7b85ef32cd5108078f80f744920608a15081516686aab35b888c71"}
May 29 16:58:49.740946 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:49.740850    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r" event={"ID":"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2","Type":"ContainerStarted","Data":"0921a5686c0f4169c86d03f8f517ec8924de65a4e03ba57c657c7369b41eeada"}
May 29 16:58:49.740946 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:49.740897    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r" event={"ID":"28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2","Type":"ContainerStarted","Data":"7a9e30ca6e40ee077e9c005852f9315741a2ca44afd617d9688372e908767ee1"}
May 29 16:58:49.743616 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:49.743583    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerStarted","Data":"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"}
May 29 16:58:49.763880 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:49.763840    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bcd779d6d-jhs7r" podStartSLOduration=1.896331337 podStartE2EDuration="5.763812727s" podCreationTimestamp="2026-05-29 16:58:44 +0000 UTC" firstStartedPulling="2026-05-29 16:58:44.70248983 +0000 UTC m=+103.991281313" lastFinishedPulling="2026-05-29 16:58:48.569971205 +0000 UTC m=+107.858762703" observedRunningTime="2026-05-29 16:58:49.762158815 +0000 UTC m=+109.050950331" watchObservedRunningTime="2026-05-29 16:58:49.763812727 +0000 UTC m=+109.052604230"
May 29 16:58:49.788832 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:49.788785    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.916177682 podStartE2EDuration="9.788773166s" podCreationTimestamp="2026-05-29 16:58:40 +0000 UTC" firstStartedPulling="2026-05-29 16:58:41.44054083 +0000 UTC m=+100.729332311" lastFinishedPulling="2026-05-29 16:58:49.313136301 +0000 UTC m=+108.601927795" observedRunningTime="2026-05-29 16:58:49.78750606 +0000 UTC m=+109.076297602" watchObservedRunningTime="2026-05-29 16:58:49.788773166 +0000 UTC m=+109.077564670"
May 29 16:58:50.675342 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.675308    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 16:58:50.697335 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.697310    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 16:58:50.697460 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.697414    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.706131 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.706098    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 16:58:50.862698 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.862990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjcj\" (UniqueName: \"kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.863155 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.863135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964532 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964460    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964532 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964498    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964532 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964526    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964549    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964586    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964609    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjcj\" (UniqueName: \"kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.964793 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.964647    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.965338 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.965311    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.965441 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.965363    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.965441 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.965363    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.965441 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.965417    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.966991 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.966959    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.967068 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.967037    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:50.973411 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:50.973392    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjcj\" (UniqueName: \"kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj\") pod \"console-557b8dbb78-nj49c\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") " pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:51.006796 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:51.006772    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:58:51.128223 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:51.128203    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 16:58:51.130959 ip-10-0-128-169 kubenswrapper[2564]: W0529 16:58:51.130921    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8469f1_8e8a_4008_ac89_00f08e68b995.slice/crio-87a146060382bd961de3d1953c9954a0eb484b9c4b9b99c4950c1fe8c6cfe6cf WatchSource:0}: Error finding container 87a146060382bd961de3d1953c9954a0eb484b9c4b9b99c4950c1fe8c6cfe6cf: Status 404 returned error can't find the container with id 87a146060382bd961de3d1953c9954a0eb484b9c4b9b99c4950c1fe8c6cfe6cf
May 29 16:58:51.754071 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:51.754038    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b8dbb78-nj49c" event={"ID":"9f8469f1-8e8a-4008-ac89-00f08e68b995","Type":"ContainerStarted","Data":"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"}
May 29 16:58:51.754071 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:51.754076    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b8dbb78-nj49c" event={"ID":"9f8469f1-8e8a-4008-ac89-00f08e68b995","Type":"ContainerStarted","Data":"87a146060382bd961de3d1953c9954a0eb484b9c4b9b99c4950c1fe8c6cfe6cf"}
May 29 16:58:51.774210 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:51.774169    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-557b8dbb78-nj49c" podStartSLOduration=1.77415559 podStartE2EDuration="1.77415559s" podCreationTimestamp="2026-05-29 16:58:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:58:51.773313554 +0000 UTC m=+111.062105071" watchObservedRunningTime="2026-05-29 16:58:51.77415559 +0000 UTC m=+111.062947093"
May 29 16:58:59.833323 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:58:59.833293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vmm9p_c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47/serve-healthcheck-canary/0.log"
May 29 16:59:01.006914 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:01.006873    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:59:01.006914 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:01.006918    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:59:01.011254 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:01.011234    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:59:01.786647 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:01.786621    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 16:59:03.748075 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:03.748033    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:59:03.748075 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:03.748080    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:59:08.590325 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.590109    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5fb7fc7779-qcq5b" podUID="5c504d14-877f-4eed-b50e-958d9e6264d4" containerName="console" containerID="cri-o://bb36a089797909eb763686011962c2eea32eecf6e1d13838cdd12816c72153d5" gracePeriod=15
May 29 16:59:08.806713 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.806690    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb7fc7779-qcq5b_5c504d14-877f-4eed-b50e-958d9e6264d4/console/0.log"
May 29 16:59:08.806859 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.806736    2564 generic.go:358] "Generic (PLEG): container finished" podID="5c504d14-877f-4eed-b50e-958d9e6264d4" containerID="bb36a089797909eb763686011962c2eea32eecf6e1d13838cdd12816c72153d5" exitCode=2
May 29 16:59:08.806952 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.806932    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb7fc7779-qcq5b" event={"ID":"5c504d14-877f-4eed-b50e-958d9e6264d4","Type":"ContainerDied","Data":"bb36a089797909eb763686011962c2eea32eecf6e1d13838cdd12816c72153d5"}
May 29 16:59:08.892361 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.892341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb7fc7779-qcq5b_5c504d14-877f-4eed-b50e-958d9e6264d4/console/0.log"
May 29 16:59:08.892467 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:08.892407    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:59:09.004206 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004170    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004374 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004260    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004374 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004297    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004374 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004322    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004374 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004355    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004579 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004400    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhhb6\" (UniqueName: \"kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6\") pod \"5c504d14-877f-4eed-b50e-958d9e6264d4\" (UID: \"5c504d14-877f-4eed-b50e-958d9e6264d4\") "
May 29 16:59:09.004652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004629    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 16:59:09.004711 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004687    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 16:59:09.004760 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.004738    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config" (OuterVolumeSpecName: "console-config") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 16:59:09.006591 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.006566    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6" (OuterVolumeSpecName: "kube-api-access-dhhb6") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "kube-api-access-dhhb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 16:59:09.006591 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.006576    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 16:59:09.006591 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.006588    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c504d14-877f-4eed-b50e-958d9e6264d4" (UID: "5c504d14-877f-4eed-b50e-958d9e6264d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 16:59:09.105141 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105114    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-service-ca\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.105141 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105142    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-oauth-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.105313 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105154    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-console-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.105313 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105164    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c504d14-877f-4eed-b50e-958d9e6264d4-console-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.105313 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105173    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhhb6\" (UniqueName: \"kubernetes.io/projected/5c504d14-877f-4eed-b50e-958d9e6264d4-kube-api-access-dhhb6\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.105313 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.105182    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c504d14-877f-4eed-b50e-958d9e6264d4-oauth-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 16:59:09.810351 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.810325    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb7fc7779-qcq5b_5c504d14-877f-4eed-b50e-958d9e6264d4/console/0.log"
May 29 16:59:09.810838 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.810379    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb7fc7779-qcq5b" event={"ID":"5c504d14-877f-4eed-b50e-958d9e6264d4","Type":"ContainerDied","Data":"d93983da7eec828b3247a9db9125d8211a81ffc2fe466adc1bfbc20b003b8a19"}
May 29 16:59:09.810838 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.810427    2564 scope.go:117] "RemoveContainer" containerID="bb36a089797909eb763686011962c2eea32eecf6e1d13838cdd12816c72153d5"
May 29 16:59:09.810838 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.810443    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb7fc7779-qcq5b"
May 29 16:59:09.828784 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.828760    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:59:09.832116 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:09.832092    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb7fc7779-qcq5b"]
May 29 16:59:11.323968 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:11.323929    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c504d14-877f-4eed-b50e-958d9e6264d4" path="/var/lib/kubelet/pods/5c504d14-877f-4eed-b50e-958d9e6264d4/volumes"
May 29 16:59:23.752935 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:23.752907    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:59:23.756652 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:23.756629    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79d998c4cd-dp9b7"
May 29 16:59:59.453052 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.452967    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453400    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="alertmanager" containerID="cri-o://16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f" gracePeriod=120
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453445    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-metric" containerID="cri-o://4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1" gracePeriod=120
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453504    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-web" containerID="cri-o://3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427" gracePeriod=120
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453524    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy" containerID="cri-o://00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771" gracePeriod=120
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453547    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="prom-label-proxy" containerID="cri-o://a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b" gracePeriod=120
May 29 16:59:59.453645 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.453547    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="config-reloader" containerID="cri-o://bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a" gracePeriod=120
May 29 16:59:59.960835 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960781    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b" exitCode=0
May 29 16:59:59.960835 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960813    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1" exitCode=0
May 29 16:59:59.960835 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960843    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771" exitCode=0
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960849    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a" exitCode=0
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960854    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f" exitCode=0
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960849    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"}
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960891    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"}
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960901    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"}
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960910    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"}
May 29 16:59:59.961060 ip-10-0-128-169 kubenswrapper[2564]: I0529 16:59:59.960921    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"}
May 29 17:00:00.699555 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.699528    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:00.814096 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814069    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814244 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814107    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814244 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814143    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814244 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814167    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814244 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814194    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814244 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814229    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814259    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt7tm\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814286    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814325    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814361    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814412    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814449    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814461    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814559 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814490    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets\") pod \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\" (UID: \"0c57c718-a8e1-4a6b-9f0e-9767c6464fea\") "
May 29 17:00:00.814979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814674    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:00.814979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.814727    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-main-db\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.815717 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.815408    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:00.817283 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.817243    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume" (OuterVolumeSpecName: "config-volume") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.817684 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.817655    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.817773 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.817679    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.818001 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.817977    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out" (OuterVolumeSpecName: "config-out") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:00:00.818173 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.818146    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm" (OuterVolumeSpecName: "kube-api-access-pt7tm") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "kube-api-access-pt7tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:00:00.818280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.818264    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.818651 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.818621    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.819202 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.819178    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:00:00.821774 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.821676    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.827652 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.827627    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config" (OuterVolumeSpecName: "web-config") pod "0c57c718-a8e1-4a6b-9f0e-9767c6464fea" (UID: "0c57c718-a8e1-4a6b-9f0e-9767c6464fea"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:00.916114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916066    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916110    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-main-tls\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916122    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916132    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-tls-assets\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916140    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-out\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916148    2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-config-volume\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916156    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916166    2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-cluster-tls-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916175    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-metrics-client-ca\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916184    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt7tm\" (UniqueName: \"kubernetes.io/projected/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-kube-api-access-pt7tm\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916192    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.916368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.916201    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c57c718-a8e1-4a6b-9f0e-9767c6464fea-web-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:00.965673 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.965641    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerID="3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427" exitCode=0
May 29 17:00:00.965794 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.965720    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"}
May 29 17:00:00.965794 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.965759    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c57c718-a8e1-4a6b-9f0e-9767c6464fea","Type":"ContainerDied","Data":"1e2825052b454db11d9badd698f6ce14dfff017af36e9e9684e7375cf8c1ba78"}
May 29 17:00:00.965794 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.965775    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:00.965905 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.965776    2564 scope.go:117] "RemoveContainer" containerID="a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"
May 29 17:00:00.973878 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.973860    2564 scope.go:117] "RemoveContainer" containerID="4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"
May 29 17:00:00.983792 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.983759    2564 scope.go:117] "RemoveContainer" containerID="00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"
May 29 17:00:00.990716 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.990687    2564 scope.go:117] "RemoveContainer" containerID="3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"
May 29 17:00:00.992668 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.992646    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:00:00.996119 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.996100    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:00:00.997682 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:00.997660    2564 scope.go:117] "RemoveContainer" containerID="bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"
May 29 17:00:01.003849 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.003810    2564 scope.go:117] "RemoveContainer" containerID="16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"
May 29 17:00:01.010096 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.010079    2564 scope.go:117] "RemoveContainer" containerID="6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3"
May 29 17:00:01.016361 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.016335    2564 scope.go:117] "RemoveContainer" containerID="a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"
May 29 17:00:01.016614 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.016593    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b\": container with ID starting with a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b not found: ID does not exist" containerID="a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"
May 29 17:00:01.016674 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.016622    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b"} err="failed to get container status \"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b\": rpc error: code = NotFound desc = could not find container \"a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b\": container with ID starting with a135dffc42d4e80d3599df97cdedfe8891d25ad8fa447d2aa5175fafdb785a7b not found: ID does not exist"
May 29 17:00:01.016674 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.016656    2564 scope.go:117] "RemoveContainer" containerID="4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"
May 29 17:00:01.016923 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.016897    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1\": container with ID starting with 4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1 not found: ID does not exist" containerID="4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"
May 29 17:00:01.016977 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.016932    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1"} err="failed to get container status \"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1\": rpc error: code = NotFound desc = could not find container \"4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1\": container with ID starting with 4a624b8e589d87683d87602789c79d016b04a1bdc86cf59fee3b3b1ddd3384e1 not found: ID does not exist"
May 29 17:00:01.016977 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.016954    2564 scope.go:117] "RemoveContainer" containerID="00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"
May 29 17:00:01.017180 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.017165    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771\": container with ID starting with 00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771 not found: ID does not exist" containerID="00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"
May 29 17:00:01.017217 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017187    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771"} err="failed to get container status \"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771\": rpc error: code = NotFound desc = could not find container \"00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771\": container with ID starting with 00ce53beda04a38c11b4d70622e08a447fe3200dbf94a095213000ac3380b771 not found: ID does not exist"
May 29 17:00:01.017217 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017201    2564 scope.go:117] "RemoveContainer" containerID="3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"
May 29 17:00:01.017384 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.017370    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427\": container with ID starting with 3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427 not found: ID does not exist" containerID="3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"
May 29 17:00:01.017424 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017386    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427"} err="failed to get container status \"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427\": rpc error: code = NotFound desc = could not find container \"3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427\": container with ID starting with 3b8149cac28ea2badb70d52314d903770162e18cfd4424aa7054197109e7f427 not found: ID does not exist"
May 29 17:00:01.017424 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017397    2564 scope.go:117] "RemoveContainer" containerID="bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"
May 29 17:00:01.017575 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.017560    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a\": container with ID starting with bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a not found: ID does not exist" containerID="bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"
May 29 17:00:01.017610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017580    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a"} err="failed to get container status \"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a\": rpc error: code = NotFound desc = could not find container \"bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a\": container with ID starting with bdba5bba5f3cdffc3b2d9e672af7b0a491bc9c3bed8c2885b9015b99336e477a not found: ID does not exist"
May 29 17:00:01.017610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017592    2564 scope.go:117] "RemoveContainer" containerID="16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"
May 29 17:00:01.017783 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.017766    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f\": container with ID starting with 16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f not found: ID does not exist" containerID="16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"
May 29 17:00:01.017859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017792    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f"} err="failed to get container status \"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f\": rpc error: code = NotFound desc = could not find container \"16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f\": container with ID starting with 16c15e062ef38eb51d93074514c6f5f36f1ec50798d66ef34de2349d4a89957f not found: ID does not exist"
May 29 17:00:01.017859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.017813    2564 scope.go:117] "RemoveContainer" containerID="6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3"
May 29 17:00:01.018052 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:01.018037    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3\": container with ID starting with 6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3 not found: ID does not exist" containerID="6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3"
May 29 17:00:01.018091 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.018055    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3"} err="failed to get container status \"6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3\": rpc error: code = NotFound desc = could not find container \"6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3\": container with ID starting with 6179707da9614ccbe21e40fd814d22b302d76257496a8263dd68e0ed7100a5e3 not found: ID does not exist"
May 29 17:00:01.021575 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021552    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:00:01.021959 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021944    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="prom-label-proxy"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021961    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="prom-label-proxy"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021973    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021978    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021990    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="config-reloader"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.021995    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="config-reloader"
May 29 17:00:01.022003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022003    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="init-config-reloader"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022008    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="init-config-reloader"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022028    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="alertmanager"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="alertmanager"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022042    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-metric"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022046    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-metric"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022051    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c504d14-877f-4eed-b50e-958d9e6264d4" containerName="console"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022056    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c504d14-877f-4eed-b50e-958d9e6264d4" containerName="console"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022063    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-web"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022067    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-web"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022111    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c504d14-877f-4eed-b50e-958d9e6264d4" containerName="console"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022119    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022124    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="prom-label-proxy"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022132    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="alertmanager"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022137    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-web"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022143    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="config-reloader"
May 29 17:00:01.022198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.022149    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" containerName="kube-rbac-proxy-metric"
May 29 17:00:01.027775 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.027756    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.030780 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.030760    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 17:00:01.030918 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.030778    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 17:00:01.030918 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.030789    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 17:00:01.030918 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.030887    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 17:00:01.031097 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.031038    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 17:00:01.031097 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.031091    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9fpsb\""
May 29 17:00:01.031225 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.031194    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 17:00:01.031401 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.031380    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 17:00:01.031510 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.031496    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 17:00:01.035620 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.035545    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 17:00:01.036426 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.036408    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:00:01.218280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-out\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-volume\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdvxb\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-kube-api-access-xdvxb\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.218748 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.218612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-web-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.316712 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.316675    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c57c718-a8e1-4a6b-9f0e-9767c6464fea" path="/var/lib/kubelet/pods/0c57c718-a8e1-4a6b-9f0e-9767c6464fea/volumes"
May 29 17:00:01.318977 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.318949    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.318998    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319038    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-volume\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319061    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319087    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdvxb\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-kube-api-access-xdvxb\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319144    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319181    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319217    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-web-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319249    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-out\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319278    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319319    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319657 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319353    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.319657 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.320008 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.319988    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.321464 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.321445    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-out\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.322549 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322526    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 17:00:01.322549 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322546    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 17:00:01.322745 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322565    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 17:00:01.322745 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322547    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 17:00:01.322745 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322552    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 17:00:01.322890 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322861    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 17:00:01.322890 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322870    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 17:00:01.322965 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.322898    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 17:00:01.326942 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.326925    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 17:00:01.328747 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.328730    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdvxb\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-kube-api-access-xdvxb\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332533 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332342    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/307341bb-f230-4f97-ae87-f2c3c3e3b38b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332533 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332467    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-config-volume\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332533 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332510    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332605    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-web-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332640    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.332798 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.332690    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/307341bb-f230-4f97-ae87-f2c3c3e3b38b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.333095 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.333078    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/307341bb-f230-4f97-ae87-f2c3c3e3b38b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"307341bb-f230-4f97-ae87-f2c3c3e3b38b\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.341301 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.341286    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9fpsb\""
May 29 17:00:01.349408 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.349394    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:00:01.474534 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.474507    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:00:01.476813 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:00:01.476785    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307341bb_f230_4f97_ae87_f2c3c3e3b38b.slice/crio-f22419bc838ae5bf65fbf78cde2597ca76a8508adf490f6691280d1142e2ce97 WatchSource:0}: Error finding container f22419bc838ae5bf65fbf78cde2597ca76a8508adf490f6691280d1142e2ce97: Status 404 returned error can't find the container with id f22419bc838ae5bf65fbf78cde2597ca76a8508adf490f6691280d1142e2ce97
May 29 17:00:01.970452 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.970418    2564 generic.go:358] "Generic (PLEG): container finished" podID="307341bb-f230-4f97-ae87-f2c3c3e3b38b" containerID="e0fa7dcf2a80659035bd7618aeec962e1530953dced7e09bca83b2cc006cad95" exitCode=0
May 29 17:00:01.970940 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.970495    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerDied","Data":"e0fa7dcf2a80659035bd7618aeec962e1530953dced7e09bca83b2cc006cad95"}
May 29 17:00:01.970940 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:01.970527    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"f22419bc838ae5bf65fbf78cde2597ca76a8508adf490f6691280d1142e2ce97"}
May 29 17:00:02.976991 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.976961    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"d78cacc3e50b1c2a61dfd388b47f578e8c900cab81ec0d899b3f2920227288df"}
May 29 17:00:02.976991 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.976993    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"0e536ff6a9a4fe7f7f3f442404e2896ef893f18c354f569710507ceb69f63d78"}
May 29 17:00:02.977367 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.977002    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"4214cc97e55ad6076bf607f2efb4d072b6e301d6a001d49f5f47ad50cd976dd4"}
May 29 17:00:02.977367 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.977011    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"044da56f8f5b92311ae8095d5c519951a03c73fa5a298c29c26813b61e509417"}
May 29 17:00:02.977367 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.977019    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"9e35a4098e1ceb3f848bf40b1bf769fb957186b2e377b3c5262b5ede9bd777bb"}
May 29 17:00:02.977367 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:02.977026    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"307341bb-f230-4f97-ae87-f2c3c3e3b38b","Type":"ContainerStarted","Data":"98786c1732d4d7ef3512695cccd74fcc4b6048c8b83c50c949121b3ccdc9244c"}
May 29 17:00:03.007174 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:03.007122    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.007107998 podStartE2EDuration="2.007107998s" podCreationTimestamp="2026-05-29 17:00:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:00:03.004618253 +0000 UTC m=+182.293409775" watchObservedRunningTime="2026-05-29 17:00:03.007107998 +0000 UTC m=+182.295899501"
May 29 17:00:16.387058 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.387028    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:00:16.390218 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.390201    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.399294 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.399272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:00:16.421807 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.421807 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2vz\" (UniqueName: \"kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.421997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.421997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.421997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.421997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.421984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.422150 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.422036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.522883 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522851    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.522883 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522882    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2vz\" (UniqueName: \"kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522902    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522925    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522953    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.522985    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.523020    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523637 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.523610    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523726 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.523685    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523778 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.523759    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.523962 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.523938    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.525374 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.525350    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.525464 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.525408    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.532282 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.532260    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2vz\" (UniqueName: \"kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz\") pod \"console-55c44c9456-xs258\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") " pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.701378 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.701291    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:16.823750 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:16.823726    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:00:16.825904 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:00:16.825882    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e82505_e04c_4efb_bdf8_ab5854c40b84.slice/crio-a03a0c91579eac074e89bfd377bb973aca219c914b2c186fc47c008edfe629d9 WatchSource:0}: Error finding container a03a0c91579eac074e89bfd377bb973aca219c914b2c186fc47c008edfe629d9: Status 404 returned error can't find the container with id a03a0c91579eac074e89bfd377bb973aca219c914b2c186fc47c008edfe629d9
May 29 17:00:17.019421 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:17.019338    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c44c9456-xs258" event={"ID":"99e82505-e04c-4efb-bdf8-ab5854c40b84","Type":"ContainerStarted","Data":"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"}
May 29 17:00:17.019421 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:17.019375    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c44c9456-xs258" event={"ID":"99e82505-e04c-4efb-bdf8-ab5854c40b84","Type":"ContainerStarted","Data":"a03a0c91579eac074e89bfd377bb973aca219c914b2c186fc47c008edfe629d9"}
May 29 17:00:17.038537 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:17.038497    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55c44c9456-xs258" podStartSLOduration=1.038485185 podStartE2EDuration="1.038485185s" podCreationTimestamp="2026-05-29 17:00:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:00:17.037471997 +0000 UTC m=+196.326263503" watchObservedRunningTime="2026-05-29 17:00:17.038485185 +0000 UTC m=+196.327276735"
May 29 17:00:22.584526 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.584492    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b2n6f"]
May 29 17:00:22.587870 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.587854    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.590490 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.590465    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 17:00:22.595067 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.594792    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2n6f"]
May 29 17:00:22.664918 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.664875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-dbus\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.664918 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.664922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-original-pull-secret\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.665280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.664993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-kubelet-config\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.765858 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.765827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-kubelet-config\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.766021 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.765908    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-dbus\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.766021 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.765926    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-original-pull-secret\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.766021 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.765940    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-kubelet-config\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.766214 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.766117    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-dbus\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.768183 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.768163    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61fcf7fa-1a0a-4b99-88e0-4a49dca332d1-original-pull-secret\") pod \"global-pull-secret-syncer-b2n6f\" (UID: \"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1\") " pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:22.897563 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:22.897458    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2n6f"
May 29 17:00:23.020441 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:23.020414    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2n6f"]
May 29 17:00:23.022733 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:00:23.022701    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fcf7fa_1a0a_4b99_88e0_4a49dca332d1.slice/crio-dc6460a78da6b77f3b81b1662e0073ac4665392ef68af760308fd6461c780175 WatchSource:0}: Error finding container dc6460a78da6b77f3b81b1662e0073ac4665392ef68af760308fd6461c780175: Status 404 returned error can't find the container with id dc6460a78da6b77f3b81b1662e0073ac4665392ef68af760308fd6461c780175
May 29 17:00:23.037017 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:23.036987    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2n6f" event={"ID":"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1","Type":"ContainerStarted","Data":"dc6460a78da6b77f3b81b1662e0073ac4665392ef68af760308fd6461c780175"}
May 29 17:00:26.701528 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:26.701457    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:26.701528 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:26.701508    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:26.707106 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:26.707081    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:27.053737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:27.053706    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:00:27.103271 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:27.103235    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 17:00:28.053492 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:28.053459    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2n6f" event={"ID":"61fcf7fa-1a0a-4b99-88e0-4a49dca332d1","Type":"ContainerStarted","Data":"19a3ed6b0a6f463088bd6d50594c189c9ebe1610a99f5dbae405729844d58ec6"}
May 29 17:00:28.069859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:28.069791    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b2n6f" podStartSLOduration=1.592514022 podStartE2EDuration="6.069777891s" podCreationTimestamp="2026-05-29 17:00:22 +0000 UTC" firstStartedPulling="2026-05-29 17:00:23.024360403 +0000 UTC m=+202.313151885" lastFinishedPulling="2026-05-29 17:00:27.501624273 +0000 UTC m=+206.790415754" observedRunningTime="2026-05-29 17:00:28.069167975 +0000 UTC m=+207.357959517" watchObservedRunningTime="2026-05-29 17:00:28.069777891 +0000 UTC m=+207.358569427"
May 29 17:00:42.228635 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.228602    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"]
May 29 17:00:42.231985 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.231970    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.234578 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.234555    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:00:42.235607 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.235589    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:00:42.235607 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.235602    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:00:42.239408 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.239387    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"]
May 29 17:00:42.329718 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.329691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.329880 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.329724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbk9w\" (UniqueName: \"kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.329880 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.329799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.430217 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.430170    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.430399 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.430247    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.430399 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.430268    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbk9w\" (UniqueName: \"kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.430554 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.430534    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.430656 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.430635    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.438601 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.438573    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbk9w\" (UniqueName: \"kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.541921 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.541842    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:42.662868 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:42.662775    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"]
May 29 17:00:42.665073 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:00:42.665046    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfc5ff1_7c37_4576_9310_f3a14cfb224d.slice/crio-a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0 WatchSource:0}: Error finding container a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0: Status 404 returned error can't find the container with id a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0
May 29 17:00:43.094076 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:43.094044    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv" event={"ID":"7bfc5ff1-7c37-4576-9310-f3a14cfb224d","Type":"ContainerStarted","Data":"a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0"}
May 29 17:00:48.110668 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:48.110627    2564 generic.go:358] "Generic (PLEG): container finished" podID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerID="97b9c4034350b7db6b15aba910478c8a0aef07d021f472a8fd787f12d98d7173" exitCode=0
May 29 17:00:48.111089 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:48.110714    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv" event={"ID":"7bfc5ff1-7c37-4576-9310-f3a14cfb224d","Type":"ContainerDied","Data":"97b9c4034350b7db6b15aba910478c8a0aef07d021f472a8fd787f12d98d7173"}
May 29 17:00:51.123194 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:51.123160    2564 generic.go:358] "Generic (PLEG): container finished" podID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerID="75b7a789c53440e48e2de3801716176a0692d82efd744725e9313fa1eda6cc67" exitCode=0
May 29 17:00:51.123603 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:51.123213    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv" event={"ID":"7bfc5ff1-7c37-4576-9310-f3a14cfb224d","Type":"ContainerDied","Data":"75b7a789c53440e48e2de3801716176a0692d82efd744725e9313fa1eda6cc67"}
May 29 17:00:52.126543 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.126476    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-557b8dbb78-nj49c" podUID="9f8469f1-8e8a-4008-ac89-00f08e68b995" containerName="console" containerID="cri-o://b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115" gracePeriod=15
May 29 17:00:52.372844 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.372795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557b8dbb78-nj49c_9f8469f1-8e8a-4008-ac89-00f08e68b995/console/0.log"
May 29 17:00:52.372967 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.372879    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 17:00:52.516347 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516257    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516347 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516313    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516577 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516352    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516577 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516463    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516577 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516515    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516723 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516658    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpjcj\" (UniqueName: \"kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516775 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516740    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca\") pod \"9f8469f1-8e8a-4008-ac89-00f08e68b995\" (UID: \"9f8469f1-8e8a-4008-ac89-00f08e68b995\") "
May 29 17:00:52.516891 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.516865    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config" (OuterVolumeSpecName: "console-config") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:52.517058 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.517032    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:52.517126 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.517041    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.517184 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.517163    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:52.517290 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.517185    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:00:52.519201 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.519166    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:52.519412 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.519392    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj" (OuterVolumeSpecName: "kube-api-access-kpjcj") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "kube-api-access-kpjcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:00:52.519480 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.519424    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f8469f1-8e8a-4008-ac89-00f08e68b995" (UID: "9f8469f1-8e8a-4008-ac89-00f08e68b995"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:00:52.617453 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617417    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpjcj\" (UniqueName: \"kubernetes.io/projected/9f8469f1-8e8a-4008-ac89-00f08e68b995-kube-api-access-kpjcj\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.617453 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617452    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-service-ca\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.617667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617464    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-oauth-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.617667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617472    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f8469f1-8e8a-4008-ac89-00f08e68b995-trusted-ca-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.617667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617482    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-oauth-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:52.617667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:52.617502    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f8469f1-8e8a-4008-ac89-00f08e68b995-console-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:53.131708 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557b8dbb78-nj49c_9f8469f1-8e8a-4008-ac89-00f08e68b995/console/0.log"
May 29 17:00:53.132208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131726    2564 generic.go:358] "Generic (PLEG): container finished" podID="9f8469f1-8e8a-4008-ac89-00f08e68b995" containerID="b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115" exitCode=2
May 29 17:00:53.132208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131762    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b8dbb78-nj49c" event={"ID":"9f8469f1-8e8a-4008-ac89-00f08e68b995","Type":"ContainerDied","Data":"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"}
May 29 17:00:53.132208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131791    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b8dbb78-nj49c" event={"ID":"9f8469f1-8e8a-4008-ac89-00f08e68b995","Type":"ContainerDied","Data":"87a146060382bd961de3d1953c9954a0eb484b9c4b9b99c4950c1fe8c6cfe6cf"}
May 29 17:00:53.132208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131806    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b8dbb78-nj49c"
May 29 17:00:53.132208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.131812    2564 scope.go:117] "RemoveContainer" containerID="b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"
May 29 17:00:53.141995 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.141643    2564 scope.go:117] "RemoveContainer" containerID="b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"
May 29 17:00:53.142190 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:00:53.142133    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115\": container with ID starting with b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115 not found: ID does not exist" containerID="b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"
May 29 17:00:53.142190 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.142169    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115"} err="failed to get container status \"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115\": rpc error: code = NotFound desc = could not find container \"b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115\": container with ID starting with b271757d4b0a4fcec5a7ab8601882f99fff3d66fb8a44e9296c9d53238c6a115 not found: ID does not exist"
May 29 17:00:53.176696 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.176670    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 17:00:53.179948 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.179927    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557b8dbb78-nj49c"]
May 29 17:00:53.314506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:53.314476    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8469f1-8e8a-4008-ac89-00f08e68b995" path="/var/lib/kubelet/pods/9f8469f1-8e8a-4008-ac89-00f08e68b995/volumes"
May 29 17:00:58.155201 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:58.155166    2564 generic.go:358] "Generic (PLEG): container finished" podID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerID="6d89bedf6a4d1ed10527d0305605873264b039947f98cb60bda68f54efe47c30" exitCode=0
May 29 17:00:58.155547 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:58.155238    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv" event={"ID":"7bfc5ff1-7c37-4576-9310-f3a14cfb224d","Type":"ContainerDied","Data":"6d89bedf6a4d1ed10527d0305605873264b039947f98cb60bda68f54efe47c30"}
May 29 17:00:59.289200 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.289180    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:00:59.378886 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.378857    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util\") pod \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") "
May 29 17:00:59.379064 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.378916    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle\") pod \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") "
May 29 17:00:59.379064 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.378946    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbk9w\" (UniqueName: \"kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w\") pod \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\" (UID: \"7bfc5ff1-7c37-4576-9310-f3a14cfb224d\") "
May 29 17:00:59.379552 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.379528    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle" (OuterVolumeSpecName: "bundle") pod "7bfc5ff1-7c37-4576-9310-f3a14cfb224d" (UID: "7bfc5ff1-7c37-4576-9310-f3a14cfb224d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:00:59.381081 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.381060    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w" (OuterVolumeSpecName: "kube-api-access-rbk9w") pod "7bfc5ff1-7c37-4576-9310-f3a14cfb224d" (UID: "7bfc5ff1-7c37-4576-9310-f3a14cfb224d"). InnerVolumeSpecName "kube-api-access-rbk9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:00:59.383252 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.383221    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util" (OuterVolumeSpecName: "util") pod "7bfc5ff1-7c37-4576-9310-f3a14cfb224d" (UID: "7bfc5ff1-7c37-4576-9310-f3a14cfb224d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:00:59.480177 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.480103    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:59.480177 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.480130    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbk9w\" (UniqueName: \"kubernetes.io/projected/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-kube-api-access-rbk9w\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:00:59.480177 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:00:59.480141    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfc5ff1-7c37-4576-9310-f3a14cfb224d-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:00.163356 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:00.163320    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv" event={"ID":"7bfc5ff1-7c37-4576-9310-f3a14cfb224d","Type":"ContainerDied","Data":"a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0"}
May 29 17:01:00.163356 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:00.163346    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkwwlv"
May 29 17:01:00.163356 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:00.163354    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a33c16a28398fd12a71d3cba664fe6a1b53135303a28dc104c1a23acb7dc8db0"
May 29 17:01:05.165446 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165402    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"]
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165690    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="util"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165700    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="util"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165709    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="pull"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165714    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="pull"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165724    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="extract"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165730    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="extract"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165742    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8469f1-8e8a-4008-ac89-00f08e68b995" containerName="console"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165748    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8469f1-8e8a-4008-ac89-00f08e68b995" containerName="console"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165808    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f8469f1-8e8a-4008-ac89-00f08e68b995" containerName="console"
May 29 17:01:05.165863 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.165831    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bfc5ff1-7c37-4576-9310-f3a14cfb224d" containerName="extract"
May 29 17:01:05.218308 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.218275    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"]
May 29 17:01:05.218468 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.218356    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.222180 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.222159    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mpnd7\""
May 29 17:01:05.223922 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.223907    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 29 17:01:05.224320 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.224294    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 29 17:01:05.329695 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.329666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tdm\" (UniqueName: \"kubernetes.io/projected/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-kube-api-access-f8tdm\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.329840 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.329712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.430292 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.430228    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tdm\" (UniqueName: \"kubernetes.io/projected/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-kube-api-access-f8tdm\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.430292 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.430270    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.430620 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.430604    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.438207 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.438179    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tdm\" (UniqueName: \"kubernetes.io/projected/3d6cb8e5-632e-40cb-8ad9-b1b2b9504605-kube-api-access-f8tdm\") pod \"cert-manager-operator-controller-manager-54b9655956-pt6xp\" (UID: \"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.527717 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.527687    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"
May 29 17:01:05.654639 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:05.654595    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp"]
May 29 17:01:05.656859 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:05.656814    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6cb8e5_632e_40cb_8ad9_b1b2b9504605.slice/crio-1756bbf6b97bc538957d7033f06fe1b989533f5364860eb7036ef1d03d431508 WatchSource:0}: Error finding container 1756bbf6b97bc538957d7033f06fe1b989533f5364860eb7036ef1d03d431508: Status 404 returned error can't find the container with id 1756bbf6b97bc538957d7033f06fe1b989533f5364860eb7036ef1d03d431508
May 29 17:01:06.181402 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:06.181368    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp" event={"ID":"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605","Type":"ContainerStarted","Data":"1756bbf6b97bc538957d7033f06fe1b989533f5364860eb7036ef1d03d431508"}
May 29 17:01:09.194740 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.194700    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp" event={"ID":"3d6cb8e5-632e-40cb-8ad9-b1b2b9504605","Type":"ContainerStarted","Data":"44d8088a7938b8fb53afdff36784ec700bbaacd2e5b133ed64982e397fba7885"}
May 29 17:01:09.216965 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.216918    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-pt6xp" podStartSLOduration=1.5102618030000001 podStartE2EDuration="4.216903864s" podCreationTimestamp="2026-05-29 17:01:05 +0000 UTC" firstStartedPulling="2026-05-29 17:01:05.659297438 +0000 UTC m=+244.948088919" lastFinishedPulling="2026-05-29 17:01:08.365939494 +0000 UTC m=+247.654730980" observedRunningTime="2026-05-29 17:01:09.215597161 +0000 UTC m=+248.504388666" watchObservedRunningTime="2026-05-29 17:01:09.216903864 +0000 UTC m=+248.505695368"
May 29 17:01:09.756397 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.756366    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"]
May 29 17:01:09.758579 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.758557    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.763119 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.763059    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:01:09.763298 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.763163    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:01:09.763421 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.763407    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:01:09.767967 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.767942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.768080 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.767985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.768080 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.768046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.771215 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.771190    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"]
May 29 17:01:09.868699 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.868661    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.868888 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.868710    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.868888 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.868754    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.869083 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.869066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.869132 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.869113    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:09.888255 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:09.888230    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:10.067687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:10.067659    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:10.190772 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:10.190737    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"]
May 29 17:01:10.194004 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:10.193976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a7ce30_7026_4714_9a27_d46ffc131c2d.slice/crio-2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f WatchSource:0}: Error finding container 2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f: Status 404 returned error can't find the container with id 2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f
May 29 17:01:10.198746 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:10.198724    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerStarted","Data":"2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f"}
May 29 17:01:11.203178 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.203092    2564 generic.go:358] "Generic (PLEG): container finished" podID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerID="5b7dc74d169170139981ee4bc2d37018bbfa8371e67e9496dbe5b9c16317b5ed" exitCode=0
May 29 17:01:11.203517 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.203181    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerDied","Data":"5b7dc74d169170139981ee4bc2d37018bbfa8371e67e9496dbe5b9c16317b5ed"}
May 29 17:01:11.749334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.749255    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9s46n"]
May 29 17:01:11.751380 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.751364    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.754015 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.753993    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 29 17:01:11.755067 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.755050    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6hkzb\""
May 29 17:01:11.755165 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.755068    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 29 17:01:11.760312 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.760293    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9s46n"]
May 29 17:01:11.782499 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.782473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.782615 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.782553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgs2\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-kube-api-access-8hgs2\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.883899 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.883863    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgs2\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-kube-api-access-8hgs2\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.884039 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.883925    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.892979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.892958    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:11.893163 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:11.893143    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgs2\" (UniqueName: \"kubernetes.io/projected/6ed106f6-3a32-4d5d-ab55-9045cba5af9c-kube-api-access-8hgs2\") pod \"cert-manager-webhook-587ccfb98-9s46n\" (UID: \"6ed106f6-3a32-4d5d-ab55-9045cba5af9c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:12.070864 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:12.070810    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:12.209964 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:12.209928    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9s46n"]
May 29 17:01:12.211919 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:12.211890    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed106f6_3a32_4d5d_ab55_9045cba5af9c.slice/crio-ede74a06ac8df8ac4b7d2ec029aa128199f7834aace1c4d810e4391485b7f4a7 WatchSource:0}: Error finding container ede74a06ac8df8ac4b7d2ec029aa128199f7834aace1c4d810e4391485b7f4a7: Status 404 returned error can't find the container with id ede74a06ac8df8ac4b7d2ec029aa128199f7834aace1c4d810e4391485b7f4a7
May 29 17:01:13.212900 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:13.212862    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n" event={"ID":"6ed106f6-3a32-4d5d-ab55-9045cba5af9c","Type":"ContainerStarted","Data":"ede74a06ac8df8ac4b7d2ec029aa128199f7834aace1c4d810e4391485b7f4a7"}
May 29 17:01:14.219173 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.219135    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerStarted","Data":"9bb0b2a3052176abff96fe6e409e87d0f8221cf4dfae01a50095ebd114f3425e"}
May 29 17:01:14.571667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.571630    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k5f54"]
May 29 17:01:14.574237 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.574218    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.576858 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.576839    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sxv49\""
May 29 17:01:14.584078 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.584053    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k5f54"]
May 29 17:01:14.608360 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.608325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.608493 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.608386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc6kg\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-kube-api-access-xc6kg\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.709223 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.709198    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.709345 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.709243    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6kg\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-kube-api-access-xc6kg\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.718028 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.718005    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.718142 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.718087    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6kg\" (UniqueName: \"kubernetes.io/projected/25a4289c-7d61-417b-9396-3283b5c0e0ce-kube-api-access-xc6kg\") pod \"cert-manager-cainjector-68b757865b-k5f54\" (UID: \"25a4289c-7d61-417b-9396-3283b5c0e0ce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:14.885501 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:14.885411    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54"
May 29 17:01:15.006548 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.006517    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k5f54"]
May 29 17:01:15.009944 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:15.009918    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25a4289c_7d61_417b_9396_3283b5c0e0ce.slice/crio-fd86d7a4b0dd6251c6eb2ece6eb03acbdc8a612e7dbfb311ffa346ca031ef7ce WatchSource:0}: Error finding container fd86d7a4b0dd6251c6eb2ece6eb03acbdc8a612e7dbfb311ffa346ca031ef7ce: Status 404 returned error can't find the container with id fd86d7a4b0dd6251c6eb2ece6eb03acbdc8a612e7dbfb311ffa346ca031ef7ce
May 29 17:01:15.225028 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.224929    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n" event={"ID":"6ed106f6-3a32-4d5d-ab55-9045cba5af9c","Type":"ContainerStarted","Data":"d9dde705b14ce534b1767c7c9b16927258a3f046e96d65c6d0694d9be6020f2a"}
May 29 17:01:15.225530 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.225026    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:15.226763 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.226740    2564 generic.go:358] "Generic (PLEG): container finished" podID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerID="9bb0b2a3052176abff96fe6e409e87d0f8221cf4dfae01a50095ebd114f3425e" exitCode=0
May 29 17:01:15.226909 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.226843    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerDied","Data":"9bb0b2a3052176abff96fe6e409e87d0f8221cf4dfae01a50095ebd114f3425e"}
May 29 17:01:15.228140 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.228120    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54" event={"ID":"25a4289c-7d61-417b-9396-3283b5c0e0ce","Type":"ContainerStarted","Data":"956e9a46a271f3778a1b5358ad3a611976054c1a75e78d2fa29771010af48cd5"}
May 29 17:01:15.228269 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.228144    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54" event={"ID":"25a4289c-7d61-417b-9396-3283b5c0e0ce","Type":"ContainerStarted","Data":"fd86d7a4b0dd6251c6eb2ece6eb03acbdc8a612e7dbfb311ffa346ca031ef7ce"}
May 29 17:01:15.241427 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.241382    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n" podStartSLOduration=1.8080712060000002 podStartE2EDuration="4.241366587s" podCreationTimestamp="2026-05-29 17:01:11 +0000 UTC" firstStartedPulling="2026-05-29 17:01:12.213986436 +0000 UTC m=+251.502777918" lastFinishedPulling="2026-05-29 17:01:14.647281814 +0000 UTC m=+253.936073299" observedRunningTime="2026-05-29 17:01:15.239980074 +0000 UTC m=+254.528771578" watchObservedRunningTime="2026-05-29 17:01:15.241366587 +0000 UTC m=+254.530158095"
May 29 17:01:15.271134 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:15.271094    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-k5f54" podStartSLOduration=1.2710798429999999 podStartE2EDuration="1.271079843s" podCreationTimestamp="2026-05-29 17:01:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:01:15.26992189 +0000 UTC m=+254.558713393" watchObservedRunningTime="2026-05-29 17:01:15.271079843 +0000 UTC m=+254.559871347"
May 29 17:01:16.233661 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:16.233630    2564 generic.go:358] "Generic (PLEG): container finished" podID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerID="43d07cc923b097e6ddb362857f12ac69e937d5f5289b3330e88948948b2be3cb" exitCode=0
May 29 17:01:16.234168 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:16.233711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerDied","Data":"43d07cc923b097e6ddb362857f12ac69e937d5f5289b3330e88948948b2be3cb"}
May 29 17:01:17.356043 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.356016    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:17.429658 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.429632    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle\") pod \"17a7ce30-7026-4714-9a27-d46ffc131c2d\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") "
May 29 17:01:17.429806 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.429686    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util\") pod \"17a7ce30-7026-4714-9a27-d46ffc131c2d\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") "
May 29 17:01:17.429806 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.429725    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf\") pod \"17a7ce30-7026-4714-9a27-d46ffc131c2d\" (UID: \"17a7ce30-7026-4714-9a27-d46ffc131c2d\") "
May 29 17:01:17.430120 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.430082    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle" (OuterVolumeSpecName: "bundle") pod "17a7ce30-7026-4714-9a27-d46ffc131c2d" (UID: "17a7ce30-7026-4714-9a27-d46ffc131c2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:01:17.431856 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.431836    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf" (OuterVolumeSpecName: "kube-api-access-9t6zf") pod "17a7ce30-7026-4714-9a27-d46ffc131c2d" (UID: "17a7ce30-7026-4714-9a27-d46ffc131c2d"). InnerVolumeSpecName "kube-api-access-9t6zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:01:17.434565 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.434547    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util" (OuterVolumeSpecName: "util") pod "17a7ce30-7026-4714-9a27-d46ffc131c2d" (UID: "17a7ce30-7026-4714-9a27-d46ffc131c2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:01:17.530976 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.530903    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:17.530976 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.530925    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a7ce30-7026-4714-9a27-d46ffc131c2d-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:17.530976 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:17.530935    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/17a7ce30-7026-4714-9a27-d46ffc131c2d-kube-api-access-9t6zf\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:18.245795 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:18.245763    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt" event={"ID":"17a7ce30-7026-4714-9a27-d46ffc131c2d","Type":"ContainerDied","Data":"2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f"}
May 29 17:01:18.245795 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:18.245793    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2034761657fced003ff43c909ec5a9f51f6f7e1ab7cb9833c7e5acb3e9ba1f4f"
May 29 17:01:18.246027 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:18.245810    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fngzjt"
May 29 17:01:21.236396 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:21.236364    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-9s46n"
May 29 17:01:23.322262 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322229    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"]
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322537    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="extract"
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322553    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="extract"
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322566    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="util"
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322571    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="util"
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322584    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="pull"
May 29 17:01:23.322621 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322589    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="pull"
May 29 17:01:23.322805 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.322644    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="17a7ce30-7026-4714-9a27-d46ffc131c2d" containerName="extract"
May 29 17:01:23.326871 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.326855    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.330858 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.330837    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pjm2c\""
May 29 17:01:23.331040 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.330899    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 29 17:01:23.331040 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.331011    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 29 17:01:23.332723 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.332696    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"]
May 29 17:01:23.372170 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.372135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-tmp\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.372320 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.372248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfhv4\" (UniqueName: \"kubernetes.io/projected/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-kube-api-access-mfhv4\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.472670 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.472636    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-tmp\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.472843 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.472694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfhv4\" (UniqueName: \"kubernetes.io/projected/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-kube-api-access-mfhv4\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.473092 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.473074    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-tmp\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.481388 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.481364    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfhv4\" (UniqueName: \"kubernetes.io/projected/5ef26e10-dd06-4b34-a294-c7dfdc7c7be9-kube-api-access-mfhv4\") pod \"openshift-lws-operator-bfc7f696d-868dw\" (UID: \"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.637345 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.637252    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"
May 29 17:01:23.776269 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:23.776240    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw"]
May 29 17:01:23.779372 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:23.779342    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef26e10_dd06_4b34_a294_c7dfdc7c7be9.slice/crio-7cc93ab346abb9b394f43cceebcd8adb9940e5115ff2a05c1a765cefc1710d58 WatchSource:0}: Error finding container 7cc93ab346abb9b394f43cceebcd8adb9940e5115ff2a05c1a765cefc1710d58: Status 404 returned error can't find the container with id 7cc93ab346abb9b394f43cceebcd8adb9940e5115ff2a05c1a765cefc1710d58
May 29 17:01:24.264310 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:24.264275    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw" event={"ID":"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9","Type":"ContainerStarted","Data":"7cc93ab346abb9b394f43cceebcd8adb9940e5115ff2a05c1a765cefc1710d58"}
May 29 17:01:26.271905 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:26.271867    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw" event={"ID":"5ef26e10-dd06-4b34-a294-c7dfdc7c7be9","Type":"ContainerStarted","Data":"c6d66d42f703d61d4526c066f23b1bbf4551943906383e63df6a83e79edef029"}
May 29 17:01:26.289759 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:26.289712    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-868dw" podStartSLOduration=1.5895555369999999 podStartE2EDuration="3.289698225s" podCreationTimestamp="2026-05-29 17:01:23 +0000 UTC" firstStartedPulling="2026-05-29 17:01:23.781010751 +0000 UTC m=+263.069802233" lastFinishedPulling="2026-05-29 17:01:25.481153425 +0000 UTC m=+264.769944921" observedRunningTime="2026-05-29 17:01:26.287349555 +0000 UTC m=+265.576141059" watchObservedRunningTime="2026-05-29 17:01:26.289698225 +0000 UTC m=+265.578489726"
May 29 17:01:28.732203 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.732167    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"]
May 29 17:01:28.735721 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.735703    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.738466 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.738446    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:01:28.738570 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.738471    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:01:28.739612 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.739593    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:01:28.742265 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.742245    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"]
May 29 17:01:28.820312 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.820280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.820432 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.820318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.820432 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.820358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ghz\" (UniqueName: \"kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.921373 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.921343    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85ghz\" (UniqueName: \"kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.921520 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.921424    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.921520 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.921455    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.921836 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.921793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.921964 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.921848    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:28.929167 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:28.929148    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ghz\" (UniqueName: \"kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:29.045105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:29.045078    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:29.169847 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:29.169806    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"]
May 29 17:01:29.171849 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:29.171809    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91a470c_9393_484d_a839_a62861659acd.slice/crio-3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7 WatchSource:0}: Error finding container 3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7: Status 404 returned error can't find the container with id 3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7
May 29 17:01:29.284862 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:29.284810    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerStarted","Data":"a9bd3266ca2a96a3d8407042e9ed5407a859d807c5cc02cdd74c0bfcc32247a6"}
May 29 17:01:29.284973 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:29.284875    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerStarted","Data":"3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7"}
May 29 17:01:30.290265 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:30.290194    2564 generic.go:358] "Generic (PLEG): container finished" podID="b91a470c-9393-484d-a839-a62861659acd" containerID="a9bd3266ca2a96a3d8407042e9ed5407a859d807c5cc02cdd74c0bfcc32247a6" exitCode=0
May 29 17:01:30.290265 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:30.290217    2564 generic.go:358] "Generic (PLEG): container finished" podID="b91a470c-9393-484d-a839-a62861659acd" containerID="ba6b03f989f9d0498414c211adbcac5afffdffc93ef1623d13d24fbf91427940" exitCode=0
May 29 17:01:30.290619 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:30.290275    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerDied","Data":"a9bd3266ca2a96a3d8407042e9ed5407a859d807c5cc02cdd74c0bfcc32247a6"}
May 29 17:01:30.290619 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:30.290308    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerDied","Data":"ba6b03f989f9d0498414c211adbcac5afffdffc93ef1623d13d24fbf91427940"}
May 29 17:01:31.295368 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:31.295334    2564 generic.go:358] "Generic (PLEG): container finished" podID="b91a470c-9393-484d-a839-a62861659acd" containerID="8eb169d3a2343dfc1ae8b0598a387987fe7bf40c37d5653a525bc4a106fba3bc" exitCode=0
May 29 17:01:31.295737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:31.295421    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerDied","Data":"8eb169d3a2343dfc1ae8b0598a387987fe7bf40c37d5653a525bc4a106fba3bc"}
May 29 17:01:32.421736 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.421714    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:32.448864 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.448837    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle\") pod \"b91a470c-9393-484d-a839-a62861659acd\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") "
May 29 17:01:32.448972 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.448898    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util\") pod \"b91a470c-9393-484d-a839-a62861659acd\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") "
May 29 17:01:32.448972 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.448937    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85ghz\" (UniqueName: \"kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz\") pod \"b91a470c-9393-484d-a839-a62861659acd\" (UID: \"b91a470c-9393-484d-a839-a62861659acd\") "
May 29 17:01:32.449654 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.449626    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle" (OuterVolumeSpecName: "bundle") pod "b91a470c-9393-484d-a839-a62861659acd" (UID: "b91a470c-9393-484d-a839-a62861659acd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:01:32.451225 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.451190    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz" (OuterVolumeSpecName: "kube-api-access-85ghz") pod "b91a470c-9393-484d-a839-a62861659acd" (UID: "b91a470c-9393-484d-a839-a62861659acd"). InnerVolumeSpecName "kube-api-access-85ghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:01:32.454890 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.454854    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util" (OuterVolumeSpecName: "util") pod "b91a470c-9393-484d-a839-a62861659acd" (UID: "b91a470c-9393-484d-a839-a62861659acd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:01:32.549687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.549611    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:32.549687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.549639    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91a470c-9393-484d-a839-a62861659acd-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:32.549687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:32.549650    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85ghz\" (UniqueName: \"kubernetes.io/projected/b91a470c-9393-484d-a839-a62861659acd-kube-api-access-85ghz\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:01:33.304145 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:33.304112    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm" event={"ID":"b91a470c-9393-484d-a839-a62861659acd","Type":"ContainerDied","Data":"3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7"}
May 29 17:01:33.304145 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:33.304150    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d503f45e97c1d72b35143ad197895f3ae1675355d77cdfae82f3f3c84726ae7"
May 29 17:01:33.304342 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:33.304176    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtd2rm"
May 29 17:01:45.774240 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774210    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"]
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774520    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="util"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774532    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="util"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774540    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="extract"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774546    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="extract"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774554    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="pull"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774560    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="pull"
May 29 17:01:45.774683 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.774617    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="b91a470c-9393-484d-a839-a62861659acd" containerName="extract"
May 29 17:01:45.777944 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.777925    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.781128 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.781090    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 29 17:01:45.781128 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.781109    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 29 17:01:45.781128 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.781095    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 29 17:01:45.781356 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.781328    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 29 17:01:45.781450 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.781433    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-57nb9\""
May 29 17:01:45.792797 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.792777    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"]
May 29 17:01:45.859003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.858974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.859160 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.859021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.859160 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.859088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zns2q\" (UniqueName: \"kubernetes.io/projected/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-kube-api-access-zns2q\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.859160 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.859124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.859160 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.859145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.959746 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.959709    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.959746 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.959750    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.959979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.959778    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.959979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.959809    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.959979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.959874    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zns2q\" (UniqueName: \"kubernetes.io/projected/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-kube-api-access-zns2q\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.960235 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.960191    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.962149 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.962126    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.962219 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.962188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.962345 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.962330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:45.972715 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:45.972688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zns2q\" (UniqueName: \"kubernetes.io/projected/b7b965fb-e0d4-414a-ba6b-7675eeb84b62-kube-api-access-zns2q\") pod \"opendatahub-operator-controller-manager-598f575fbf-hfvhg\" (UID: \"b7b965fb-e0d4-414a-ba6b-7675eeb84b62\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:46.087914 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:46.087882    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:46.254899 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:46.254871    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"]
May 29 17:01:46.256581 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:01:46.256555    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b965fb_e0d4_414a_ba6b_7675eeb84b62.slice/crio-2dab91a8b146ff28f1779819d39a98e39530306fd03e3b2223549238eb413ee5 WatchSource:0}: Error finding container 2dab91a8b146ff28f1779819d39a98e39530306fd03e3b2223549238eb413ee5: Status 404 returned error can't find the container with id 2dab91a8b146ff28f1779819d39a98e39530306fd03e3b2223549238eb413ee5
May 29 17:01:46.352885 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:46.352770    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg" event={"ID":"b7b965fb-e0d4-414a-ba6b-7675eeb84b62","Type":"ContainerStarted","Data":"2dab91a8b146ff28f1779819d39a98e39530306fd03e3b2223549238eb413ee5"}
May 29 17:01:50.369205 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:50.369173    2564 generic.go:358] "Generic (PLEG): container finished" podID="b7b965fb-e0d4-414a-ba6b-7675eeb84b62" containerID="705030a3c29d7f1e86381402e76c70d3aba7ca55c9d732719ef5437255386a63" exitCode=0
May 29 17:01:50.369537 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:50.369252    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg" event={"ID":"b7b965fb-e0d4-414a-ba6b-7675eeb84b62","Type":"ContainerDied","Data":"705030a3c29d7f1e86381402e76c70d3aba7ca55c9d732719ef5437255386a63"}
May 29 17:01:51.374785 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:51.374749    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg" event={"ID":"b7b965fb-e0d4-414a-ba6b-7675eeb84b62","Type":"ContainerStarted","Data":"a2073dc56062a4d6efe4b27c07e7dc7243e53dc9b1e6e0ced890bdf5ba6189a8"}
May 29 17:01:51.375284 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:51.374947    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:01:51.397458 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:01:51.397414    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg" podStartSLOduration=1.901473118 podStartE2EDuration="6.397398489s" podCreationTimestamp="2026-05-29 17:01:45 +0000 UTC" firstStartedPulling="2026-05-29 17:01:46.258301267 +0000 UTC m=+285.547092753" lastFinishedPulling="2026-05-29 17:01:50.75422664 +0000 UTC m=+290.043018124" observedRunningTime="2026-05-29 17:01:51.395762697 +0000 UTC m=+290.684554212" watchObservedRunningTime="2026-05-29 17:01:51.397398489 +0000 UTC m=+290.686189993"
May 29 17:02:01.247716 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:01.247685    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:02:01.249566 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:01.249544    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:02:01.251505 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:01.251488    2564 kubelet.go:1628] "Image garbage collection succeeded"
May 29 17:02:02.380543 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:02.380516    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-hfvhg"
May 29 17:02:07.025932 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.025897    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"]
May 29 17:02:07.029424 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.029407    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.032383 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.032356    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 29 17:02:07.032509 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.032438    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 29 17:02:07.032722 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.032708    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 29 17:02:07.033566 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.033547    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 29 17:02:07.041607 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.041583    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"]
May 29 17:02:07.143493 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.143457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac73967a-9777-49e7-8ffd-2b95d7827011-tls-certs\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.143681 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.143522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac73967a-9777-49e7-8ffd-2b95d7827011-tmp\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.143681 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.143577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nsfn\" (UniqueName: \"kubernetes.io/projected/ac73967a-9777-49e7-8ffd-2b95d7827011-kube-api-access-4nsfn\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.244064 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.244030    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac73967a-9777-49e7-8ffd-2b95d7827011-tmp\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.244064 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.244067    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nsfn\" (UniqueName: \"kubernetes.io/projected/ac73967a-9777-49e7-8ffd-2b95d7827011-kube-api-access-4nsfn\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.244339 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.244126    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac73967a-9777-49e7-8ffd-2b95d7827011-tls-certs\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.246617 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.246587    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac73967a-9777-49e7-8ffd-2b95d7827011-tmp\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.246955 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.246934    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac73967a-9777-49e7-8ffd-2b95d7827011-tls-certs\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.255809 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.255784    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"]
May 29 17:02:07.256734 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.256714    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nsfn\" (UniqueName: \"kubernetes.io/projected/ac73967a-9777-49e7-8ffd-2b95d7827011-kube-api-access-4nsfn\") pod \"kube-auth-proxy-6fbdcf5ddf-6wr72\" (UID: \"ac73967a-9777-49e7-8ffd-2b95d7827011\") " pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.260082 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.260064    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.262860 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.262840    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:02:07.262860 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.262852    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:02:07.262998 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.262848    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:02:07.271586 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.271562    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"]
May 29 17:02:07.342888 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.342857    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"
May 29 17:02:07.364459 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.364431    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-gfv95"]
May 29 17:02:07.368975 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.368953    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.372255 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.372232    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gg52j\""
May 29 17:02:07.372446 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.372237    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 29 17:02:07.375784 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.375338    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-gfv95"]
May 29 17:02:07.445403 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.445367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl58b\" (UniqueName: \"kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.445541 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.445488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.445584 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.445542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.489973 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.489946    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72"]
May 29 17:02:07.496405 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:07.496380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac73967a_9777_49e7_8ffd_2b95d7827011.slice/crio-3121a9f68d3ce389431db031964988cc958241fed20bc46018116dfd7a103eaa WatchSource:0}: Error finding container 3121a9f68d3ce389431db031964988cc958241fed20bc46018116dfd7a103eaa: Status 404 returned error can't find the container with id 3121a9f68d3ce389431db031964988cc958241fed20bc46018116dfd7a103eaa
May 29 17:02:07.497853 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.497837    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:02:07.546334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546292    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.546502 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546356    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl58b\" (UniqueName: \"kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.546502 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546452    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.546612 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.546612 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxxgb\" (UniqueName: \"kubernetes.io/projected/5ff948c7-3b14-4301-a436-68c8be52e256-kube-api-access-kxxgb\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.546904 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546885    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.546975 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.546910    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.556020 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.555999    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl58b\" (UniqueName: \"kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.576789 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.576764    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:07.647851 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.647793    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.648011 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.647854    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxxgb\" (UniqueName: \"kubernetes.io/projected/5ff948c7-3b14-4301-a436-68c8be52e256-kube-api-access-kxxgb\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.648011 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:07.647981    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 29 17:02:07.648129 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:07.648063    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert podName:5ff948c7-3b14-4301-a436-68c8be52e256 nodeName:}" failed. No retries permitted until 2026-05-29 17:02:08.148036442 +0000 UTC m=+307.436827925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert") pod "odh-model-controller-76588b95-gfv95" (UID: "5ff948c7-3b14-4301-a436-68c8be52e256") : secret "odh-model-controller-webhook-cert" not found
May 29 17:02:07.678516 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.678452    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxxgb\" (UniqueName: \"kubernetes.io/projected/5ff948c7-3b14-4301-a436-68c8be52e256-kube-api-access-kxxgb\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:07.713114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:07.713085    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"]
May 29 17:02:07.715972 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:07.715946    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61105e5_9bb3_4ddc_84e6_b9d3bd77b491.slice/crio-a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1 WatchSource:0}: Error finding container a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1: Status 404 returned error can't find the container with id a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1
May 29 17:02:08.154333 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.153849    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:08.157105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.157076    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff948c7-3b14-4301-a436-68c8be52e256-cert\") pod \"odh-model-controller-76588b95-gfv95\" (UID: \"5ff948c7-3b14-4301-a436-68c8be52e256\") " pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:08.282025 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.281992    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:08.430293 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.430202    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72" event={"ID":"ac73967a-9777-49e7-8ffd-2b95d7827011","Type":"ContainerStarted","Data":"3121a9f68d3ce389431db031964988cc958241fed20bc46018116dfd7a103eaa"}
May 29 17:02:08.431733 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.431699    2564 generic.go:358] "Generic (PLEG): container finished" podID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerID="ccfb27a9d4f450febd9cea84c584d3f6666296c16e72f9b8b441793b9f8ae06d" exitCode=0
May 29 17:02:08.431900 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.431748    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282" event={"ID":"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491","Type":"ContainerDied","Data":"ccfb27a9d4f450febd9cea84c584d3f6666296c16e72f9b8b441793b9f8ae06d"}
May 29 17:02:08.431900 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.431772    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282" event={"ID":"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491","Type":"ContainerStarted","Data":"a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1"}
May 29 17:02:08.445947 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:08.445913    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-gfv95"]
May 29 17:02:09.439004 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:09.438964    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-gfv95" event={"ID":"5ff948c7-3b14-4301-a436-68c8be52e256","Type":"ContainerStarted","Data":"38f649a196268e00cb3c6676eff4b6380417ececc522f9f66f1c4b28f90c791f"}
May 29 17:02:12.459461 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.459424    2564 generic.go:358] "Generic (PLEG): container finished" podID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerID="76bfebdacf352d1b20b997f1906b672a23e85a2bac91985351a66f1110024f3a" exitCode=0
May 29 17:02:12.459920 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.459520    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282" event={"ID":"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491","Type":"ContainerDied","Data":"76bfebdacf352d1b20b997f1906b672a23e85a2bac91985351a66f1110024f3a"}
May 29 17:02:12.461259 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.461234    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72" event={"ID":"ac73967a-9777-49e7-8ffd-2b95d7827011","Type":"ContainerStarted","Data":"c6bc9450c11b153bad4494ce490d255e03fbba7b8651a9b79c2b9619ac080fc4"}
May 29 17:02:12.462783 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.462765    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-gfv95" event={"ID":"5ff948c7-3b14-4301-a436-68c8be52e256","Type":"ContainerStarted","Data":"47236329c9e4f61e6b36aed7167c20b256110baf94c559334cbfa06242bac636"}
May 29 17:02:12.464751 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.464724    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:12.491126 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.491084    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fbdcf5ddf-6wr72" podStartSLOduration=0.930518174 podStartE2EDuration="5.491072123s" podCreationTimestamp="2026-05-29 17:02:07 +0000 UTC" firstStartedPulling="2026-05-29 17:02:07.497982676 +0000 UTC m=+306.786774157" lastFinishedPulling="2026-05-29 17:02:12.058536607 +0000 UTC m=+311.347328106" observedRunningTime="2026-05-29 17:02:12.489519204 +0000 UTC m=+311.778310710" watchObservedRunningTime="2026-05-29 17:02:12.491072123 +0000 UTC m=+311.779863659"
May 29 17:02:12.503935 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:12.503889    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-gfv95" podStartSLOduration=1.881367389 podStartE2EDuration="5.50387463s" podCreationTimestamp="2026-05-29 17:02:07 +0000 UTC" firstStartedPulling="2026-05-29 17:02:08.449026273 +0000 UTC m=+307.737817758" lastFinishedPulling="2026-05-29 17:02:12.071533517 +0000 UTC m=+311.360324999" observedRunningTime="2026-05-29 17:02:12.503357849 +0000 UTC m=+311.792149355" watchObservedRunningTime="2026-05-29 17:02:12.50387463 +0000 UTC m=+311.792666135"
May 29 17:02:13.468363 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:13.468263    2564 generic.go:358] "Generic (PLEG): container finished" podID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerID="9fd5b19f682a844451d8dcd0a4a8c3b8822fda795881aff662d272593658fa56" exitCode=0
May 29 17:02:13.468809 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:13.468350    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282" event={"ID":"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491","Type":"ContainerDied","Data":"9fd5b19f682a844451d8dcd0a4a8c3b8822fda795881aff662d272593658fa56"}
May 29 17:02:14.598541 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.598513    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:14.610069 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.610023    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl58b\" (UniqueName: \"kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b\") pod \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") "
May 29 17:02:14.610069 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.610068    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle\") pod \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") "
May 29 17:02:14.610288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.610129    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util\") pod \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\" (UID: \"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491\") "
May 29 17:02:14.611288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.611226    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle" (OuterVolumeSpecName: "bundle") pod "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" (UID: "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:02:14.612659 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.612633    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b" (OuterVolumeSpecName: "kube-api-access-xl58b") pod "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" (UID: "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491"). InnerVolumeSpecName "kube-api-access-xl58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:02:14.618861 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.617744    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util" (OuterVolumeSpecName: "util") pod "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" (UID: "d61105e5-9bb3-4ddc-84e6-b9d3bd77b491"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:02:14.711506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.711476    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl58b\" (UniqueName: \"kubernetes.io/projected/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-kube-api-access-xl58b\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:14.711506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.711502    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:14.711506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:14.711512    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d61105e5-9bb3-4ddc-84e6-b9d3bd77b491-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:15.477013 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:15.476978    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282" event={"ID":"d61105e5-9bb3-4ddc-84e6-b9d3bd77b491","Type":"ContainerDied","Data":"a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1"}
May 29 17:02:15.477013 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:15.477013    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6a766c3b330da49f8ed6e6106a2e4189a63b93ce7bc3c33e8b10f1f8fb8f4c1"
May 29 17:02:15.477206 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:15.477035    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835lk282"
May 29 17:02:18.097996 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.097958    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"]
May 29 17:02:18.098451 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098434    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="pull"
May 29 17:02:18.098451 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098451    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="pull"
May 29 17:02:18.098576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098476    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="util"
May 29 17:02:18.098576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098485    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="util"
May 29 17:02:18.098576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098496    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="extract"
May 29 17:02:18.098576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098505    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="extract"
May 29 17:02:18.098703 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.098593    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="d61105e5-9bb3-4ddc-84e6-b9d3bd77b491" containerName="extract"
May 29 17:02:18.104342 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.104317    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.107507 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.107482    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qgzvp\""
May 29 17:02:18.108617 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.108596    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 29 17:02:18.109895 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.109872    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"]
May 29 17:02:18.113878 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.113859    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.116670 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.116648    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"]
May 29 17:02:18.116987 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.116965    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
May 29 17:02:18.117103 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.117072    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b87p9\""
May 29 17:02:18.128546 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.128228    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"]
May 29 17:02:18.139106 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.139079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg7xk\" (UniqueName: \"kubernetes.io/projected/5daea879-c35a-4ec4-873c-a0808eb77701-kube-api-access-tg7xk\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.139235 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.139122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fxx\" (UniqueName: \"kubernetes.io/projected/d6739a8b-286b-4cee-ac38-3b8fc4b13311-kube-api-access-g9fxx\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.139235 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.139192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6739a8b-286b-4cee-ac38-3b8fc4b13311-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.139235 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.139224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.241241 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.241203    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7xk\" (UniqueName: \"kubernetes.io/projected/5daea879-c35a-4ec4-873c-a0808eb77701-kube-api-access-tg7xk\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.241241 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.241259    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fxx\" (UniqueName: \"kubernetes.io/projected/d6739a8b-286b-4cee-ac38-3b8fc4b13311-kube-api-access-g9fxx\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.241504 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.241309    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6739a8b-286b-4cee-ac38-3b8fc4b13311-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.241504 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.241344    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.241504 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:18.241481    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
May 29 17:02:18.241634 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:18.241549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert podName:5daea879-c35a-4ec4-873c-a0808eb77701 nodeName:}" failed. No retries permitted until 2026-05-29 17:02:18.741528074 +0000 UTC m=+318.030319562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert") pod "llmisvc-controller-manager-c6b9847d7-wcnb4" (UID: "5daea879-c35a-4ec4-873c-a0808eb77701") : secret "llmisvc-webhook-server-cert" not found
May 29 17:02:18.244426 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.244390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6739a8b-286b-4cee-ac38-3b8fc4b13311-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.260356 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.260326    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fxx\" (UniqueName: \"kubernetes.io/projected/d6739a8b-286b-4cee-ac38-3b8fc4b13311-kube-api-access-g9fxx\") pod \"kserve-controller-manager-7c99ffcdcd-9xb5c\" (UID: \"d6739a8b-286b-4cee-ac38-3b8fc4b13311\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.265138 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.265116    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7xk\" (UniqueName: \"kubernetes.io/projected/5daea879-c35a-4ec4-873c-a0808eb77701-kube-api-access-tg7xk\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.416632 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.416551    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:18.551066 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.551034    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"]
May 29 17:02:18.552855 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:18.552805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6739a8b_286b_4cee_ac38_3b8fc4b13311.slice/crio-876a5a67171ef6af29cf1f77ae3b4bbc6cfe3924ab2bc663ce8c1e76d26c467f WatchSource:0}: Error finding container 876a5a67171ef6af29cf1f77ae3b4bbc6cfe3924ab2bc663ce8c1e76d26c467f: Status 404 returned error can't find the container with id 876a5a67171ef6af29cf1f77ae3b4bbc6cfe3924ab2bc663ce8c1e76d26c467f
May 29 17:02:18.745737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:18.745649    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:18.745912 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:18.745787    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
May 29 17:02:18.745912 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:02:18.745867    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert podName:5daea879-c35a-4ec4-873c-a0808eb77701 nodeName:}" failed. No retries permitted until 2026-05-29 17:02:19.745848207 +0000 UTC m=+319.034639696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert") pod "llmisvc-controller-manager-c6b9847d7-wcnb4" (UID: "5daea879-c35a-4ec4-873c-a0808eb77701") : secret "llmisvc-webhook-server-cert" not found
May 29 17:02:19.494279 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:19.494238    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c" event={"ID":"d6739a8b-286b-4cee-ac38-3b8fc4b13311","Type":"ContainerStarted","Data":"876a5a67171ef6af29cf1f77ae3b4bbc6cfe3924ab2bc663ce8c1e76d26c467f"}
May 29 17:02:19.753726 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:19.753634    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:19.756179 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:19.756147    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5daea879-c35a-4ec4-873c-a0808eb77701-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcnb4\" (UID: \"5daea879-c35a-4ec4-873c-a0808eb77701\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:19.929514 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:19.929474    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:20.052304 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:20.052278    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"]
May 29 17:02:20.054396 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:20.054373    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5daea879_c35a_4ec4_873c_a0808eb77701.slice/crio-85c2df3f9d176f22f184c1ea740a0cb54af5605a86254df59db6009dce7a18b4 WatchSource:0}: Error finding container 85c2df3f9d176f22f184c1ea740a0cb54af5605a86254df59db6009dce7a18b4: Status 404 returned error can't find the container with id 85c2df3f9d176f22f184c1ea740a0cb54af5605a86254df59db6009dce7a18b4
May 29 17:02:20.499687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:20.499648    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4" event={"ID":"5daea879-c35a-4ec4-873c-a0808eb77701","Type":"ContainerStarted","Data":"85c2df3f9d176f22f184c1ea740a0cb54af5605a86254df59db6009dce7a18b4"}
May 29 17:02:21.613478 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.613450    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"]
May 29 17:02:21.632696 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.632673    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.633390 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.633365    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"]
May 29 17:02:21.636456 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.636437    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:02:21.636669 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.636652    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:02:21.636731 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.636652    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:02:21.668675 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.668649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.669029 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.668691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk8tp\" (UniqueName: \"kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.669029 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.668754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.770009 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.769976    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.770156 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.770039    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.770156 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.770078    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk8tp\" (UniqueName: \"kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.770365 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.770345    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.770401 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.770371    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.790428 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.790399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk8tp\" (UniqueName: \"kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:21.943886 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:21.943810    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:22.122590 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.122562    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"]
May 29 17:02:22.124545 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:22.124514    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd52d76c_37b7_4f77_9de3_6f75faaab05b.slice/crio-593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47 WatchSource:0}: Error finding container 593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47: Status 404 returned error can't find the container with id 593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47
May 29 17:02:22.508714 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.508646    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c" event={"ID":"d6739a8b-286b-4cee-ac38-3b8fc4b13311","Type":"ContainerStarted","Data":"1cea1d78f57a7b4cb652dc34b695262cd3d15706554313f67ea15dd5614e30d4"}
May 29 17:02:22.508985 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.508720    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:22.510191 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.510159    2564 generic.go:358] "Generic (PLEG): container finished" podID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerID="a72b5e38e1745677cfb023d6796933e5310db8bf13741dc6fc008a7d00516073" exitCode=0
May 29 17:02:22.510288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.510217    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt" event={"ID":"bd52d76c-37b7-4f77-9de3-6f75faaab05b","Type":"ContainerDied","Data":"a72b5e38e1745677cfb023d6796933e5310db8bf13741dc6fc008a7d00516073"}
May 29 17:02:22.510288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.510250    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt" event={"ID":"bd52d76c-37b7-4f77-9de3-6f75faaab05b","Type":"ContainerStarted","Data":"593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47"}
May 29 17:02:22.555583 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:22.555536    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c" podStartSLOduration=1.562449992 podStartE2EDuration="4.5555222s" podCreationTimestamp="2026-05-29 17:02:18 +0000 UTC" firstStartedPulling="2026-05-29 17:02:18.554112384 +0000 UTC m=+317.842903866" lastFinishedPulling="2026-05-29 17:02:21.547184592 +0000 UTC m=+320.835976074" observedRunningTime="2026-05-29 17:02:22.553760265 +0000 UTC m=+321.842551781" watchObservedRunningTime="2026-05-29 17:02:22.5555222 +0000 UTC m=+321.844313706"
May 29 17:02:23.471906 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.471875    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-gfv95"
May 29 17:02:23.502167 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.502140    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-26c45"]
May 29 17:02:23.520754 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.520728    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.523834 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.523801    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
May 29 17:02:23.523957 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.523935    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nmb7p\""
May 29 17:02:23.537464 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.537439    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-26c45"]
May 29 17:02:23.586190 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.586050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/064069c9-96c3-43f4-9f9b-93ef37c238fa-redirect-config\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.586476 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.586237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmz4c\" (UniqueName: \"kubernetes.io/projected/064069c9-96c3-43f4-9f9b-93ef37c238fa-kube-api-access-bmz4c\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.687260 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.687228    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/064069c9-96c3-43f4-9f9b-93ef37c238fa-redirect-config\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.687440 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.687397    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmz4c\" (UniqueName: \"kubernetes.io/projected/064069c9-96c3-43f4-9f9b-93ef37c238fa-kube-api-access-bmz4c\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.687967 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.687944    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/064069c9-96c3-43f4-9f9b-93ef37c238fa-redirect-config\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.699350 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.699326    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmz4c\" (UniqueName: \"kubernetes.io/projected/064069c9-96c3-43f4-9f9b-93ef37c238fa-kube-api-access-bmz4c\") pod \"dashboard-redirect-76cb944577-26c45\" (UID: \"064069c9-96c3-43f4-9f9b-93ef37c238fa\") " pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:23.831337 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:23.831306    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76cb944577-26c45"
May 29 17:02:24.117608 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.117529    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"]
May 29 17:02:24.134634 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.134604    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"]
May 29 17:02:24.134786 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.134737    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.137838 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.137798    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-95p7m\""
May 29 17:02:24.137969 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.137871    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 29 17:02:24.137969 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.137912    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 29 17:02:24.193342 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.193312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.193472 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.193360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5kn\" (UniqueName: \"kubernetes.io/projected/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-kube-api-access-9l5kn\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.294761 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.294717    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.294955 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.294796    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5kn\" (UniqueName: \"kubernetes.io/projected/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-kube-api-access-9l5kn\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.300802 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.300771    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.305733 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.305704    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5kn\" (UniqueName: \"kubernetes.io/projected/5919b9c5-0020-41ba-8c0a-01a6b4a82e1d-kube-api-access-9l5kn\") pod \"servicemesh-operator3-55f49c5f94-gkhcc\" (UID: \"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.320051 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.320017    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-26c45"]
May 29 17:02:24.324618 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:24.324585    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064069c9_96c3_43f4_9f9b_93ef37c238fa.slice/crio-1c0ec9addeab26243b05011d4bb9fdba3ae0d04e5e037280ccd2eb2a5c5a512d WatchSource:0}: Error finding container 1c0ec9addeab26243b05011d4bb9fdba3ae0d04e5e037280ccd2eb2a5c5a512d: Status 404 returned error can't find the container with id 1c0ec9addeab26243b05011d4bb9fdba3ae0d04e5e037280ccd2eb2a5c5a512d
May 29 17:02:24.448219 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.448131    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:24.519261 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.519214    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76cb944577-26c45" event={"ID":"064069c9-96c3-43f4-9f9b-93ef37c238fa","Type":"ContainerStarted","Data":"1c0ec9addeab26243b05011d4bb9fdba3ae0d04e5e037280ccd2eb2a5c5a512d"}
May 29 17:02:24.661475 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:24.661447    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"]
May 29 17:02:24.664449 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:24.664413    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5919b9c5_0020_41ba_8c0a_01a6b4a82e1d.slice/crio-3aabbdffd16b6e3fbe19b627b0257758297bda66fd3b1d7caa670e387d073eef WatchSource:0}: Error finding container 3aabbdffd16b6e3fbe19b627b0257758297bda66fd3b1d7caa670e387d073eef: Status 404 returned error can't find the container with id 3aabbdffd16b6e3fbe19b627b0257758297bda66fd3b1d7caa670e387d073eef
May 29 17:02:25.524173 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:25.524150    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc" event={"ID":"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d","Type":"ContainerStarted","Data":"3aabbdffd16b6e3fbe19b627b0257758297bda66fd3b1d7caa670e387d073eef"}
May 29 17:02:26.532072 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:26.531862    2564 generic.go:358] "Generic (PLEG): container finished" podID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerID="065e5fe77574f3a9fd2f76c756e9f44886b7f847a27004b56047a7f32593ca46" exitCode=0
May 29 17:02:26.532072 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:26.531963    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt" event={"ID":"bd52d76c-37b7-4f77-9de3-6f75faaab05b","Type":"ContainerDied","Data":"065e5fe77574f3a9fd2f76c756e9f44886b7f847a27004b56047a7f32593ca46"}
May 29 17:02:26.534197 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:26.534114    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4" event={"ID":"5daea879-c35a-4ec4-873c-a0808eb77701","Type":"ContainerStarted","Data":"b999879c28125a1d315496a4c9714a32f63161d26f3b2901c7ac5f58b7bdf6f9"}
May 29 17:02:26.534548 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:26.534529    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:02:28.544327 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.544287    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76cb944577-26c45" event={"ID":"064069c9-96c3-43f4-9f9b-93ef37c238fa","Type":"ContainerStarted","Data":"3face6aa0356f999ebe832a22ca01f69c45e5f66c21760828719151a3d1b1665"}
May 29 17:02:28.546167 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.546115    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc" event={"ID":"5919b9c5-0020-41ba-8c0a-01a6b4a82e1d","Type":"ContainerStarted","Data":"6126e9c7c976f019f7ae5cf8bb1223206ba2fc30d3c50eee245e3615d53126a4"}
May 29 17:02:28.546315 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.546212    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:28.548160 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.548135    2564 generic.go:358] "Generic (PLEG): container finished" podID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerID="4af61829bac7a6cbdf1926b5d4bf7d1f067ca9de36cdfaeab964d2195ec7bf75" exitCode=0
May 29 17:02:28.548284 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.548202    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt" event={"ID":"bd52d76c-37b7-4f77-9de3-6f75faaab05b","Type":"ContainerDied","Data":"4af61829bac7a6cbdf1926b5d4bf7d1f067ca9de36cdfaeab964d2195ec7bf75"}
May 29 17:02:28.561985 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.561930    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76cb944577-26c45" podStartSLOduration=1.7850232959999999 podStartE2EDuration="5.561913267s" podCreationTimestamp="2026-05-29 17:02:23 +0000 UTC" firstStartedPulling="2026-05-29 17:02:24.326229996 +0000 UTC m=+323.615021477" lastFinishedPulling="2026-05-29 17:02:28.103119961 +0000 UTC m=+327.391911448" observedRunningTime="2026-05-29 17:02:28.559103554 +0000 UTC m=+327.847895085" watchObservedRunningTime="2026-05-29 17:02:28.561913267 +0000 UTC m=+327.850704775"
May 29 17:02:28.562535 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.562504    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4" podStartSLOduration=5.101868496 podStartE2EDuration="10.562495986s" podCreationTimestamp="2026-05-29 17:02:18 +0000 UTC" firstStartedPulling="2026-05-29 17:02:20.05611459 +0000 UTC m=+319.344906071" lastFinishedPulling="2026-05-29 17:02:25.516742079 +0000 UTC m=+324.805533561" observedRunningTime="2026-05-29 17:02:26.602109363 +0000 UTC m=+325.890900863" watchObservedRunningTime="2026-05-29 17:02:28.562495986 +0000 UTC m=+327.851287491"
May 29 17:02:28.580745 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:28.580678    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc" podStartSLOduration=1.140387055 podStartE2EDuration="4.580664476s" podCreationTimestamp="2026-05-29 17:02:24 +0000 UTC" firstStartedPulling="2026-05-29 17:02:24.667681226 +0000 UTC m=+323.956472707" lastFinishedPulling="2026-05-29 17:02:28.107958642 +0000 UTC m=+327.396750128" observedRunningTime="2026-05-29 17:02:28.57957537 +0000 UTC m=+327.868366875" watchObservedRunningTime="2026-05-29 17:02:28.580664476 +0000 UTC m=+327.869455981"
May 29 17:02:29.687315 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.687277    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:29.751490 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.751454    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util\") pod \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") "
May 29 17:02:29.751678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.751554    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk8tp\" (UniqueName: \"kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp\") pod \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") "
May 29 17:02:29.751678 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.751586    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle\") pod \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\" (UID: \"bd52d76c-37b7-4f77-9de3-6f75faaab05b\") "
May 29 17:02:29.752675 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.752644    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle" (OuterVolumeSpecName: "bundle") pod "bd52d76c-37b7-4f77-9de3-6f75faaab05b" (UID: "bd52d76c-37b7-4f77-9de3-6f75faaab05b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:02:29.753845 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.753783    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp" (OuterVolumeSpecName: "kube-api-access-mk8tp") pod "bd52d76c-37b7-4f77-9de3-6f75faaab05b" (UID: "bd52d76c-37b7-4f77-9de3-6f75faaab05b"). InnerVolumeSpecName "kube-api-access-mk8tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:02:29.755594 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.755565    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util" (OuterVolumeSpecName: "util") pod "bd52d76c-37b7-4f77-9de3-6f75faaab05b" (UID: "bd52d76c-37b7-4f77-9de3-6f75faaab05b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:02:29.852594 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.852506    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:29.852594 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.852538    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk8tp\" (UniqueName: \"kubernetes.io/projected/bd52d76c-37b7-4f77-9de3-6f75faaab05b-kube-api-access-mk8tp\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:29.852594 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:29.852552    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd52d76c-37b7-4f77-9de3-6f75faaab05b-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:02:30.556723 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:30.556688    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt" event={"ID":"bd52d76c-37b7-4f77-9de3-6f75faaab05b","Type":"ContainerDied","Data":"593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47"}
May 29 17:02:30.556723 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:30.556726    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="593063da08d8d85e14c6fd77e54c47306f03c3843f6c24968c8f187cb20e8a47"
May 29 17:02:30.556941 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:30.556740    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqmhxt"
May 29 17:02:33.328624 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.328587    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"]
May 29 17:02:33.329107 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329089    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="util"
May 29 17:02:33.329208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329111    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="util"
May 29 17:02:33.329208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329128    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="pull"
May 29 17:02:33.329208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329136    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="pull"
May 29 17:02:33.329208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329156    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="extract"
May 29 17:02:33.329208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329164    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="extract"
May 29 17:02:33.329462 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.329269    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd52d76c-37b7-4f77-9de3-6f75faaab05b" containerName="extract"
May 29 17:02:33.336337 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.336306    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.339325 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.339301    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 29 17:02:33.339449 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.339409    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 29 17:02:33.339449 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.339417    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 29 17:02:33.339576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.339417    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 29 17:02:33.339576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.339550    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xxnss\""
May 29 17:02:33.344454 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.344432    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"]
May 29 17:02:33.383359 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383522 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383522 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383399    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383522 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfs8\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-kube-api-access-tcfs8\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383671 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383725 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.383884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.383724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484692 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484653    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484711    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484744    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484771    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484795    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.484884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.484883    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfs8\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-kube-api-access-tcfs8\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.485231 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.485203    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.486016 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.485949    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.487618 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.487597    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.487738 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.487662    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.487854 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.487771    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.487961 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.487927    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.493143 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.493119    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.493522 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.493504    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfs8\" (UniqueName: \"kubernetes.io/projected/0ae18f2a-0d07-47fd-a020-eaa37b87fd0e-kube-api-access-tcfs8\") pod \"istiod-openshift-gateway-798958bb55-w2skv\" (UID: \"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.647576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.647480    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:33.791207 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:33.791182    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"]
May 29 17:02:33.794413 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:02:33.794377    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae18f2a_0d07_47fd_a020_eaa37b87fd0e.slice/crio-d49423a4bcbd5d6b28ba828e32d751db63f7d5c0ee40683573cd78e6a97afe93 WatchSource:0}: Error finding container d49423a4bcbd5d6b28ba828e32d751db63f7d5c0ee40683573cd78e6a97afe93: Status 404 returned error can't find the container with id d49423a4bcbd5d6b28ba828e32d751db63f7d5c0ee40683573cd78e6a97afe93
May 29 17:02:34.573484 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:34.573450    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv" event={"ID":"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e","Type":"ContainerStarted","Data":"d49423a4bcbd5d6b28ba828e32d751db63f7d5c0ee40683573cd78e6a97afe93"}
May 29 17:02:36.507764 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:36.507726    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 29 17:02:36.508064 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:36.507798    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 29 17:02:36.582929 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:36.582884    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv" event={"ID":"0ae18f2a-0d07-47fd-a020-eaa37b87fd0e","Type":"ContainerStarted","Data":"cbbd74da6d89d6f827e779498473a1b70723c480fd327d2d2b3758fa218ba520"}
May 29 17:02:36.583046 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:36.582978    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:36.605478 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:36.605423    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv" podStartSLOduration=0.894806185 podStartE2EDuration="3.605406627s" podCreationTimestamp="2026-05-29 17:02:33 +0000 UTC" firstStartedPulling="2026-05-29 17:02:33.796884951 +0000 UTC m=+333.085676446" lastFinishedPulling="2026-05-29 17:02:36.507485396 +0000 UTC m=+335.796276888" observedRunningTime="2026-05-29 17:02:36.602682086 +0000 UTC m=+335.891473591" watchObservedRunningTime="2026-05-29 17:02:36.605406627 +0000 UTC m=+335.894198133"
May 29 17:02:37.588914 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:37.588879    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-w2skv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 29 17:02:37.589373 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:37.589032    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv" podUID="0ae18f2a-0d07-47fd-a020-eaa37b87fd0e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 17:02:39.553687 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:39.553652    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-gkhcc"
May 29 17:02:40.587905 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:40.587872    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w2skv"
May 29 17:02:53.526121 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:53.526033    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xb5c"
May 29 17:02:58.550227 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:02:58.550200    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcnb4"
May 29 17:03:08.441758 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.441720    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:08.461200 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.461163    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:08.461354 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.461216    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:08.464947 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.464924    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 17:03:08.465578 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.465558    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mfnth\""
May 29 17:03:08.465734 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.465710    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 17:03:08.492018 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.491993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhppk\" (UniqueName: \"kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk\") pod \"kuadrant-operator-catalog-8cpzv\" (UID: \"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4\") " pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:08.592954 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.592926    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhppk\" (UniqueName: \"kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk\") pod \"kuadrant-operator-catalog-8cpzv\" (UID: \"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4\") " pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:08.604391 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.604359    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhppk\" (UniqueName: \"kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk\") pod \"kuadrant-operator-catalog-8cpzv\" (UID: \"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4\") " pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:08.771738 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.771664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:08.812158 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.812128    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:08.898108 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:08.898077    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:08.900357 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:08.900331    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021d917e_f2b5_4fcc_85a8_2859d6d5e2f4.slice/crio-e13ee1afc801864bcdb4c4d969f3376050b467843a14005592adb9e27d3ec904 WatchSource:0}: Error finding container e13ee1afc801864bcdb4c4d969f3376050b467843a14005592adb9e27d3ec904: Status 404 returned error can't find the container with id e13ee1afc801864bcdb4c4d969f3376050b467843a14005592adb9e27d3ec904
May 29 17:03:09.018773 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.018734    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hqv6j"]
May 29 17:03:09.023734 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.023676    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:09.027432 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.027409    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hqv6j"]
May 29 17:03:09.097689 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.097660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfg8g\" (UniqueName: \"kubernetes.io/projected/e3f466f0-45b1-4a89-931b-bb45af505666-kube-api-access-nfg8g\") pod \"kuadrant-operator-catalog-hqv6j\" (UID: \"e3f466f0-45b1-4a89-931b-bb45af505666\") " pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:09.198661 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.198625    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfg8g\" (UniqueName: \"kubernetes.io/projected/e3f466f0-45b1-4a89-931b-bb45af505666-kube-api-access-nfg8g\") pod \"kuadrant-operator-catalog-hqv6j\" (UID: \"e3f466f0-45b1-4a89-931b-bb45af505666\") " pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:09.208722 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.208698    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfg8g\" (UniqueName: \"kubernetes.io/projected/e3f466f0-45b1-4a89-931b-bb45af505666-kube-api-access-nfg8g\") pod \"kuadrant-operator-catalog-hqv6j\" (UID: \"e3f466f0-45b1-4a89-931b-bb45af505666\") " pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:09.334208 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.334176    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:09.462952 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.462926    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hqv6j"]
May 29 17:03:09.464232 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:09.464193    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f466f0_45b1_4a89_931b_bb45af505666.slice/crio-fc87feb8e9d0d21b8f9a56264933b37b8fe22ec8927f618a6687af0395575b0c WatchSource:0}: Error finding container fc87feb8e9d0d21b8f9a56264933b37b8fe22ec8927f618a6687af0395575b0c: Status 404 returned error can't find the container with id fc87feb8e9d0d21b8f9a56264933b37b8fe22ec8927f618a6687af0395575b0c
May 29 17:03:09.707652 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.707561    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j" event={"ID":"e3f466f0-45b1-4a89-931b-bb45af505666","Type":"ContainerStarted","Data":"fc87feb8e9d0d21b8f9a56264933b37b8fe22ec8927f618a6687af0395575b0c"}
May 29 17:03:09.709502 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:09.709461    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" event={"ID":"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4","Type":"ContainerStarted","Data":"e13ee1afc801864bcdb4c4d969f3376050b467843a14005592adb9e27d3ec904"}
May 29 17:03:11.718868 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.718804    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j" event={"ID":"e3f466f0-45b1-4a89-931b-bb45af505666","Type":"ContainerStarted","Data":"b332d27eff191e311910dfea3c0c2a6629900e7c07cb6c71c6f613a922336016"}
May 29 17:03:11.720201 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.720174    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" event={"ID":"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4","Type":"ContainerStarted","Data":"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"}
May 29 17:03:11.720310 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.720257    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" podUID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" containerName="registry-server" containerID="cri-o://58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc" gracePeriod=2
May 29 17:03:11.735277 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.735229    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j" podStartSLOduration=1.286563514 podStartE2EDuration="2.735212535s" podCreationTimestamp="2026-05-29 17:03:09 +0000 UTC" firstStartedPulling="2026-05-29 17:03:09.465557791 +0000 UTC m=+368.754349273" lastFinishedPulling="2026-05-29 17:03:10.914206812 +0000 UTC m=+370.202998294" observedRunningTime="2026-05-29 17:03:11.733357416 +0000 UTC m=+371.022148913" watchObservedRunningTime="2026-05-29 17:03:11.735212535 +0000 UTC m=+371.024004040"
May 29 17:03:11.749910 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.749863    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" podStartSLOduration=1.738005137 podStartE2EDuration="3.74985187s" podCreationTimestamp="2026-05-29 17:03:08 +0000 UTC" firstStartedPulling="2026-05-29 17:03:08.901588398 +0000 UTC m=+368.190379879" lastFinishedPulling="2026-05-29 17:03:10.91343513 +0000 UTC m=+370.202226612" observedRunningTime="2026-05-29 17:03:11.748132538 +0000 UTC m=+371.036924043" watchObservedRunningTime="2026-05-29 17:03:11.74985187 +0000 UTC m=+371.038643374"
May 29 17:03:11.960227 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:11.960204    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:12.025049 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.024966    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhppk\" (UniqueName: \"kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk\") pod \"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4\" (UID: \"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4\") "
May 29 17:03:12.027122 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.027093    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk" (OuterVolumeSpecName: "kube-api-access-nhppk") pod "021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" (UID: "021d917e-f2b5-4fcc-85a8-2859d6d5e2f4"). InnerVolumeSpecName "kube-api-access-nhppk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:03:12.126406 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.126381    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhppk\" (UniqueName: \"kubernetes.io/projected/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4-kube-api-access-nhppk\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:12.724862 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.724797    2564 generic.go:358] "Generic (PLEG): container finished" podID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" containerID="58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc" exitCode=0
May 29 17:03:12.725288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.724882    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" event={"ID":"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4","Type":"ContainerDied","Data":"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"}
May 29 17:03:12.725288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.724904    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv"
May 29 17:03:12.725288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.724926    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cpzv" event={"ID":"021d917e-f2b5-4fcc-85a8-2859d6d5e2f4","Type":"ContainerDied","Data":"e13ee1afc801864bcdb4c4d969f3376050b467843a14005592adb9e27d3ec904"}
May 29 17:03:12.725288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.724943    2564 scope.go:117] "RemoveContainer" containerID="58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"
May 29 17:03:12.734333 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.734317    2564 scope.go:117] "RemoveContainer" containerID="58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"
May 29 17:03:12.734566 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:03:12.734548    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc\": container with ID starting with 58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc not found: ID does not exist" containerID="58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"
May 29 17:03:12.734628 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.734573    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc"} err="failed to get container status \"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc\": rpc error: code = NotFound desc = could not find container \"58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc\": container with ID starting with 58516e8714d8df1eb822b0ac81b8b179376cf86a549bd677737a83670f6f4dfc not found: ID does not exist"
May 29 17:03:12.748249 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.748227    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:12.752128 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:12.752108    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cpzv"]
May 29 17:03:13.316280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:13.316250    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" path="/var/lib/kubelet/pods/021d917e-f2b5-4fcc-85a8-2859d6d5e2f4/volumes"
May 29 17:03:19.335185 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:19.335140    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:19.335185 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:19.335192    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:19.357889 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:19.357861    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:19.773114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:19.773042    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hqv6j"
May 29 17:03:24.052889 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.052859    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"]
May 29 17:03:24.053280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.053218    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" containerName="registry-server"
May 29 17:03:24.053280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.053228    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" containerName="registry-server"
May 29 17:03:24.053377 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.053296    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="021d917e-f2b5-4fcc-85a8-2859d6d5e2f4" containerName="registry-server"
May 29 17:03:24.062304 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.062260    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.064996 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.064974    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhxp8\""
May 29 17:03:24.065337 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.065318    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"]
May 29 17:03:24.129388 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.129351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.129562 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.129408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.129562 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.129458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.230915 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.230877    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.231077 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.230945    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.231077 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.230971    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.231361 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.231336    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.231398 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.231345    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.239872 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.239841    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.372263 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.372180    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:24.500143 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.500116    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"]
May 29 17:03:24.502048 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:24.502014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87989f63_2a22_4432_8c6d_e8afd1169085.slice/crio-6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8 WatchSource:0}: Error finding container 6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8: Status 404 returned error can't find the container with id 6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8
May 29 17:03:24.653409 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.653337    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"]
May 29 17:03:24.656920 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.656902    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.663756 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.663725    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"]
May 29 17:03:24.735879 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.735842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwvv\" (UniqueName: \"kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.736033 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.735934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.736033 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.736015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.770784 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.770753    2564 generic.go:358] "Generic (PLEG): container finished" podID="87989f63-2a22-4432-8c6d-e8afd1169085" containerID="304ef34bd2bfdf42792fdc67db0c38cb40ee05e5ba4d74332dfb62b220da0d93" exitCode=0
May 29 17:03:24.770979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.770842    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h" event={"ID":"87989f63-2a22-4432-8c6d-e8afd1169085","Type":"ContainerDied","Data":"304ef34bd2bfdf42792fdc67db0c38cb40ee05e5ba4d74332dfb62b220da0d93"}
May 29 17:03:24.770979 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.770877    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h" event={"ID":"87989f63-2a22-4432-8c6d-e8afd1169085","Type":"ContainerStarted","Data":"6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8"}
May 29 17:03:24.836441 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.836410    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.836577 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.836465    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwvv\" (UniqueName: \"kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.836577 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.836529    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.836913 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.836891    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.836968 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.836924    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.845046 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.845024    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwvv\" (UniqueName: \"kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:24.966785 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:24.966703    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:25.096194 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.096166    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"]
May 29 17:03:25.097085 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:25.097062    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f9e955_da03_491c_b9d7_4548e94eaf7c.slice/crio-5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb WatchSource:0}: Error finding container 5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb: Status 404 returned error can't find the container with id 5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb
May 29 17:03:25.262480 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.262411    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"]
May 29 17:03:25.270112 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.270079    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.272346 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.272327    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"]
May 29 17:03:25.341352 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.341318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.341506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.341378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsf4\" (UniqueName: \"kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.341506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.341418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.442507 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.442480    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.442630 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.442603    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsf4\" (UniqueName: \"kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.442692 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.442644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.442899 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.442878    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.443015 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.442996    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.450314 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.450294    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsf4\" (UniqueName: \"kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.581273 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.581246    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:25.705331 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.705308    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"]
May 29 17:03:25.707265 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:25.707235    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6853c289_6f37_4d6a_a253_fd921d21b460.slice/crio-d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d WatchSource:0}: Error finding container d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d: Status 404 returned error can't find the container with id d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d
May 29 17:03:25.776252 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.776227    2564 generic.go:358] "Generic (PLEG): container finished" podID="87989f63-2a22-4432-8c6d-e8afd1169085" containerID="970ca56848334f4b72d790d3bfc0a9d59d8b34a94d1edb37bfaabed79e051d3b" exitCode=0
May 29 17:03:25.776365 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.776305    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h" event={"ID":"87989f63-2a22-4432-8c6d-e8afd1169085","Type":"ContainerDied","Data":"970ca56848334f4b72d790d3bfc0a9d59d8b34a94d1edb37bfaabed79e051d3b"}
May 29 17:03:25.777757 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.777731    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerStarted","Data":"799761c4936af1800a34a94be64754f5ea46bb1f5b6ae652cbc1f4ebdaf4005f"}
May 29 17:03:25.777889 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.777761    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerStarted","Data":"d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d"}
May 29 17:03:25.779316 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.779295    2564 generic.go:358] "Generic (PLEG): container finished" podID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerID="4451376a92c6483fd63d76e5c8b853e2d30fa34383939dc3307ea1d67b2f8912" exitCode=0
May 29 17:03:25.779397 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.779347    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj" event={"ID":"c3f9e955-da03-491c-b9d7-4548e94eaf7c","Type":"ContainerDied","Data":"4451376a92c6483fd63d76e5c8b853e2d30fa34383939dc3307ea1d67b2f8912"}
May 29 17:03:25.779397 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.779362    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj" event={"ID":"c3f9e955-da03-491c-b9d7-4548e94eaf7c","Type":"ContainerStarted","Data":"5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb"}
May 29 17:03:25.854748 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.854690    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"]
May 29 17:03:25.858258 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.858244    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:25.867640 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.867618    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"]
May 29 17:03:25.946421 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.946387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjb7z\" (UniqueName: \"kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:25.946569 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.946433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:25.946569 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:25.946510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.047807 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.047766    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjb7z\" (UniqueName: \"kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.047997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.047843    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.047997 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.047903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.048265 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.048248    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.048302 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.048279    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.056682 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.056661    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjb7z\" (UniqueName: \"kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.186029 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.185951    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:26.319068 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.319040    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"]
May 29 17:03:26.319995 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:26.319966    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dd92d8_c603_4653_9b81_c642999184e6.slice/crio-2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec WatchSource:0}: Error finding container 2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec: Status 404 returned error can't find the container with id 2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec
May 29 17:03:26.785951 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.785919    2564 generic.go:358] "Generic (PLEG): container finished" podID="87989f63-2a22-4432-8c6d-e8afd1169085" containerID="4ecdd6a6f4744e59990ea1328dccdc1a72ffd00c0ab18bd7ca8b9e7b02a7559d" exitCode=0
May 29 17:03:26.786098 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.786002    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h" event={"ID":"87989f63-2a22-4432-8c6d-e8afd1169085","Type":"ContainerDied","Data":"4ecdd6a6f4744e59990ea1328dccdc1a72ffd00c0ab18bd7ca8b9e7b02a7559d"}
May 29 17:03:26.787271 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.787247    2564 generic.go:358] "Generic (PLEG): container finished" podID="6853c289-6f37-4d6a-a253-fd921d21b460" containerID="799761c4936af1800a34a94be64754f5ea46bb1f5b6ae652cbc1f4ebdaf4005f" exitCode=0
May 29 17:03:26.787358 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.787318    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerDied","Data":"799761c4936af1800a34a94be64754f5ea46bb1f5b6ae652cbc1f4ebdaf4005f"}
May 29 17:03:26.788944 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.788925    2564 generic.go:358] "Generic (PLEG): container finished" podID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerID="2f926b855cc1e58fd4c9975417f443fac63deb18100cd0fa42670bf45280f9fd" exitCode=0
May 29 17:03:26.789048 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.788992    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj" event={"ID":"c3f9e955-da03-491c-b9d7-4548e94eaf7c","Type":"ContainerDied","Data":"2f926b855cc1e58fd4c9975417f443fac63deb18100cd0fa42670bf45280f9fd"}
May 29 17:03:26.790289 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.790270    2564 generic.go:358] "Generic (PLEG): container finished" podID="65dd92d8-c603-4653-9b81-c642999184e6" containerID="b1f2ad9b17ade41d73aeba05fb3ca949479fe261eaf064c769100c50414fbe6c" exitCode=0
May 29 17:03:26.790409 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.790341    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7" event={"ID":"65dd92d8-c603-4653-9b81-c642999184e6","Type":"ContainerDied","Data":"b1f2ad9b17ade41d73aeba05fb3ca949479fe261eaf064c769100c50414fbe6c"}
May 29 17:03:26.790409 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:26.790365    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7" event={"ID":"65dd92d8-c603-4653-9b81-c642999184e6","Type":"ContainerStarted","Data":"2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec"}
May 29 17:03:27.796972 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:27.796947    2564 generic.go:358] "Generic (PLEG): container finished" podID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerID="ba413184f8e094245fc337350d36d93e9d443c0d2246d086ad5dd7bd8d988059" exitCode=0
May 29 17:03:27.797288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:27.797033    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj" event={"ID":"c3f9e955-da03-491c-b9d7-4548e94eaf7c","Type":"ContainerDied","Data":"ba413184f8e094245fc337350d36d93e9d443c0d2246d086ad5dd7bd8d988059"}
May 29 17:03:27.798528 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:27.798501    2564 generic.go:358] "Generic (PLEG): container finished" podID="65dd92d8-c603-4653-9b81-c642999184e6" containerID="5d4fe303b61fd036ef2a1755c62b52e26f0094f5f13138d11b0b22e0e0c37437" exitCode=0
May 29 17:03:27.798620 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:27.798582    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7" event={"ID":"65dd92d8-c603-4653-9b81-c642999184e6","Type":"ContainerDied","Data":"5d4fe303b61fd036ef2a1755c62b52e26f0094f5f13138d11b0b22e0e0c37437"}
May 29 17:03:27.925288 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:27.925267    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:28.064485 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.064456    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util\") pod \"87989f63-2a22-4432-8c6d-e8afd1169085\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") "
May 29 17:03:28.064646 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.064515    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle\") pod \"87989f63-2a22-4432-8c6d-e8afd1169085\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") "
May 29 17:03:28.064646 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.064575    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg\") pod \"87989f63-2a22-4432-8c6d-e8afd1169085\" (UID: \"87989f63-2a22-4432-8c6d-e8afd1169085\") "
May 29 17:03:28.065001 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.064977    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle" (OuterVolumeSpecName: "bundle") pod "87989f63-2a22-4432-8c6d-e8afd1169085" (UID: "87989f63-2a22-4432-8c6d-e8afd1169085"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:28.066584 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.066564    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg" (OuterVolumeSpecName: "kube-api-access-kh9rg") pod "87989f63-2a22-4432-8c6d-e8afd1169085" (UID: "87989f63-2a22-4432-8c6d-e8afd1169085"). InnerVolumeSpecName "kube-api-access-kh9rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:03:28.069966 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.069931    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util" (OuterVolumeSpecName: "util") pod "87989f63-2a22-4432-8c6d-e8afd1169085" (UID: "87989f63-2a22-4432-8c6d-e8afd1169085"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:28.166061 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.166024    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/87989f63-2a22-4432-8c6d-e8afd1169085-kube-api-access-kh9rg\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:28.166061 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.166060    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:28.166061 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.166071    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87989f63-2a22-4432-8c6d-e8afd1169085-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:28.804374 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.804347    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h"
May 29 17:03:28.804796 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.804338    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h" event={"ID":"87989f63-2a22-4432-8c6d-e8afd1169085","Type":"ContainerDied","Data":"6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8"}
May 29 17:03:28.804796 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.804453    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a76ab3d410149d4497c881c3b9fac89c84f60ab643920b9f94a981ce539d1b8"
May 29 17:03:28.805965 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.805937    2564 generic.go:358] "Generic (PLEG): container finished" podID="6853c289-6f37-4d6a-a253-fd921d21b460" containerID="a6b5f6b03dd52b412c19d3ee8a8f79badbe01805070e6d9cbf240943beb67524" exitCode=0
May 29 17:03:28.806058 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.806020    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerDied","Data":"a6b5f6b03dd52b412c19d3ee8a8f79badbe01805070e6d9cbf240943beb67524"}
May 29 17:03:28.807870 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.807847    2564 generic.go:358] "Generic (PLEG): container finished" podID="65dd92d8-c603-4653-9b81-c642999184e6" containerID="d32690103a92e9c069983b23cc470c8a9391732f116bdd8080dbcf3668a50ce3" exitCode=0
May 29 17:03:28.807981 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.807932    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7" event={"ID":"65dd92d8-c603-4653-9b81-c642999184e6","Type":"ContainerDied","Data":"d32690103a92e9c069983b23cc470c8a9391732f116bdd8080dbcf3668a50ce3"}
May 29 17:03:28.938655 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:28.938629    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:29.075220 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.075143    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gwvv\" (UniqueName: \"kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv\") pod \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") "
May 29 17:03:29.075220 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.075211    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util\") pod \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") "
May 29 17:03:29.075439 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.075252    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle\") pod \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\" (UID: \"c3f9e955-da03-491c-b9d7-4548e94eaf7c\") "
May 29 17:03:29.075771 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.075742    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle" (OuterVolumeSpecName: "bundle") pod "c3f9e955-da03-491c-b9d7-4548e94eaf7c" (UID: "c3f9e955-da03-491c-b9d7-4548e94eaf7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:29.077181 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.077157    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv" (OuterVolumeSpecName: "kube-api-access-9gwvv") pod "c3f9e955-da03-491c-b9d7-4548e94eaf7c" (UID: "c3f9e955-da03-491c-b9d7-4548e94eaf7c"). InnerVolumeSpecName "kube-api-access-9gwvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:03:29.080803 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.080782    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util" (OuterVolumeSpecName: "util") pod "c3f9e955-da03-491c-b9d7-4548e94eaf7c" (UID: "c3f9e955-da03-491c-b9d7-4548e94eaf7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:29.176318 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.176284    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gwvv\" (UniqueName: \"kubernetes.io/projected/c3f9e955-da03-491c-b9d7-4548e94eaf7c-kube-api-access-9gwvv\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:29.176318 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.176312    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:29.176318 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.176321    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3f9e955-da03-491c-b9d7-4548e94eaf7c-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:29.814289 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.814253    2564 generic.go:358] "Generic (PLEG): container finished" podID="6853c289-6f37-4d6a-a253-fd921d21b460" containerID="fb98f19d0b84d29e3a493466c743b2e024ef313bed42db79ef82e3666d8956fc" exitCode=0
May 29 17:03:29.814705 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.814315    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerDied","Data":"fb98f19d0b84d29e3a493466c743b2e024ef313bed42db79ef82e3666d8956fc"}
May 29 17:03:29.815970 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.815951    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj"
May 29 17:03:29.815970 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.815952    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj" event={"ID":"c3f9e955-da03-491c-b9d7-4548e94eaf7c","Type":"ContainerDied","Data":"5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb"}
May 29 17:03:29.816091 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.815982    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5adb223a219107a44ca5a02054682007e290a8b41627e2862d930c92123e9bcb"
May 29 17:03:29.951593 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:29.951561    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:30.082954 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.082864    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjb7z\" (UniqueName: \"kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z\") pod \"65dd92d8-c603-4653-9b81-c642999184e6\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") "
May 29 17:03:30.082954 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.082916    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle\") pod \"65dd92d8-c603-4653-9b81-c642999184e6\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") "
May 29 17:03:30.082954 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.082932    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util\") pod \"65dd92d8-c603-4653-9b81-c642999184e6\" (UID: \"65dd92d8-c603-4653-9b81-c642999184e6\") "
May 29 17:03:30.083361 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.083333    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle" (OuterVolumeSpecName: "bundle") pod "65dd92d8-c603-4653-9b81-c642999184e6" (UID: "65dd92d8-c603-4653-9b81-c642999184e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:30.084998 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.084973    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z" (OuterVolumeSpecName: "kube-api-access-qjb7z") pod "65dd92d8-c603-4653-9b81-c642999184e6" (UID: "65dd92d8-c603-4653-9b81-c642999184e6"). InnerVolumeSpecName "kube-api-access-qjb7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:03:30.088318 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.088297    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util" (OuterVolumeSpecName: "util") pod "65dd92d8-c603-4653-9b81-c642999184e6" (UID: "65dd92d8-c603-4653-9b81-c642999184e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:30.184003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.183971    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjb7z\" (UniqueName: \"kubernetes.io/projected/65dd92d8-c603-4653-9b81-c642999184e6-kube-api-access-qjb7z\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:30.184003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.183995    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:30.184003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.184004    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65dd92d8-c603-4653-9b81-c642999184e6-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:30.821041 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.821010    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7"
May 29 17:03:30.821383 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.821059    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7" event={"ID":"65dd92d8-c603-4653-9b81-c642999184e6","Type":"ContainerDied","Data":"2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec"}
May 29 17:03:30.821383 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.821093    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2265d2796c8b7505d566fe9999ed385ba7249618474038fc4c701b034ec06dec"
May 29 17:03:30.952651 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:30.952629    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:31.092227 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.092141    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle\") pod \"6853c289-6f37-4d6a-a253-fd921d21b460\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") "
May 29 17:03:31.092227 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.092187    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hsf4\" (UniqueName: \"kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4\") pod \"6853c289-6f37-4d6a-a253-fd921d21b460\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") "
May 29 17:03:31.092425 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.092236    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util\") pod \"6853c289-6f37-4d6a-a253-fd921d21b460\" (UID: \"6853c289-6f37-4d6a-a253-fd921d21b460\") "
May 29 17:03:31.092862 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.092813    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle" (OuterVolumeSpecName: "bundle") pod "6853c289-6f37-4d6a-a253-fd921d21b460" (UID: "6853c289-6f37-4d6a-a253-fd921d21b460"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:31.094291 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.094267    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4" (OuterVolumeSpecName: "kube-api-access-6hsf4") pod "6853c289-6f37-4d6a-a253-fd921d21b460" (UID: "6853c289-6f37-4d6a-a253-fd921d21b460"). InnerVolumeSpecName "kube-api-access-6hsf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:03:31.097448 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.097412    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util" (OuterVolumeSpecName: "util") pod "6853c289-6f37-4d6a-a253-fd921d21b460" (UID: "6853c289-6f37-4d6a-a253-fd921d21b460"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:03:31.193200 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.193161    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:31.193200 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.193197    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hsf4\" (UniqueName: \"kubernetes.io/projected/6853c289-6f37-4d6a-a253-fd921d21b460-kube-api-access-6hsf4\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:31.193200 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.193207    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6853c289-6f37-4d6a-a253-fd921d21b460-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:03:31.826956 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.826922    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh" event={"ID":"6853c289-6f37-4d6a-a253-fd921d21b460","Type":"ContainerDied","Data":"d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d"}
May 29 17:03:31.826956 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.826956    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0c01632afc0546fa18dfb472c7e6ff668716b34d2054f4fea858a05b71cfd7d"
May 29 17:03:31.826956 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:31.826938    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh"
May 29 17:03:40.854711 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.854665    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"]
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855049    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="extract"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855061    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="extract"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855069    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="pull"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855075    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="pull"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855089    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="pull"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855094    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="pull"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855102    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="extract"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855107    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="extract"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855114    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="util"
May 29 17:03:40.855118 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855118    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855126    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855131    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855138    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="pull"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855142    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="pull"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855151    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855156    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855163    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="pull"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855167    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="pull"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855174    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855178    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855191    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855196    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855202    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855207    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="util"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855256    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6853c289-6f37-4d6a-a253-fd921d21b460" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855266    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3f9e955-da03-491c-b9d7-4548e94eaf7c" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855272    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="65dd92d8-c603-4653-9b81-c642999184e6" containerName="extract"
May 29 17:03:40.855404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.855277    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="87989f63-2a22-4432-8c6d-e8afd1169085" containerName="extract"
May 29 17:03:40.864163 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.864142    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:40.867757 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.867738    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6md8c\""
May 29 17:03:40.884236 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.884210    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"]
May 29 17:03:40.980585 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:40.980548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66z9l\" (UniqueName: \"kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l\") pod \"limitador-operator-controller-manager-85c4996f8c-phtzj\" (UID: \"47d037e5-e0b9-4fd7-b604-1da9047aed0b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:41.081578 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:41.081540    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66z9l\" (UniqueName: \"kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l\") pod \"limitador-operator-controller-manager-85c4996f8c-phtzj\" (UID: \"47d037e5-e0b9-4fd7-b604-1da9047aed0b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:41.094749 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:41.094715    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66z9l\" (UniqueName: \"kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l\") pod \"limitador-operator-controller-manager-85c4996f8c-phtzj\" (UID: \"47d037e5-e0b9-4fd7-b604-1da9047aed0b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:41.174407 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:41.174327    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:41.306624 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:41.306601    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"]
May 29 17:03:41.309427 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:41.309402    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d037e5_e0b9_4fd7_b604_1da9047aed0b.slice/crio-d108c88b3bd99ee7fd63ca1e82c5054b740a21ad2b2490f827a9b0e29f2987c8 WatchSource:0}: Error finding container d108c88b3bd99ee7fd63ca1e82c5054b740a21ad2b2490f827a9b0e29f2987c8: Status 404 returned error can't find the container with id d108c88b3bd99ee7fd63ca1e82c5054b740a21ad2b2490f827a9b0e29f2987c8
May 29 17:03:41.867423 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:41.867384    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" event={"ID":"47d037e5-e0b9-4fd7-b604-1da9047aed0b","Type":"ContainerStarted","Data":"d108c88b3bd99ee7fd63ca1e82c5054b740a21ad2b2490f827a9b0e29f2987c8"}
May 29 17:03:43.878619 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:43.878586    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" event={"ID":"47d037e5-e0b9-4fd7-b604-1da9047aed0b","Type":"ContainerStarted","Data":"85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2"}
May 29 17:03:43.879032 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:43.878667    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:43.910362 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:43.910315    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" podStartSLOduration=2.347555154 podStartE2EDuration="3.910300341s" podCreationTimestamp="2026-05-29 17:03:40 +0000 UTC" firstStartedPulling="2026-05-29 17:03:41.311415915 +0000 UTC m=+400.600207403" lastFinishedPulling="2026-05-29 17:03:42.874161093 +0000 UTC m=+402.162952590" observedRunningTime="2026-05-29 17:03:43.90825715 +0000 UTC m=+403.197048653" watchObservedRunningTime="2026-05-29 17:03:43.910300341 +0000 UTC m=+403.199091844"
May 29 17:03:44.940052 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:44.940021    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l4p7t"]
May 29 17:03:44.944807 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:44.944781    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:44.951024 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:44.950983    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ms5gv\""
May 29 17:03:44.956597 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:44.956567    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l4p7t"]
May 29 17:03:45.118779 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.118737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gs5\" (UniqueName: \"kubernetes.io/projected/d08c0765-97d6-4430-8aa8-fdc66b73d0d3-kube-api-access-k4gs5\") pod \"authorino-operator-657f44b778-l4p7t\" (UID: \"d08c0765-97d6-4430-8aa8-fdc66b73d0d3\") " pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:45.219438 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.219336    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gs5\" (UniqueName: \"kubernetes.io/projected/d08c0765-97d6-4430-8aa8-fdc66b73d0d3-kube-api-access-k4gs5\") pod \"authorino-operator-657f44b778-l4p7t\" (UID: \"d08c0765-97d6-4430-8aa8-fdc66b73d0d3\") " pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:45.227174 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.227149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gs5\" (UniqueName: \"kubernetes.io/projected/d08c0765-97d6-4430-8aa8-fdc66b73d0d3-kube-api-access-k4gs5\") pod \"authorino-operator-657f44b778-l4p7t\" (UID: \"d08c0765-97d6-4430-8aa8-fdc66b73d0d3\") " pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:45.264872 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.264840    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:45.400411 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.400384    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-l4p7t"]
May 29 17:03:45.402200 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:03:45.402174    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08c0765_97d6_4430_8aa8_fdc66b73d0d3.slice/crio-ac4a81ca5408ecd3bd8103c4f03448391d5997e9795268e43abe3ad00125cafa WatchSource:0}: Error finding container ac4a81ca5408ecd3bd8103c4f03448391d5997e9795268e43abe3ad00125cafa: Status 404 returned error can't find the container with id ac4a81ca5408ecd3bd8103c4f03448391d5997e9795268e43abe3ad00125cafa
May 29 17:03:45.887157 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:45.887124    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t" event={"ID":"d08c0765-97d6-4430-8aa8-fdc66b73d0d3","Type":"ContainerStarted","Data":"ac4a81ca5408ecd3bd8103c4f03448391d5997e9795268e43abe3ad00125cafa"}
May 29 17:03:47.896722 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:47.896635    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t" event={"ID":"d08c0765-97d6-4430-8aa8-fdc66b73d0d3","Type":"ContainerStarted","Data":"4e906c63314a76f1c827d5001a3ec4f54e2fc06838db9c444e46d74077185fe5"}
May 29 17:03:47.897099 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:47.896755    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:03:47.916457 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:47.916417    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t" podStartSLOduration=1.705357418 podStartE2EDuration="3.91640266s" podCreationTimestamp="2026-05-29 17:03:44 +0000 UTC" firstStartedPulling="2026-05-29 17:03:45.404248107 +0000 UTC m=+404.693039589" lastFinishedPulling="2026-05-29 17:03:47.615293333 +0000 UTC m=+406.904084831" observedRunningTime="2026-05-29 17:03:47.912998068 +0000 UTC m=+407.201789574" watchObservedRunningTime="2026-05-29 17:03:47.91640266 +0000 UTC m=+407.205194164"
May 29 17:03:54.884394 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:54.884362    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:03:58.903163 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:03:58.903131    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-l4p7t"
May 29 17:04:02.516963 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:02.516931    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:04:11.625436 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.625358    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"]
May 29 17:04:11.625793 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.625596    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" containerName="manager" containerID="cri-o://85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2" gracePeriod=2
May 29 17:04:11.642967 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.642934    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"]
May 29 17:04:11.648648 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.648621    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"]
May 29 17:04:11.649013 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.649001    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" containerName="manager"
May 29 17:04:11.649062 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.649015    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" containerName="manager"
May 29 17:04:11.649102 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.649094    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" containerName="manager"
May 29 17:04:11.652358 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.652336    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:11.666299 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.666272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"]
May 29 17:04:11.732486 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.732453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lhm\" (UniqueName: \"kubernetes.io/projected/7954da64-5b48-4d51-9e9a-8054c0890088-kube-api-access-p7lhm\") pod \"limitador-operator-controller-manager-85c4996f8c-zhw7c\" (UID: \"7954da64-5b48-4d51-9e9a-8054c0890088\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:11.833381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.833349    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lhm\" (UniqueName: \"kubernetes.io/projected/7954da64-5b48-4d51-9e9a-8054c0890088-kube-api-access-p7lhm\") pod \"limitador-operator-controller-manager-85c4996f8c-zhw7c\" (UID: \"7954da64-5b48-4d51-9e9a-8054c0890088\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:11.842327 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.842297    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lhm\" (UniqueName: \"kubernetes.io/projected/7954da64-5b48-4d51-9e9a-8054c0890088-kube-api-access-p7lhm\") pod \"limitador-operator-controller-manager-85c4996f8c-zhw7c\" (UID: \"7954da64-5b48-4d51-9e9a-8054c0890088\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:11.862776 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.862758    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:04:11.865439 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.865414    2564 status_manager.go:895] "Failed to get status for pod" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" err="pods \"limitador-operator-controller-manager-85c4996f8c-phtzj\" is forbidden: User \"system:node:ip-10-0-128-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-169.ec2.internal' and this object"
May 29 17:04:11.934614 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.934551    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66z9l\" (UniqueName: \"kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l\") pod \"47d037e5-e0b9-4fd7-b604-1da9047aed0b\" (UID: \"47d037e5-e0b9-4fd7-b604-1da9047aed0b\") "
May 29 17:04:11.936482 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.936454    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l" (OuterVolumeSpecName: "kube-api-access-66z9l") pod "47d037e5-e0b9-4fd7-b604-1da9047aed0b" (UID: "47d037e5-e0b9-4fd7-b604-1da9047aed0b"). InnerVolumeSpecName "kube-api-access-66z9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:04:11.990898 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.990864    2564 generic.go:358] "Generic (PLEG): container finished" podID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" containerID="85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2" exitCode=0
May 29 17:04:11.991036 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.990914    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj"
May 29 17:04:11.991036 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.990922    2564 scope.go:117] "RemoveContainer" containerID="85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2"
May 29 17:04:11.993823 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.993792    2564 status_manager.go:895] "Failed to get status for pod" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" err="pods \"limitador-operator-controller-manager-85c4996f8c-phtzj\" is forbidden: User \"system:node:ip-10-0-128-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-169.ec2.internal' and this object"
May 29 17:04:11.996117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:11.996100    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:12.000703 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.000686    2564 scope.go:117] "RemoveContainer" containerID="85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2"
May 29 17:04:12.000970 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:04:12.000953    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2\": container with ID starting with 85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2 not found: ID does not exist" containerID="85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2"
May 29 17:04:12.001039 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.000978    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2"} err="failed to get container status \"85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2\": rpc error: code = NotFound desc = could not find container \"85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2\": container with ID starting with 85c1c61859e044c273f515cba87b579fcb6069082c21a3710178e6abd00accc2 not found: ID does not exist"
May 29 17:04:12.002685 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.002656    2564 status_manager.go:895] "Failed to get status for pod" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" err="pods \"limitador-operator-controller-manager-85c4996f8c-phtzj\" is forbidden: User \"system:node:ip-10-0-128-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-169.ec2.internal' and this object"
May 29 17:04:12.036113 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.036083    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66z9l\" (UniqueName: \"kubernetes.io/projected/47d037e5-e0b9-4fd7-b604-1da9047aed0b-kube-api-access-66z9l\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:12.153677 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:04:12.153629    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7954da64_5b48_4d51_9e9a_8054c0890088.slice/crio-4743d143db625d34ff5cfbdf762da74934b9063c2ed0114d37948c2dce978e2c WatchSource:0}: Error finding container 4743d143db625d34ff5cfbdf762da74934b9063c2ed0114d37948c2dce978e2c: Status 404 returned error can't find the container with id 4743d143db625d34ff5cfbdf762da74934b9063c2ed0114d37948c2dce978e2c
May 29 17:04:12.157210 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.157176    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"]
May 29 17:04:12.996786 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.996751    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c" event={"ID":"7954da64-5b48-4d51-9e9a-8054c0890088","Type":"ContainerStarted","Data":"a891bf32e087febe460bc471fefd9b83101a0986bcc6d700e41a9a6a1ad6b633"}
May 29 17:04:12.996786 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.996784    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c" event={"ID":"7954da64-5b48-4d51-9e9a-8054c0890088","Type":"ContainerStarted","Data":"4743d143db625d34ff5cfbdf762da74934b9063c2ed0114d37948c2dce978e2c"}
May 29 17:04:12.997280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:12.996872    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:13.016881 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:13.016835    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c" podStartSLOduration=2.016804777 podStartE2EDuration="2.016804777s" podCreationTimestamp="2026-05-29 17:04:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:04:13.015260008 +0000 UTC m=+432.304051514" watchObservedRunningTime="2026-05-29 17:04:13.016804777 +0000 UTC m=+432.305596281"
May 29 17:04:13.017489 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:13.017462    2564 status_manager.go:895] "Failed to get status for pod" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-phtzj" err="pods \"limitador-operator-controller-manager-85c4996f8c-phtzj\" is forbidden: User \"system:node:ip-10-0-128-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-169.ec2.internal' and this object"
May 29 17:04:13.315911 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:13.315880    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d037e5-e0b9-4fd7-b604-1da9047aed0b" path="/var/lib/kubelet/pods/47d037e5-e0b9-4fd7-b604-1da9047aed0b/volumes"
May 29 17:04:24.004334 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:24.004302    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zhw7c"
May 29 17:04:27.536759 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.536701    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-55c44c9456-xs258" podUID="99e82505-e04c-4efb-bdf8-ab5854c40b84" containerName="console" containerID="cri-o://56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa" gracePeriod=15
May 29 17:04:27.788803 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.788740    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55c44c9456-xs258_99e82505-e04c-4efb-bdf8-ab5854c40b84/console/0.log"
May 29 17:04:27.788938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.788805    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:04:27.876731 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876698    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876759    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876785    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876805    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876867    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876896    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.876938 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.876924    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf2vz\" (UniqueName: \"kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz\") pod \"99e82505-e04c-4efb-bdf8-ab5854c40b84\" (UID: \"99e82505-e04c-4efb-bdf8-ab5854c40b84\") "
May 29 17:04:27.877283 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.877259    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:04:27.877340 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.877269    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca" (OuterVolumeSpecName: "service-ca") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:04:27.877377 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.877351    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:04:27.877412 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.877348    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config" (OuterVolumeSpecName: "console-config") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:04:27.879259 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.879217    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:04:27.879370 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.879260    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:04:27.879370 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.879265    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz" (OuterVolumeSpecName: "kube-api-access-qf2vz") pod "99e82505-e04c-4efb-bdf8-ab5854c40b84" (UID: "99e82505-e04c-4efb-bdf8-ab5854c40b84"). InnerVolumeSpecName "kube-api-access-qf2vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:04:27.978169 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978137    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-oauth-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978354 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978325    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-service-ca\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978354 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978348    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-trusted-ca-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978466 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978400    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-serving-cert\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978466 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978437    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-oauth-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978466 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978456    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99e82505-e04c-4efb-bdf8-ab5854c40b84-console-config\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:27.978602 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:27.978484    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf2vz\" (UniqueName: \"kubernetes.io/projected/99e82505-e04c-4efb-bdf8-ab5854c40b84-kube-api-access-qf2vz\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:04:28.057199 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057176    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55c44c9456-xs258_99e82505-e04c-4efb-bdf8-ab5854c40b84/console/0.log"
May 29 17:04:28.057381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057215    2564 generic.go:358] "Generic (PLEG): container finished" podID="99e82505-e04c-4efb-bdf8-ab5854c40b84" containerID="56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa" exitCode=2
May 29 17:04:28.057381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057244    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c44c9456-xs258" event={"ID":"99e82505-e04c-4efb-bdf8-ab5854c40b84","Type":"ContainerDied","Data":"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"}
May 29 17:04:28.057381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057281    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c44c9456-xs258" event={"ID":"99e82505-e04c-4efb-bdf8-ab5854c40b84","Type":"ContainerDied","Data":"a03a0c91579eac074e89bfd377bb973aca219c914b2c186fc47c008edfe629d9"}
May 29 17:04:28.057381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057297    2564 scope.go:117] "RemoveContainer" containerID="56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"
May 29 17:04:28.057381 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.057320    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c44c9456-xs258"
May 29 17:04:28.068645 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.068625    2564 scope.go:117] "RemoveContainer" containerID="56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"
May 29 17:04:28.069093 ip-10-0-128-169 kubenswrapper[2564]: E0529 17:04:28.069073    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa\": container with ID starting with 56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa not found: ID does not exist" containerID="56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"
May 29 17:04:28.069198 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.069099    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa"} err="failed to get container status \"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa\": rpc error: code = NotFound desc = could not find container \"56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa\": container with ID starting with 56e28e8bdb92568c5232688b8af7e73c3edb7c15d4402a6331512f99ed3f4daa not found: ID does not exist"
May 29 17:04:28.080214 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.080191    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:04:28.083580 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:28.083562    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55c44c9456-xs258"]
May 29 17:04:29.316251 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:29.316220    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e82505-e04c-4efb-bdf8-ab5854c40b84" path="/var/lib/kubelet/pods/99e82505-e04c-4efb-bdf8-ab5854c40b84/volumes"
May 29 17:04:56.692066 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.692032    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:04:56.692423 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.692402    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e82505-e04c-4efb-bdf8-ab5854c40b84" containerName="console"
May 29 17:04:56.692423 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.692412    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e82505-e04c-4efb-bdf8-ab5854c40b84" containerName="console"
May 29 17:04:56.692501 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.692479    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="99e82505-e04c-4efb-bdf8-ab5854c40b84" containerName="console"
May 29 17:04:56.695565 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.695545    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.698430 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.698404    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhxp8\""
May 29 17:04:56.698430 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.698420    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 29 17:04:56.703448 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.703313    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:04:56.718158 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.718135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0a018ad9-8249-4fda-8c86-264a28ab2296-config-file\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.718260 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.718198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkfxc\" (UniqueName: \"kubernetes.io/projected/0a018ad9-8249-4fda-8c86-264a28ab2296-kube-api-access-mkfxc\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.728099 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.728066    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:04:56.818659 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.818630    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkfxc\" (UniqueName: \"kubernetes.io/projected/0a018ad9-8249-4fda-8c86-264a28ab2296-kube-api-access-mkfxc\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.818785 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.818700    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0a018ad9-8249-4fda-8c86-264a28ab2296-config-file\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.819273 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.819255    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0a018ad9-8249-4fda-8c86-264a28ab2296-config-file\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:56.827400 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:56.827376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkfxc\" (UniqueName: \"kubernetes.io/projected/0a018ad9-8249-4fda-8c86-264a28ab2296-kube-api-access-mkfxc\") pod \"limitador-limitador-78c99df468-stbrq\" (UID: \"0a018ad9-8249-4fda-8c86-264a28ab2296\") " pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:57.007661 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:57.007583    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:04:57.141981 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:57.141953    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:04:57.143296 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:04:57.143268    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a018ad9_8249_4fda_8c86_264a28ab2296.slice/crio-32a74c6bf5f6ae684eb64577136d8d0aaed1fa31571a046ba0943c29a9acde44 WatchSource:0}: Error finding container 32a74c6bf5f6ae684eb64577136d8d0aaed1fa31571a046ba0943c29a9acde44: Status 404 returned error can't find the container with id 32a74c6bf5f6ae684eb64577136d8d0aaed1fa31571a046ba0943c29a9acde44
May 29 17:04:57.175874 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:04:57.175842    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq" event={"ID":"0a018ad9-8249-4fda-8c86-264a28ab2296","Type":"ContainerStarted","Data":"32a74c6bf5f6ae684eb64577136d8d0aaed1fa31571a046ba0943c29a9acde44"}
May 29 17:05:00.189844 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:00.189791    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq" event={"ID":"0a018ad9-8249-4fda-8c86-264a28ab2296","Type":"ContainerStarted","Data":"b86a07c8ef5001906d20bc533e1ad9f1dde60138815b6dc6a2f4f416ca8ac4e9"}
May 29 17:05:00.190341 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:00.189869    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:05:00.209483 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:00.209428    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq" podStartSLOduration=1.670951259 podStartE2EDuration="4.20941412s" podCreationTimestamp="2026-05-29 17:04:56 +0000 UTC" firstStartedPulling="2026-05-29 17:04:57.145107413 +0000 UTC m=+476.433898895" lastFinishedPulling="2026-05-29 17:04:59.68357027 +0000 UTC m=+478.972361756" observedRunningTime="2026-05-29 17:05:00.208086292 +0000 UTC m=+479.496877798" watchObservedRunningTime="2026-05-29 17:05:00.20941412 +0000 UTC m=+479.498205624"
May 29 17:05:11.195211 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:11.195180    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-stbrq"
May 29 17:05:26.176618 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.176582    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"]
May 29 17:05:26.180629 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.180611    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.183860 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.183840    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 17:05:26.184078 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.183940    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 17:05:26.185117 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.185098    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xws6v\""
May 29 17:05:26.188274 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.188258    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"]
May 29 17:05:26.266810 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.266773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7g4f\" (UniqueName: \"kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.267001 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.266895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.267001 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.266952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.368057 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.368026    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.368210 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.368071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.368210 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.368115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7g4f\" (UniqueName: \"kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.368456 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.368438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.368500 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.368451    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.377299 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.377275    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7g4f\" (UniqueName: \"kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.491647 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.491558    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:26.622630 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:26.622586    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"]
May 29 17:05:26.626065 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:05:26.625273    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71f896c_f382_4ea8_a588_a49c78d01750.slice/crio-81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899 WatchSource:0}: Error finding container 81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899: Status 404 returned error can't find the container with id 81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899
May 29 17:05:27.294893 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:27.294861    2564 generic.go:358] "Generic (PLEG): container finished" podID="a71f896c-f382-4ea8-a588-a49c78d01750" containerID="0721cc0160f65fe05424c626dba710b8d2e9a226bd4182463677a8bb52d420f1" exitCode=0
May 29 17:05:27.295286 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:27.294954    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf" event={"ID":"a71f896c-f382-4ea8-a588-a49c78d01750","Type":"ContainerDied","Data":"0721cc0160f65fe05424c626dba710b8d2e9a226bd4182463677a8bb52d420f1"}
May 29 17:05:27.295286 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:27.294988    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf" event={"ID":"a71f896c-f382-4ea8-a588-a49c78d01750","Type":"ContainerStarted","Data":"81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899"}
May 29 17:05:28.301420 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:28.301384    2564 generic.go:358] "Generic (PLEG): container finished" podID="a71f896c-f382-4ea8-a588-a49c78d01750" containerID="722771802cc2f88e18a5f2c8cbed7ae68bc17121f3d1cceb088cc58d27a218e9" exitCode=0
May 29 17:05:28.301898 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:28.301478    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf" event={"ID":"a71f896c-f382-4ea8-a588-a49c78d01750","Type":"ContainerDied","Data":"722771802cc2f88e18a5f2c8cbed7ae68bc17121f3d1cceb088cc58d27a218e9"}
May 29 17:05:29.307467 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:29.307437    2564 generic.go:358] "Generic (PLEG): container finished" podID="a71f896c-f382-4ea8-a588-a49c78d01750" containerID="ae396931186bcd62ad7bcf740df200d4729d8cb3d186cd4dc95bb8ddf9f3cea3" exitCode=0
May 29 17:05:29.307467 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:29.307472    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf" event={"ID":"a71f896c-f382-4ea8-a588-a49c78d01750","Type":"ContainerDied","Data":"ae396931186bcd62ad7bcf740df200d4729d8cb3d186cd4dc95bb8ddf9f3cea3"}
May 29 17:05:30.447151 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.447127    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:05:30.503652 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.503620    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7g4f\" (UniqueName: \"kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f\") pod \"a71f896c-f382-4ea8-a588-a49c78d01750\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") "
May 29 17:05:30.503784 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.503721    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle\") pod \"a71f896c-f382-4ea8-a588-a49c78d01750\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") "
May 29 17:05:30.503784 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.503758    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util\") pod \"a71f896c-f382-4ea8-a588-a49c78d01750\" (UID: \"a71f896c-f382-4ea8-a588-a49c78d01750\") "
May 29 17:05:30.504268 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.504238    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle" (OuterVolumeSpecName: "bundle") pod "a71f896c-f382-4ea8-a588-a49c78d01750" (UID: "a71f896c-f382-4ea8-a588-a49c78d01750"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:05:30.505660 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.505638    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f" (OuterVolumeSpecName: "kube-api-access-f7g4f") pod "a71f896c-f382-4ea8-a588-a49c78d01750" (UID: "a71f896c-f382-4ea8-a588-a49c78d01750"). InnerVolumeSpecName "kube-api-access-f7g4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:05:30.509944 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.509921    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util" (OuterVolumeSpecName: "util") pod "a71f896c-f382-4ea8-a588-a49c78d01750" (UID: "a71f896c-f382-4ea8-a588-a49c78d01750"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:05:30.604667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.604593    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-bundle\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:05:30.604667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.604617    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a71f896c-f382-4ea8-a588-a49c78d01750-util\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:05:30.604667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:30.604626    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7g4f\" (UniqueName: \"kubernetes.io/projected/a71f896c-f382-4ea8-a588-a49c78d01750-kube-api-access-f7g4f\") on node \"ip-10-0-128-169.ec2.internal\" DevicePath \"\""
May 29 17:05:31.324925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:31.324887    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf" event={"ID":"a71f896c-f382-4ea8-a588-a49c78d01750","Type":"ContainerDied","Data":"81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899"}
May 29 17:05:31.324925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:31.324924    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81252b15ba9b3bbe33165c9e179425bc77ea667812da4d3a2752744b916a3899"
May 29 17:05:31.325127 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:05:31.324949    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j5pxf"
May 29 17:06:58.470298 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:06:58.470260    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:07:01.284465 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:07:01.284438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:07:01.285050 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:07:01.285031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:08:07.857686 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:07.857652    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:08:31.748308 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:31.748272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:08:38.556737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:38.556706    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:08:54.095568 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.095475    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"]
May 29 17:08:54.096105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096080    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="extract"
May 29 17:08:54.096105 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096106    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="extract"
May 29 17:08:54.096268 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096140    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="util"
May 29 17:08:54.096268 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096149    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="util"
May 29 17:08:54.096268 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096162    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="pull"
May 29 17:08:54.096268 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096174    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="pull"
May 29 17:08:54.096434 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.096274    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a71f896c-f382-4ea8-a588-a49c78d01750" containerName="extract"
May 29 17:08:54.103762 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.099589    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.104134 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.104113    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 29 17:08:54.104225 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.104119    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ck7w\""
May 29 17:08:54.104329 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.104309    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 29 17:08:54.104468 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.104325    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 29 17:08:54.109216 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.109188    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"]
May 29 17:08:54.171538 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.171538 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tchj5\" (UniqueName: \"kubernetes.io/projected/0b88fc60-8d22-4622-9828-218e396b1cdb-kube-api-access-tchj5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.171737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.171737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.171737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b88fc60-8d22-4622-9828-218e396b1cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.171737 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.171694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.272983 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.272945    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.272983 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.272987    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tchj5\" (UniqueName: \"kubernetes.io/projected/0b88fc60-8d22-4622-9828-218e396b1cdb-kube-api-access-tchj5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273229 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273029    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273229 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273229 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273110    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b88fc60-8d22-4622-9828-218e396b1cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273229 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273173    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273442 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273421    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273501 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273479    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.273545 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.273512    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.275450 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.275427    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b88fc60-8d22-4622-9828-218e396b1cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.275706 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.275689    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b88fc60-8d22-4622-9828-218e396b1cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.281703 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.281683    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tchj5\" (UniqueName: \"kubernetes.io/projected/0b88fc60-8d22-4622-9828-218e396b1cdb-kube-api-access-tchj5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc\" (UID: \"0b88fc60-8d22-4622-9828-218e396b1cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.416596 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.416497    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:08:54.550909 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.550873    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"]
May 29 17:08:54.551854 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:08:54.551813    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b88fc60_8d22_4622_9828_218e396b1cdb.slice/crio-5d4fb19d4132a999ecb13a600150d1eaddeee28efee483c94734395481a93f45 WatchSource:0}: Error finding container 5d4fb19d4132a999ecb13a600150d1eaddeee28efee483c94734395481a93f45: Status 404 returned error can't find the container with id 5d4fb19d4132a999ecb13a600150d1eaddeee28efee483c94734395481a93f45
May 29 17:08:54.553786 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:54.553766    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:08:55.146363 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:55.146331    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc" event={"ID":"0b88fc60-8d22-4622-9828-218e396b1cdb","Type":"ContainerStarted","Data":"5d4fb19d4132a999ecb13a600150d1eaddeee28efee483c94734395481a93f45"}
May 29 17:08:55.151178 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:55.151153    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:08:58.160277 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:08:58.160237    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc" event={"ID":"0b88fc60-8d22-4622-9828-218e396b1cdb","Type":"ContainerStarted","Data":"c238a583b4712720a75441dca71123b414d27d0da8bdb56e6f803a93502c3b52"}
May 29 17:09:00.169623 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:00.169588    2564 generic.go:358] "Generic (PLEG): container finished" podID="0b88fc60-8d22-4622-9828-218e396b1cdb" containerID="c238a583b4712720a75441dca71123b414d27d0da8bdb56e6f803a93502c3b52" exitCode=0
May 29 17:09:00.170015 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:00.169662    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc" event={"ID":"0b88fc60-8d22-4622-9828-218e396b1cdb","Type":"ContainerDied","Data":"c238a583b4712720a75441dca71123b414d27d0da8bdb56e6f803a93502c3b52"}
May 29 17:09:02.179927 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:02.179882    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc" event={"ID":"0b88fc60-8d22-4622-9828-218e396b1cdb","Type":"ContainerStarted","Data":"cd9d4565311eca2ccf9c2456e430929b26eb32a61764199c535e063533317c72"}
May 29 17:09:02.200072 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:02.200022    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc" podStartSLOduration=1.317223209 podStartE2EDuration="8.200008892s" podCreationTimestamp="2026-05-29 17:08:54 +0000 UTC" firstStartedPulling="2026-05-29 17:08:54.553991243 +0000 UTC m=+713.842782740" lastFinishedPulling="2026-05-29 17:09:01.436776935 +0000 UTC m=+720.725568423" observedRunningTime="2026-05-29 17:09:02.19727246 +0000 UTC m=+721.486063962" watchObservedRunningTime="2026-05-29 17:09:02.200008892 +0000 UTC m=+721.488800455"
May 29 17:09:04.417220 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:04.417179    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:09:04.417220 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:04.417224    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:09:04.429813 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:04.429780    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:09:05.202969 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:05.202941    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc"
May 29 17:09:12.196526 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.196492    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"]
May 29 17:09:12.200946 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.200923    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.204037 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.204016    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 29 17:09:12.210154 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.210129    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"]
May 29 17:09:12.235999 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.235966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.236141 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.236031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.236141 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.236063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.236141 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.236080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.236141 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.236137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe2bf02-2162-4594-bd51-82953c24745f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.236275 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.236156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2wf\" (UniqueName: \"kubernetes.io/projected/dfe2bf02-2162-4594-bd51-82953c24745f-kube-api-access-sd2wf\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337281 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337243    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe2bf02-2162-4594-bd51-82953c24745f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337281 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337287    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2wf\" (UniqueName: \"kubernetes.io/projected/dfe2bf02-2162-4594-bd51-82953c24745f-kube-api-access-sd2wf\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337571 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337329    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337571 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337369    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337571 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337523    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337735 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337569    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.337963 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337938    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.338060 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.337988    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.338060 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.338017    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.339652 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.339630    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe2bf02-2162-4594-bd51-82953c24745f-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.339925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.339909    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe2bf02-2162-4594-bd51-82953c24745f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.347095 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.347069    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2wf\" (UniqueName: \"kubernetes.io/projected/dfe2bf02-2162-4594-bd51-82953c24745f-kube-api-access-sd2wf\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v\" (UID: \"dfe2bf02-2162-4594-bd51-82953c24745f\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.516321 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.516232    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:12.646354 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:12.646330    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"]
May 29 17:09:12.648452 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:09:12.648426    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe2bf02_2162_4594_bd51_82953c24745f.slice/crio-3c358a517055c5bb5137a33481dc5a9d96abad00fd93f3d37f13102a397fc1c2 WatchSource:0}: Error finding container 3c358a517055c5bb5137a33481dc5a9d96abad00fd93f3d37f13102a397fc1c2: Status 404 returned error can't find the container with id 3c358a517055c5bb5137a33481dc5a9d96abad00fd93f3d37f13102a397fc1c2
May 29 17:09:13.227148 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:13.227104    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v" event={"ID":"dfe2bf02-2162-4594-bd51-82953c24745f","Type":"ContainerStarted","Data":"93493a6d70d32420a198f019c7595d2ebde338aa76bb15c71c389e0136dd7fac"}
May 29 17:09:13.227148 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:13.227152    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v" event={"ID":"dfe2bf02-2162-4594-bd51-82953c24745f","Type":"ContainerStarted","Data":"3c358a517055c5bb5137a33481dc5a9d96abad00fd93f3d37f13102a397fc1c2"}
May 29 17:09:13.353949 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:13.353918    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:09:14.232925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:14.232801    2564 generic.go:358] "Generic (PLEG): container finished" podID="dfe2bf02-2162-4594-bd51-82953c24745f" containerID="93493a6d70d32420a198f019c7595d2ebde338aa76bb15c71c389e0136dd7fac" exitCode=0
May 29 17:09:14.232925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:14.232893    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v" event={"ID":"dfe2bf02-2162-4594-bd51-82953c24745f","Type":"ContainerDied","Data":"93493a6d70d32420a198f019c7595d2ebde338aa76bb15c71c389e0136dd7fac"}
May 29 17:09:15.244931 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:15.244890    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v" event={"ID":"dfe2bf02-2162-4594-bd51-82953c24745f","Type":"ContainerStarted","Data":"2134c3b07dc9515bd21b09c880cc52c24077bbeff046655b3ffa93df3e4031ae"}
May 29 17:09:15.261955 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:15.261896    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v" podStartSLOduration=2.750334841 podStartE2EDuration="3.261881267s" podCreationTimestamp="2026-05-29 17:09:12 +0000 UTC" firstStartedPulling="2026-05-29 17:09:14.23339602 +0000 UTC m=+733.522187502" lastFinishedPulling="2026-05-29 17:09:14.744942431 +0000 UTC m=+734.033733928" observedRunningTime="2026-05-29 17:09:15.26118164 +0000 UTC m=+734.549973169" watchObservedRunningTime="2026-05-29 17:09:15.261881267 +0000 UTC m=+734.550672753"
May 29 17:09:21.997059 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:21.997020    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"]
May 29 17:09:22.003436 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.003413    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.006493 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.006471    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 29 17:09:22.008840 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.008792    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"]
May 29 17:09:22.126644 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.126644 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfznb\" (UniqueName: \"kubernetes.io/projected/33c9c493-30a3-42e6-8ff2-b86a641e460b-kube-api-access-bfznb\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.126859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.126859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.126859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c9c493-30a3-42e6-8ff2-b86a641e460b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.126859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.126846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227550 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227513    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227550 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227548    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfznb\" (UniqueName: \"kubernetes.io/projected/33c9c493-30a3-42e6-8ff2-b86a641e460b-kube-api-access-bfznb\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227757 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227580    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227757 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227622    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227757 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c9c493-30a3-42e6-8ff2-b86a641e460b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227937 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227850    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.227996 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.227974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.228067 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.228040    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.228185 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.228164    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.229856 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.229803    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c9c493-30a3-42e6-8ff2-b86a641e460b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.230237 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.230216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c9c493-30a3-42e6-8ff2-b86a641e460b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.235171 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.235147    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfznb\" (UniqueName: \"kubernetes.io/projected/33c9c493-30a3-42e6-8ff2-b86a641e460b-kube-api-access-bfznb\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv\" (UID: \"33c9c493-30a3-42e6-8ff2-b86a641e460b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.314813 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.314784    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:22.452948 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.452353    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"]
May 29 17:09:22.457298 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:09:22.457270    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c9c493_30a3_42e6_8ff2_b86a641e460b.slice/crio-aca2dfa19f556f139e4d10ae70fe4a6f1e2446ca6a75e5f038011c5571367ee6 WatchSource:0}: Error finding container aca2dfa19f556f139e4d10ae70fe4a6f1e2446ca6a75e5f038011c5571367ee6: Status 404 returned error can't find the container with id aca2dfa19f556f139e4d10ae70fe4a6f1e2446ca6a75e5f038011c5571367ee6
May 29 17:09:22.516480 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.516455    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:22.516568 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.516500    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:22.529531 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:22.529509    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:23.279279 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:23.279235    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv" event={"ID":"33c9c493-30a3-42e6-8ff2-b86a641e460b","Type":"ContainerStarted","Data":"eab3879b0687cb4ad24c1bbad7749c6071f564d6a5bdc931c6baa2c2ed3f1248"}
May 29 17:09:23.279279 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:23.279278    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv" event={"ID":"33c9c493-30a3-42e6-8ff2-b86a641e460b","Type":"ContainerStarted","Data":"aca2dfa19f556f139e4d10ae70fe4a6f1e2446ca6a75e5f038011c5571367ee6"}
May 29 17:09:23.290860 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:23.290832    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v"
May 29 17:09:24.055051 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:24.055005    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:09:27.297002 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:27.296967    2564 generic.go:358] "Generic (PLEG): container finished" podID="33c9c493-30a3-42e6-8ff2-b86a641e460b" containerID="eab3879b0687cb4ad24c1bbad7749c6071f564d6a5bdc931c6baa2c2ed3f1248" exitCode=0
May 29 17:09:27.297469 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:27.297015    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv" event={"ID":"33c9c493-30a3-42e6-8ff2-b86a641e460b","Type":"ContainerDied","Data":"eab3879b0687cb4ad24c1bbad7749c6071f564d6a5bdc931c6baa2c2ed3f1248"}
May 29 17:09:28.302506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:28.302468    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv" event={"ID":"33c9c493-30a3-42e6-8ff2-b86a641e460b","Type":"ContainerStarted","Data":"f57849241443ee0f1a501164d6bc506be761dae90c0896f5199c393ff33b2446"}
May 29 17:09:28.321990 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:28.321946    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv" podStartSLOduration=6.988499889 podStartE2EDuration="7.321932386s" podCreationTimestamp="2026-05-29 17:09:21 +0000 UTC" firstStartedPulling="2026-05-29 17:09:27.297728593 +0000 UTC m=+746.586520075" lastFinishedPulling="2026-05-29 17:09:27.631161086 +0000 UTC m=+746.919952572" observedRunningTime="2026-05-29 17:09:28.319781758 +0000 UTC m=+747.608573259" watchObservedRunningTime="2026-05-29 17:09:28.321932386 +0000 UTC m=+747.610723889"
May 29 17:09:32.315300 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:32.315258    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:32.315751 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:32.315315    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:32.328243 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:32.328219    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:09:33.334234 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:09:33.334204    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv"
May 29 17:10:40.662003 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:10:40.661971    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:10:47.051978 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:10:47.051938    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:10:52.755691 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:10:52.755658    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:11:01.752394 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:11:01.752362    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:11:11.057605 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:11:11.057567    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:11:21.755597 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:11:21.755553    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:11:30.658567 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:11:30.658531    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:11:41.749069 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:11:41.748980    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:12:01.323569 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:12:01.323542    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:12:01.325011 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:12:01.324992    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:12:10.855388 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:12:10.855350    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:12:18.454430 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:12:18.454391    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:12:54.555579 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:12:54.555541    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:13:10.351011 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:13:10.350967    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:13:48.455624 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:13:48.455588    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:14:06.156196 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:14:06.156160    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:14:19.863338 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:14:19.863284    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:14:35.749497 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:14:35.749459    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:15:36.454788 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:15:36.454750    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:15:45.458255 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:15:45.458220    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:16:02.056711 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:16:02.056675    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:16:11.352086 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:16:11.352047    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:16:27.857869 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:16:27.857836    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:16:36.961135 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:16:36.961097    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:17:01.361294 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:01.361266    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:17:01.362560 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:01.362539    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:17:08.553834 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:08.553781    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:17:17.062876 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:17.062838    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:17:26.360684 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:26.360634    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:17:34.456806 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:34.456771    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:17:42.447456 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:17:42.447361    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:18:00.550386 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:18:00.550347    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:18:11.354870 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:18:11.354836    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:18:58.756222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:18:58.756189    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:06.953103 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:06.953074    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:12.756390 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:12.756298    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:21.064016 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:21.063978    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:29.655413 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:29.655364    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:39.362662 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:39.362623    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:48.251919 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:48.251874    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:19:56.751168 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:19:56.751129    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:05.457065 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:05.457030    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:14.850964 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:14.850928    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:23.255234 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:23.255198    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:32.857555 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:32.857520    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:41.553733 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:41.553701    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:50.157747 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:50.157710    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:20:58.853953 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:20:58.853918    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:21:07.256280 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:21:07.256240    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:21:15.756835 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:21:15.756793    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:21:24.648096 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:21:24.648052    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:22:01.394964 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:22:01.394941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:22:01.398399 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:22:01.398380    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:23:42.560479 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:23:42.560395    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:23:49.167667 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:23:49.167625    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:24:12.851656 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:24:12.851615    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:24:21.951527 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:24:21.951495    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:24:30.362185 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:24:30.362146    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:24:40.659925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:24:40.659892    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:24:49.457321 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:24:49.457286    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:00.054835 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:00.054792    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:08.556416 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:08.556382    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:19.049441 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:19.049399    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:27.651255 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:27.651218    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:38.056843 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:38.056787    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:47.258123 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:47.258086    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:25:54.946256 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:25:54.946215    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:26:20.351733 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:26:20.351700    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:01.438378 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:01.438349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:27:01.442794 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:01.442775    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:27:03.449072 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:03.449039    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:12.554859 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:12.554806    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:21.054718 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:21.054674    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:30.070685 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:30.070641    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:39.150636 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:39.150593    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:27:52.153038 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:27:52.153003    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:00.457086 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:00.457046    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:11.354114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:11.354079    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:19.657520 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:19.657484    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:26.850213 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:26.850171    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:34.958071 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:34.958033    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:28:46.649422 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:28:46.649393    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:04.149093 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:04.149045    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:13.065213 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:13.065178    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:21.558509 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:21.558466    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:30.656362 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:30.656327    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:46.361920 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:46.361810    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:29:54.958177 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:29:54.958140    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:03.753293 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:03.753254    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:12.572207 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:12.572173    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:21.464947 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:21.464911    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:28.658472 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:28.658436    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:38.350884 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:38.350852    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:30:51.853715 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:30:51.853680    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:01.559114 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:01.559078    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:14.455830 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:14.455793    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:22.854073 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:22.854032    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:32.358702 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:32.358666    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:42.854488 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:42.854434    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:31:53.862703 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:31:53.862664    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:32:01.476523 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:01.476492    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:32:01.481947 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:01.481927    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:32:10.151564 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:10.151527    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:32:19.256289 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:19.256251    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:32:25.562231 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:25.562195    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:32:37.759545 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:32:37.759508    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:33:01.152505 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:01.152424    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:33:13.952718 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:13.952675    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-stbrq"]
May 29 17:33:25.373242 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:25.373208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76cb944577-26c45_064069c9-96c3-43f4-9f9b-93ef37c238fa/nginx/0.log"
May 29 17:33:25.613018 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:25.612993    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9xb5c_d6739a8b-286b-4cee-ac38-3b8fc4b13311/manager/0.log"
May 29 17:33:25.737449 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:25.737370    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wcnb4_5daea879-c35a-4ec4-873c-a0808eb77701/manager/0.log"
May 29 17:33:26.443464 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:26.443432    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-gfv95_5ff948c7-3b14-4301-a436-68c8be52e256/manager/0.log"
May 29 17:33:26.693779 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:26.693697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-hfvhg_b7b965fb-e0d4-414a-ba6b-7675eeb84b62/copy-manifests/0.log"
May 29 17:33:26.707230 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:26.707202    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-hfvhg_b7b965fb-e0d4-414a-ba6b-7675eeb84b62/manager/0.log"
May 29 17:33:27.759238 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.759211    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/util/0.log"
May 29 17:33:27.765427 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.765401    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/pull/0.log"
May 29 17:33:27.771506 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.771486    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/extract/0.log"
May 29 17:33:27.895785 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.895756    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/util/0.log"
May 29 17:33:27.901852 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.901811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/pull/0.log"
May 29 17:33:27.907954 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:27.907936    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/extract/0.log"
May 29 17:33:28.048841 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.048795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/util/0.log"
May 29 17:33:28.055106 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.055086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/pull/0.log"
May 29 17:33:28.061302 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.061276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/extract/0.log"
May 29 17:33:28.176835 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.176795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/extract/0.log"
May 29 17:33:28.182948 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.182924    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/util/0.log"
May 29 17:33:28.188759 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.188740    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/pull/0.log"
May 29 17:33:28.442154 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.442068    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-l4p7t_d08c0765-97d6-4430-8aa8-fdc66b73d0d3/manager/0.log"
May 29 17:33:28.794966 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:28.794936    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hqv6j_e3f466f0-45b1-4a89-931b-bb45af505666/registry-server/0.log"
May 29 17:33:29.050339 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:29.050261    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-stbrq_0a018ad9-8249-4fda-8c86-264a28ab2296/limitador/0.log"
May 29 17:33:29.171593 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:29.171559    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zhw7c_7954da64-5b48-4d51-9e9a-8054c0890088/manager/0.log"
May 29 17:33:29.660031 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:29.660006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-w2skv_0ae18f2a-0d07-47fd-a020-eaa37b87fd0e/discovery/0.log"
May 29 17:33:29.771309 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:29.771272    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbdcf5ddf-6wr72_ac73967a-9777-49e7-8ffd-2b95d7827011/kube-auth-proxy/0.log"
May 29 17:33:31.002172 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.002122    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc_0b88fc60-8d22-4622-9828-218e396b1cdb/storage-initializer/0.log"
May 29 17:33:31.008438 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.008418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9nwvmc_0b88fc60-8d22-4622-9828-218e396b1cdb/main/0.log"
May 29 17:33:31.126081 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.126046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v_dfe2bf02-2162-4594-bd51-82953c24745f/storage-initializer/0.log"
May 29 17:33:31.132253 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.132231    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-k554v_dfe2bf02-2162-4594-bd51-82953c24745f/main/0.log"
May 29 17:33:31.256042 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.255939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv_33c9c493-30a3-42e6-8ff2-b86a641e460b/main/0.log"
May 29 17:33:31.262536 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:31.262515    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-2vbzv_33c9c493-30a3-42e6-8ff2-b86a641e460b/storage-initializer/0.log"
May 29 17:33:38.917924 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:38.917891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b2n6f_61fcf7fa-1a0a-4b99-88e0-4a49dca332d1/global-pull-secret-syncer/0.log"
May 29 17:33:39.086121 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:39.086085    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x2qm4_6f826046-df52-40ef-9ec8-f6c69d5feee8/konnectivity-agent/0.log"
May 29 17:33:39.102910 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:39.102881    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-169.ec2.internal_9485500250b020aa044bcc7d57132650/haproxy/0.log"
May 29 17:33:43.138771 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.138736    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/extract/0.log"
May 29 17:33:43.159175 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.159138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/util/0.log"
May 29 17:33:43.178029 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.177999    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kxnr7_65dd92d8-c603-4653-9b81-c642999184e6/pull/0.log"
May 29 17:33:43.202137 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.202111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/extract/0.log"
May 29 17:33:43.220142 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.220117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/util/0.log"
May 29 17:33:43.239425 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.239403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xkl8h_87989f63-2a22-4432-8c6d-e8afd1169085/pull/0.log"
May 29 17:33:43.263340 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.263312    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/extract/0.log"
May 29 17:33:43.283512 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.283487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/util/0.log"
May 29 17:33:43.303400 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.303375    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b64zh_6853c289-6f37-4d6a-a253-fd921d21b460/pull/0.log"
May 29 17:33:43.335146 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.335123    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/extract/0.log"
May 29 17:33:43.353796 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.353771    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/util/0.log"
May 29 17:33:43.373493 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.373473    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17hpjj_c3f9e955-da03-491c-b9d7-4548e94eaf7c/pull/0.log"
May 29 17:33:43.741073 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.741044    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-l4p7t_d08c0765-97d6-4430-8aa8-fdc66b73d0d3/manager/0.log"
May 29 17:33:43.827255 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.827224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hqv6j_e3f466f0-45b1-4a89-931b-bb45af505666/registry-server/0.log"
May 29 17:33:43.913857 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.913808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-stbrq_0a018ad9-8249-4fda-8c86-264a28ab2296/limitador/0.log"
May 29 17:33:43.974925 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:43.974893    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zhw7c_7954da64-5b48-4d51-9e9a-8054c0890088/manager/0.log"
May 29 17:33:45.232912 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.232881    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/alertmanager/0.log"
May 29 17:33:45.258610 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.258587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/config-reloader/0.log"
May 29 17:33:45.281608 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.281578    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/kube-rbac-proxy-web/0.log"
May 29 17:33:45.301370 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.301346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/kube-rbac-proxy/0.log"
May 29 17:33:45.321511 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.321483    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/kube-rbac-proxy-metric/0.log"
May 29 17:33:45.339945 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.339918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/prom-label-proxy/0.log"
May 29 17:33:45.365877 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.365853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_307341bb-f230-4f97-ae87-f2c3c3e3b38b/init-config-reloader/0.log"
May 29 17:33:45.545994 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.545963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79d998c4cd-dp9b7_1aa260c5-4bfb-4979-894b-e5bffd861831/metrics-server/0.log"
May 29 17:33:45.576898 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.576871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-d8j9t_8cb47f36-5c33-4c4a-a33b-c57f80821195/monitoring-plugin/0.log"
May 29 17:33:45.678137 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.678106    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-npslf_289785ab-73c8-496b-850a-558aa45cb4e8/node-exporter/0.log"
May 29 17:33:45.695977 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.695952    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-npslf_289785ab-73c8-496b-850a-558aa45cb4e8/kube-rbac-proxy/0.log"
May 29 17:33:45.715474 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:45.715446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-npslf_289785ab-73c8-496b-850a-558aa45cb4e8/init-textfile/0.log"
May 29 17:33:46.060107 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.060076    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-446js_ae2760b4-90d4-4cd5-9ed5-0436bbf2f015/prometheus-operator/0.log"
May 29 17:33:46.079739 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.079708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-446js_ae2760b4-90d4-4cd5-9ed5-0436bbf2f015/kube-rbac-proxy/0.log"
May 29 17:33:46.102193 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.102166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-vqjpb_b24dd6a6-e1a1-4fa7-a63c-6ced2c025f5c/prometheus-operator-admission-webhook/0.log"
May 29 17:33:46.132017 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.131988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd779d6d-jhs7r_28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2/telemeter-client/0.log"
May 29 17:33:46.155750 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.155726    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd779d6d-jhs7r_28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2/reload/0.log"
May 29 17:33:46.179754 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:46.179680    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd779d6d-jhs7r_28769c3e-e3bb-4dd9-a73e-c0d53aaa61b2/kube-rbac-proxy/0.log"
May 29 17:33:48.475704 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:48.475669    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-xdmsn_55909d0e-c658-41f4-9be2-88b9a875fe2e/download-server/0.log"
May 29 17:33:49.630107 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.630069    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"]
May 29 17:33:49.633626 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.633609    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.636132 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.636106    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7t9\"/\"kube-root-ca.crt\""
May 29 17:33:49.636279 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.636109    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7r7t9\"/\"default-dockercfg-52q9n\""
May 29 17:33:49.636352 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.636111    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7t9\"/\"openshift-service-ca.crt\""
May 29 17:33:49.643055 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.643028    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"]
May 29 17:33:49.728286 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.728247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-proc\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.728482 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.728368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-podres\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.728482 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.728413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-sys\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.728482 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.728443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-lib-modules\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.728482 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.728469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzgn\" (UniqueName: \"kubernetes.io/projected/e588263d-5a6c-479e-8e26-c0fbce9f8224-kube-api-access-djzgn\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829014 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.828972    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-podres\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829031    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-sys\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-lib-modules\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829093    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djzgn\" (UniqueName: \"kubernetes.io/projected/e588263d-5a6c-479e-8e26-c0fbce9f8224-kube-api-access-djzgn\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829144    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-podres\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829156    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-proc\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829178    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-sys\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829222 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829202    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-proc\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.829470 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.829241    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e588263d-5a6c-479e-8e26-c0fbce9f8224-lib-modules\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.837516 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.837486    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzgn\" (UniqueName: \"kubernetes.io/projected/e588263d-5a6c-479e-8e26-c0fbce9f8224-kube-api-access-djzgn\") pod \"perf-node-gather-daemonset-xtqct\" (UID: \"e588263d-5a6c-479e-8e26-c0fbce9f8224\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:49.903352 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.903265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqdxd_72202cdd-3c3e-408e-ba40-6620c2697719/dns/0.log"
May 29 17:33:49.921380 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.921352    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqdxd_72202cdd-3c3e-408e-ba40-6620c2697719/kube-rbac-proxy/0.log"
May 29 17:33:49.944465 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:49.944436    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:50.035557 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.035528    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zvrk_c82230fb-cf66-48c6-96fe-2ad5e2c425c5/dns-node-resolver/0.log"
May 29 17:33:50.085534 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.085510    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"]
May 29 17:33:50.087768 ip-10-0-128-169 kubenswrapper[2564]: W0529 17:33:50.087742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode588263d_5a6c_479e_8e26_c0fbce9f8224.slice/crio-7d22a0669924a89a3bfc23aa35c79273f0ccdeaa645e6ae1c1d8cf1c127d24d0 WatchSource:0}: Error finding container 7d22a0669924a89a3bfc23aa35c79273f0ccdeaa645e6ae1c1d8cf1c127d24d0: Status 404 returned error can't find the container with id 7d22a0669924a89a3bfc23aa35c79273f0ccdeaa645e6ae1c1d8cf1c127d24d0
May 29 17:33:50.089395 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.089378    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:33:50.248380 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.248345    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct" event={"ID":"e588263d-5a6c-479e-8e26-c0fbce9f8224","Type":"ContainerStarted","Data":"f6a234eab949554afe793ce3adbbd012b645059330464ca21783804d54a62440"}
May 29 17:33:50.248380 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.248387    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct" event={"ID":"e588263d-5a6c-479e-8e26-c0fbce9f8224","Type":"ContainerStarted","Data":"7d22a0669924a89a3bfc23aa35c79273f0ccdeaa645e6ae1c1d8cf1c127d24d0"}
May 29 17:33:50.248623 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.248486    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:50.266835 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.266781    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct" podStartSLOduration=1.266766948 podStartE2EDuration="1.266766948s" podCreationTimestamp="2026-05-29 17:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:50.264520104 +0000 UTC m=+2209.553311608" watchObservedRunningTime="2026-05-29 17:33:50.266766948 +0000 UTC m=+2209.555558451"
May 29 17:33:50.621500 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:50.621469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4ftb_ccad1c35-c7c6-4a39-b213-f27b3b66157d/node-ca/0.log"
May 29 17:33:51.512069 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:51.512037    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-w2skv_0ae18f2a-0d07-47fd-a020-eaa37b87fd0e/discovery/0.log"
May 29 17:33:51.529534 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:51.529510    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbdcf5ddf-6wr72_ac73967a-9777-49e7-8ffd-2b95d7827011/kube-auth-proxy/0.log"
May 29 17:33:52.193519 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:52.193473    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vmm9p_c0947d5d-7b57-447d-9bf9-7c0fc1b1cb47/serve-healthcheck-canary/0.log"
May 29 17:33:52.799483 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:52.799455    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnfnm_c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5/kube-rbac-proxy/0.log"
May 29 17:33:52.817301 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:52.817274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnfnm_c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5/exporter/0.log"
May 29 17:33:52.836098 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:52.836080    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnfnm_c6a0b66d-c3b0-4ec1-91ae-ac03affbcbf5/extractor/0.log"
May 29 17:33:54.774089 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:54.774058    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76cb944577-26c45_064069c9-96c3-43f4-9f9b-93ef37c238fa/nginx/0.log"
May 29 17:33:54.818568 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:54.818540    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9xb5c_d6739a8b-286b-4cee-ac38-3b8fc4b13311/manager/0.log"
May 29 17:33:54.895073 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:54.895040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wcnb4_5daea879-c35a-4ec4-873c-a0808eb77701/manager/0.log"
May 29 17:33:55.104063 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:55.104016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-gfv95_5ff948c7-3b14-4301-a436-68c8be52e256/manager/0.log"
May 29 17:33:55.249475 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:55.249428    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-hfvhg_b7b965fb-e0d4-414a-ba6b-7675eeb84b62/manager/0.log"
May 29 17:33:55.264361 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:55.264254    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-hfvhg_b7b965fb-e0d4-414a-ba6b-7675eeb84b62/copy-manifests/0.log"
May 29 17:33:56.263294 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:56.263265    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-xtqct"
May 29 17:33:56.657089 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:33:56.657059    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-868dw_5ef26e10-dd06-4b34-a294-c7dfdc7c7be9/openshift-lws-operator/0.log"
May 29 17:34:01.418501 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:01.418472    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-qrhpc_9cf68903-3db2-422f-97c5-40c06c42a37c/migrator/0.log"
May 29 17:34:01.436792 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:01.436770    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-qrhpc_9cf68903-3db2-422f-97c5-40c06c42a37c/graceful-termination/0.log"
May 29 17:34:02.909855 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:02.909806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/kube-multus-additional-cni-plugins/0.log"
May 29 17:34:02.930576 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:02.930554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/egress-router-binary-copy/0.log"
May 29 17:34:02.948404 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:02.948379    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/cni-plugins/0.log"
May 29 17:34:02.966993 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:02.966968    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/bond-cni-plugin/0.log"
May 29 17:34:02.986006 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:02.985978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/routeoverride-cni/0.log"
May 29 17:34:03.006837 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:03.006791    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/whereabouts-cni-bincopy/0.log"
May 29 17:34:03.027301 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:03.027275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4454q_f1383b6f-d930-4d19-999c-41339e2b8d70/whereabouts-cni/0.log"
May 29 17:34:03.465236 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:03.465205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h6gp6_66bab7e7-d445-4ab1-a2e1-3724d95c057b/kube-multus/0.log"
May 29 17:34:03.524603 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:03.524572    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tnvp5_4ea16f49-88cb-4987-ba18-a6c3c534282a/network-metrics-daemon/0.log"
May 29 17:34:03.544902 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:03.544877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tnvp5_4ea16f49-88cb-4987-ba18-a6c3c534282a/kube-rbac-proxy/0.log"
May 29 17:34:04.667374 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.667341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-controller/0.log"
May 29 17:34:04.682557 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.682527    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/0.log"
May 29 17:34:04.692391 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.692367    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovn-acl-logging/1.log"
May 29 17:34:04.707762 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.707741    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/kube-rbac-proxy-node/0.log"
May 29 17:34:04.725894 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.725871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/kube-rbac-proxy-ovn-metrics/0.log"
May 29 17:34:04.746013 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.745990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/northd/0.log"
May 29 17:34:04.763814 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.763791    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/nbdb/0.log"
May 29 17:34:04.781976 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.781957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/sbdb/0.log"
May 29 17:34:04.875598 ip-10-0-128-169 kubenswrapper[2564]: I0529 17:34:04.875565    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpcnk_5204caf5-e98b-4d5a-b23d-9f6c64fde9ce/ovnkube-controller/0.log"