May 29 13:42:15.352653 ip-10-0-129-53 systemd[1]: Starting Kubernetes Kubelet... May 29 13:42:15.815912 ip-10-0-129-53 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 13:42:15.815912 ip-10-0-129-53 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 13:42:15.815912 ip-10-0-129-53 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 13:42:15.815912 ip-10-0-129-53 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 13:42:15.815912 ip-10-0-129-53 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 13:42:15.817340 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.817252 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 13:42:15.821884 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821861 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 13:42:15.821884 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821879 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 13:42:15.821884 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821882 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 13:42:15.821884 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821886 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 13:42:15.821884 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821889 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821892 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821896 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821899 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821902 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821905 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821908 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821911 2568 feature_gate.go:328] unrecognized feature gate: Example May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821914 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821916 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821919 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821922 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821924 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821927 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821930 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821932 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821935 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821938 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821940 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821943 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 13:42:15.822083 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821948 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821951 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821954 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821956 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821959 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821961 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821994 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.821997 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822001 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822004 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822007 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822009 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822012 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822015 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822019 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822022 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822026 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822030 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822033 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 13:42:15.822612 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822036 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822038 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822041 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822044 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822047 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822050 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822053 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822056 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822058 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822062 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822066 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822069 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822072 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822075 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822078 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822080 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822083 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822086 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822090 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 13:42:15.823065 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822093 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822096 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822099 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822101 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822104 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822107 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822109 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822112 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822115 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822118 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822121 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822124 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822126 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822129 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822132 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822134 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822137 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822140 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822142 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822145 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 13:42:15.823535 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822147 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822150 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822152 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822154 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822558 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822564 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822567 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822570 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822573 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822576 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822579 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822582 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822585 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822588 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822591 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822595 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822598 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822601 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822604 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 13:42:15.824015 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822607 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822610 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822612 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822615 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822618 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822620 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822623 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822626 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822628 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822631 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822635 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822639 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822642 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822645 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822648 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822651 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822654 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822658 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822661 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822663 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 13:42:15.824493 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822666 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822669 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822673 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822676 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822679 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822682 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822684 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822687 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822690 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822692 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822695 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822697 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822700 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822703 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822705 2568 feature_gate.go:328] unrecognized feature gate: Example May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822707 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822710 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822713 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822715 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822718 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 13:42:15.825010 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822720 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822722 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822725 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822728 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822730 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822733 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822735 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822738 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822740 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822746 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822749 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822751 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822754 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822756 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822759 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822764 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822766 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822769 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822771 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822774 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 13:42:15.825523 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822777 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822779 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822782 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822784 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822786 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822789 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822791 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822794 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822796 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822798 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.822801 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822870 2568 flags.go:64] FLAG: --address="0.0.0.0" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822878 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822894 2568 flags.go:64] FLAG: --anonymous-auth="true" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822901 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822906 2568 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822909 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822914 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822918 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822921 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822924 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 13:42:15.826013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822929 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822933 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822936 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822939 2568 flags.go:64] FLAG: --cgroup-root="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822942 2568 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822945 2568 flags.go:64] FLAG: --client-ca-file="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822948 2568 flags.go:64] FLAG: --cloud-config="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822951 2568 flags.go:64] FLAG: --cloud-provider="external" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822954 2568 flags.go:64] FLAG: --cluster-dns="[]" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822959 2568 flags.go:64] FLAG: --cluster-domain="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822961 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822965 2568 flags.go:64] FLAG: --config-dir="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822968 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822971 2568 flags.go:64] FLAG: --container-log-max-files="5" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822975 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822978 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822981 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822984 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822987 2568 flags.go:64] FLAG: --contention-profiling="false" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822990 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822993 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822996 2568 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.822999 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823003 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823006 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 13:42:15.826585 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823009 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823012 2568 flags.go:64] FLAG: --enable-load-reader="false" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823015 2568 flags.go:64] FLAG: --enable-server="true" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823018 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823023 2568 flags.go:64] FLAG: --event-burst="100" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823026 2568 flags.go:64] FLAG: --event-qps="50" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823029 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823033 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823036 2568 flags.go:64] FLAG: --eviction-hard="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823040 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823044 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823047 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823050 2568 flags.go:64] FLAG: --eviction-soft="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823053 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823056 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823058 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823062 2568 flags.go:64] FLAG: --experimental-mounter-path="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823064 2568 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823067 2568 flags.go:64] FLAG: --fail-swap-on="true" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823070 2568 flags.go:64] FLAG: --feature-gates="" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823075 2568 flags.go:64] FLAG: --file-check-frequency="20s" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823078 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823081 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823084 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823087 2568 flags.go:64] FLAG: --healthz-port="10248" May 29 13:42:15.827199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823090 2568 flags.go:64] FLAG: --help="false" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823093 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-129-53.ec2.internal" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823097 2568 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823099 2568 flags.go:64] FLAG: --http-check-frequency="20s" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823102 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823106 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823109 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823112 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823115 2568 flags.go:64] FLAG: --image-service-endpoint="" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823118 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823121 2568 flags.go:64] FLAG: --kube-api-burst="100" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823124 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823127 2568 flags.go:64] FLAG: --kube-api-qps="50" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823130 2568 flags.go:64] FLAG: --kube-reserved="" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823134 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823137 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823140 2568 flags.go:64] FLAG: --kubelet-cgroups="" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823143 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823146 2568 flags.go:64] FLAG: --lock-file="" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823149 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823152 2568 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823155 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823161 2568 flags.go:64] FLAG: --log-json-split-stream="false" May 29 13:42:15.827831 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823164 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823166 2568 flags.go:64] FLAG: --log-text-split-stream="false" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823169 2568 flags.go:64] FLAG: --logging-format="text" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823172 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823176 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823179 2568 flags.go:64] FLAG: --manifest-url="" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823181 2568 flags.go:64] FLAG: --manifest-url-header="" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823185 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823188 2568 flags.go:64] FLAG: --max-open-files="1000000" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823193 2568 flags.go:64] FLAG: --max-pods="110" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823196 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823199 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823202 2568 flags.go:64] FLAG: --memory-manager-policy="None" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823205 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823208 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823211 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823214 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823221 2568 flags.go:64] FLAG: --node-status-max-images="50" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823223 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823226 2568 flags.go:64] FLAG: --oom-score-adj="-999" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823230 2568 flags.go:64] FLAG: --pod-cidr="" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823233 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823239 2568 flags.go:64] FLAG: --pod-manifest-path="" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823243 2568 flags.go:64] FLAG: --pod-max-pids="-1" May 29 13:42:15.828395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823246 2568 flags.go:64] FLAG: --pods-per-core="0" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823249 2568 flags.go:64] FLAG: --port="10250" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823253 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823256 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed2a13743cdea4ff" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823259 2568 flags.go:64] FLAG: --qos-reserved="" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823262 2568 flags.go:64] FLAG: --read-only-port="10255" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823265 2568 flags.go:64] FLAG: --register-node="true" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823268 2568 flags.go:64] FLAG: --register-schedulable="true" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823271 2568 flags.go:64] FLAG: --register-with-taints="" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823275 2568 flags.go:64] FLAG: --registry-burst="10" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823278 2568 flags.go:64] FLAG: --registry-qps="5" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823281 2568 flags.go:64] FLAG: --reserved-cpus="" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823283 2568 flags.go:64] FLAG: --reserved-memory="" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823287 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823290 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823293 2568 flags.go:64] FLAG: --rotate-certificates="false" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823296 2568 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823299 2568 flags.go:64] FLAG: --runonce="false" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823302 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823305 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823307 2568 flags.go:64] FLAG: --seccomp-default="false" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823310 2568 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823313 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823316 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823319 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823323 2568 flags.go:64] FLAG: --storage-driver-password="root" May 29 13:42:15.828982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823326 2568 flags.go:64] FLAG: --storage-driver-secure="false" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823328 2568 flags.go:64] FLAG: --storage-driver-table="stats" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823331 2568 flags.go:64] FLAG: --storage-driver-user="root" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823334 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823337 2568 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823342 2568 flags.go:64] FLAG: --system-cgroups="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823345 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823350 2568 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823354 2568 flags.go:64] FLAG: --tls-cert-file="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823371 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823376 2568 flags.go:64] FLAG: --tls-min-version="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823379 2568 flags.go:64] FLAG: --tls-private-key-file="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823382 2568 flags.go:64] FLAG: --topology-manager-policy="none" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823385 2568 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823388 2568 flags.go:64] FLAG: --topology-manager-scope="container" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823391 2568 flags.go:64] FLAG: --v="2" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823395 2568 flags.go:64] FLAG: --version="false" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823400 2568 flags.go:64] FLAG: --vmodule="" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823404 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823407 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823498 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823502 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823505 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823508 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 13:42:15.829660 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823511 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823513 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823516 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823518 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823521 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823524 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823526 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823529 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823532 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823534 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823537 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823540 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823543 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823547 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823550 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823552 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823556 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823559 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823562 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 13:42:15.830233 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823565 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823567 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823570 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823572 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823575 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823577 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823580 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823582 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823585 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823587 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823590 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823593 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823595 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823597 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823600 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823602 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823605 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823607 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823610 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823612 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 13:42:15.830746 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823615 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823617 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823620 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823623 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823625 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823628 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823631 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823634 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823636 2568 feature_gate.go:328] unrecognized feature gate: Example May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823640 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823643 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823646 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823648 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823652 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823656 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823659 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823661 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823665 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823669 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 13:42:15.831244 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823672 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823674 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823677 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823679 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823682 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823684 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823687 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823689 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823692 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823694 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823697 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823700 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823702 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823705 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823707 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823710 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823713 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823715 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823718 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823721 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 13:42:15.831711 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823724 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823726 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823731 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.823733 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.823739 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.830297 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.830313 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830395 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830401 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830404 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830408 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830411 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830414 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830417 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830420 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830423 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 13:42:15.832203 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830426 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830428 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830432 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830434 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830437 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830440 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830443 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830445 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830448 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830450 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830453 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830456 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830459 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830462 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830464 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830467 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830471 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830473 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830476 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830480 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 13:42:15.832618 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830483 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830486 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830490 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830492 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830495 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830498 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830501 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830503 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830506 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830509 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830511 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830514 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830517 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830519 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830522 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830524 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830527 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830530 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830532 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830535 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 13:42:15.833109 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830537 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830540 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830543 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830545 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830548 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830550 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830553 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830555 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830558 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830563 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830567 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830571 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830573 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830576 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830579 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830582 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830587 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830590 2568 feature_gate.go:328] unrecognized feature gate: Example May 29 13:42:15.833620 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830593 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830595 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830598 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830600 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830603 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830606 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830608 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830611 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830614 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830617 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830619 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830622 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830624 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830627 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830629 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830632 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830635 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 13:42:15.834122 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830637 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.830643 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830740 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830745 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830749 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830752 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830755 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830758 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830761 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830764 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830768 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830770 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830773 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830775 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830778 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830781 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 13:42:15.834552 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830783 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830786 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830790 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830794 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830797 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830800 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830805 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830808 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830811 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830814 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830816 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830819 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830822 2568 feature_gate.go:328] unrecognized feature gate: Example May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830824 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830827 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830829 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830831 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830834 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830837 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830839 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 13:42:15.834987 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830842 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830844 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830847 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830859 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830862 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830865 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830867 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830870 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830873 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830875 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830878 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830880 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830883 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830886 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830888 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830891 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830894 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830896 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830899 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 13:42:15.835520 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830902 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830904 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830907 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830909 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830912 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830914 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830917 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830920 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830922 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830925 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830927 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830930 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830933 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830935 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830938 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830941 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830943 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830949 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830952 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 13:42:15.836121 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830955 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830957 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830960 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830962 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830965 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830967 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830970 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830972 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830975 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830978 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830980 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830983 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830986 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:15.830988 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.830994 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 13:42:15.836637 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.831689 2568 server.go:962] "Client rotation is on, will bootstrap in background" May 29 13:42:15.837037 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.834694 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 13:42:15.837037 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.835513 2568 server.go:1019] "Starting client certificate rotation" May 29 13:42:15.837037 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.835646 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 13:42:15.837037 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.835693 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 13:42:15.862797 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.862772 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 13:42:15.865218 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.865191 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 13:42:15.884239 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.884220 2568 log.go:25] "Validated CRI v1 runtime API" May 29 13:42:15.889089 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.889075 2568 log.go:25] "Validated CRI v1 image API" May 29 13:42:15.890287 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.890272 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 13:42:15.892570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.892551 2568 fs.go:135] Filesystem UUIDs: map[60a803a3-10e8-423c-ad45-f754b7c122b2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bdf78e71-4b7d-4a85-be0d-2c1fdc8e49b0:/dev/nvme0n1p3] May 29 13:42:15.892645 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.892569 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 13:42:15.897024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.896913 2568 manager.go:217] Machine: {Timestamp:2026-05-29 13:42:15.896427067 +0000 UTC m=+0.430333086 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099972 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221bd3942bd8577d75f5cbcaa6c6fa SystemUUID:ec221bd3-942b-d857-7d75-f5cbcaa6c6fa BootID:7bb0f8b6-190c-4d35-a06f-454b10115a59 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:80:21:6e:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:80:21:6e:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:d1:2c:6c:ef:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 13:42:15.897584 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.897574 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 13:42:15.897662 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.897652 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 13:42:15.901405 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.901379 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 13:42:15.901533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.901406 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 13:42:15.901577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.901543 2568 topology_manager.go:138] "Creating topology manager with none policy" May 29 13:42:15.901577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.901552 2568 container_manager_linux.go:306] "Creating device plugin manager" May 29 13:42:15.901577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.901559 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 13:42:15.902324 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.902314 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 13:42:15.902788 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.902770 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 13:42:15.904053 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.904040 2568 state_mem.go:36] "Initialized new in-memory state store" May 29 13:42:15.904171 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.904163 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 13:42:15.906438 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.906428 2568 kubelet.go:491] "Attempting to sync node with API server" May 29 13:42:15.906480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.906441 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 13:42:15.906480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.906454 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 13:42:15.906480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.906463 2568 kubelet.go:397] "Adding apiserver pod source" May 29 13:42:15.906480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.906471 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 13:42:15.907541 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.907529 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 13:42:15.907589 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.907548 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 13:42:15.911537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.911498 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 13:42:15.914318 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.914301 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 13:42:15.915176 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915162 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 13:42:15.915214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915185 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 13:42:15.915214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915194 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 13:42:15.915214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915199 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 13:42:15.915214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915207 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 13:42:15.915214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915213 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 13:42:15.915353 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915219 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 13:42:15.915353 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915225 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 13:42:15.915353 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915234 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 13:42:15.915353 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915243 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 13:42:15.915353 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915255 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 13:42:15.915663 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.915654 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 13:42:15.916518 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.916506 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 13:42:15.916565 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.916521 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 13:42:15.917450 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.917419 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 13:42:15.917534 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.917420 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 13:42:15.918784 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.918770 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 13:42:15.919605 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.919592 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 13:42:15.919652 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.919627 2568 server.go:1295] "Started kubelet" May 29 13:42:15.919762 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.919721 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 13:42:15.919825 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.919720 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 13:42:15.919877 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.919843 2568 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 13:42:15.920529 ip-10-0-129-53 systemd[1]: Started Kubernetes Kubelet. May 29 13:42:15.920869 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.920837 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 13:42:15.923203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.923189 2568 server.go:317] "Adding debug handlers to kubelet server" May 29 13:42:15.928637 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.928620 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 13:42:15.929021 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929008 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 13:42:15.929080 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929053 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 13:42:15.929124 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929079 2568 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 13:42:15.929124 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929094 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 13:42:15.929305 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929289 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 13:42:15.929446 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929418 2568 reconstruct.go:97] "Volume reconstruction finished" May 29 13:42:15.929446 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.929430 2568 reconciler.go:26] "Reconciler: start to sync state" May 29 13:42:15.929994 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.929795 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:15.930327 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930313 2568 factory.go:153] Registering CRI-O factory May 29 13:42:15.930327 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930328 2568 factory.go:223] Registration of the crio container factory successfully May 29 13:42:15.930485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930397 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 13:42:15.930485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930407 2568 factory.go:55] Registering systemd factory May 29 13:42:15.930485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930415 2568 factory.go:223] Registration of the systemd container factory successfully May 29 13:42:15.930485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930431 2568 factory.go:103] Registering Raw factory May 29 13:42:15.930485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930444 2568 manager.go:1196] Started watching for new ooms in manager May 29 13:42:15.930955 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.930941 2568 manager.go:319] Starting recovery of all containers May 29 13:42:15.933708 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.933676 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 29 13:42:15.934521 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.934497 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 29 13:42:15.934709 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.933891 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-53.ec2.internal.18b40d14d99c7569 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-53.ec2.internal,UID:ip-10-0-129-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-53.ec2.internal,},FirstTimestamp:2026-05-29 13:42:15.919605097 +0000 UTC m=+0.453511118,LastTimestamp:2026-05-29 13:42:15.919605097 +0000 UTC m=+0.453511118,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-53.ec2.internal,}" May 29 13:42:15.943059 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.942892 2568 manager.go:324] Recovery completed May 29 13:42:15.947070 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.947059 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:15.949095 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949079 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:15.949160 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949106 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:15.949160 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949116 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:15.949614 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949602 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 13:42:15.949614 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949612 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 13:42:15.949691 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.949626 2568 state_mem.go:36] "Initialized new in-memory state store" May 29 13:42:15.951343 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.951277 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-53.ec2.internal.18b40d14db5e6d96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-53.ec2.internal,UID:ip-10-0-129-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-53.ec2.internal,},FirstTimestamp:2026-05-29 13:42:15.949094294 +0000 UTC m=+0.483000313,LastTimestamp:2026-05-29 13:42:15.949094294 +0000 UTC m=+0.483000313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-53.ec2.internal,}" May 29 13:42:15.952120 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.952101 2568 policy_none.go:49] "None policy: Start" May 29 13:42:15.952120 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.952120 2568 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 13:42:15.952263 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.952131 2568 state_mem.go:35] "Initializing new in-memory state store" May 29 13:42:15.960178 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.960121 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-53.ec2.internal.18b40d14db5eaeba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-53.ec2.internal,UID:ip-10-0-129-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-53.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-53.ec2.internal,},FirstTimestamp:2026-05-29 13:42:15.94911097 +0000 UTC m=+0.483016987,LastTimestamp:2026-05-29 13:42:15.94911097 +0000 UTC m=+0.483016987,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-53.ec2.internal,}" May 29 13:42:15.970527 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.970464 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-53.ec2.internal.18b40d14db5ed386 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-53.ec2.internal,UID:ip-10-0-129-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-53.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-53.ec2.internal,},FirstTimestamp:2026-05-29 13:42:15.94912039 +0000 UTC m=+0.483026407,LastTimestamp:2026-05-29 13:42:15.94912039 +0000 UTC m=+0.483026407,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-53.ec2.internal,}" May 29 13:42:15.983921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.983907 2568 manager.go:341] "Starting Device Plugin manager" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.983939 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.983948 2568 server.go:85] "Starting device plugin registration server" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.984173 2568 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.984188 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.984266 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.984330 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:15.984338 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.984833 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 13:42:15.994961 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.984873 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:15.998838 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:15.998782 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-53.ec2.internal.18b40d14dd91571d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-53.ec2.internal,UID:ip-10-0-129-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-129-53.ec2.internal,},FirstTimestamp:2026-05-29 13:42:15.985985309 +0000 UTC m=+0.519891313,LastTimestamp:2026-05-29 13:42:15.985985309 +0000 UTC m=+0.519891313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-53.ec2.internal,}" May 29 13:42:16.019274 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.019252 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lntlz" May 29 13:42:16.030687 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.030669 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lntlz" May 29 13:42:16.050263 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.050234 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 13:42:16.051508 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.051489 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 13:42:16.051508 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.051507 2568 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 13:42:16.051617 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.051523 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 13:42:16.051617 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.051532 2568 kubelet.go:2451] "Starting kubelet main sync loop" May 29 13:42:16.051617 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.051574 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 13:42:16.058676 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.058653 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 13:42:16.085086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.085071 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:16.086072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.086056 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:16.086159 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.086090 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:16.086159 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.086108 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:16.086159 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.086140 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-53.ec2.internal" May 29 13:42:16.092644 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.092629 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-53.ec2.internal" May 29 13:42:16.092711 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.092650 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-53.ec2.internal\": node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.109234 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.109215 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.151681 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.151663 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal"] May 29 13:42:16.151755 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.151728 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:16.152450 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.152435 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:16.152519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.152467 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:16.152519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.152479 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:16.153967 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.153954 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:16.154145 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154126 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.154191 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154154 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:16.154610 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154593 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:16.154712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154623 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:16.154712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154637 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:16.154712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154598 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:16.154712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154696 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:16.154712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.154705 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:16.155798 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.155782 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:16.155879 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.155811 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 13:42:16.156429 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.156413 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientMemory" May 29 13:42:16.156497 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.156443 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasNoDiskPressure" May 29 13:42:16.156497 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.156458 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeHasSufficientPID" May 29 13:42:16.180006 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.179990 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-53.ec2.internal\" not found" node="ip-10-0-129-53.ec2.internal" May 29 13:42:16.184388 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.184375 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-53.ec2.internal\" not found" node="ip-10-0-129-53.ec2.internal" May 29 13:42:16.210150 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.210132 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.231407 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.231388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.231485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.231410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3df1bb21d6366b73602f6da128df9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-129-53.ec2.internal\" (UID: \"e3df1bb21d6366b73602f6da128df9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:16.231485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.231425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.310243 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.310221 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.332577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332556 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.332646 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.332646 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.332748 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332625 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f04d31d2308764f443098729df95f23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal\" (UID: \"9f04d31d2308764f443098729df95f23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.332802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332746 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3df1bb21d6366b73602f6da128df9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-129-53.ec2.internal\" (UID: \"e3df1bb21d6366b73602f6da128df9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:16.332802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.332785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3df1bb21d6366b73602f6da128df9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-129-53.ec2.internal\" (UID: \"e3df1bb21d6366b73602f6da128df9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:16.410995 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.410937 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.482395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.482371 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:16.487072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.487057 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:16.511631 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.511608 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.612148 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.612112 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.712635 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.712576 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.813049 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.813023 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.835371 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.835349 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 13:42:16.835970 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.835539 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 13:42:16.913918 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:16.913888 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-53.ec2.internal\" not found" May 29 13:42:16.929645 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.929626 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 13:42:16.946575 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.946554 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 13:42:16.948352 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.948331 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 13:42:16.962539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.962517 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbsfz" May 29 13:42:16.965084 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.965034 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 13:42:16.972812 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:16.972793 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbsfz" May 29 13:42:17.007614 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:17.007582 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3df1bb21d6366b73602f6da128df9ea.slice/crio-fce324491377d28c649b9c8d3fde925f5a1138cce3f63420e61a0cdfe4970602 WatchSource:0}: Error finding container fce324491377d28c649b9c8d3fde925f5a1138cce3f63420e61a0cdfe4970602: Status 404 returned error can't find the container with id fce324491377d28c649b9c8d3fde925f5a1138cce3f63420e61a0cdfe4970602 May 29 13:42:17.007958 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:17.007945 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f04d31d2308764f443098729df95f23.slice/crio-6529b7884e10516eaea303f25e3d0bf4be7e265b4e10b8b8bd797d0dbbd40cbd WatchSource:0}: Error finding container 6529b7884e10516eaea303f25e3d0bf4be7e265b4e10b8b8bd797d0dbbd40cbd: Status 404 returned error can't find the container with id 6529b7884e10516eaea303f25e3d0bf4be7e265b4e10b8b8bd797d0dbbd40cbd May 29 13:42:17.011733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.011676 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 13:42:17.030066 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.030048 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" May 29 13:42:17.032203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.032181 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 13:37:16 +0000 UTC" deadline="2027-11-17 06:00:51.604676764 +0000 UTC" May 29 13:42:17.032257 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.032203 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12880h18m34.572475901s" May 29 13:42:17.040020 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.040006 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 13:42:17.041568 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.041551 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 13:42:17.042888 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.042875 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" May 29 13:42:17.053999 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.053958 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" event={"ID":"9f04d31d2308764f443098729df95f23","Type":"ContainerStarted","Data":"6529b7884e10516eaea303f25e3d0bf4be7e265b4e10b8b8bd797d0dbbd40cbd"} May 29 13:42:17.054286 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.054259 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 13:42:17.055023 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.055002 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" event={"ID":"e3df1bb21d6366b73602f6da128df9ea","Type":"ContainerStarted","Data":"fce324491377d28c649b9c8d3fde925f5a1138cce3f63420e61a0cdfe4970602"} May 29 13:42:17.908700 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.908666 2568 apiserver.go:52] "Watching apiserver" May 29 13:42:17.917043 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.917018 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 13:42:17.919096 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.919066 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jmf9q","openshift-image-registry/node-ca-l9j5k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal","openshift-multus/multus-7lblt","openshift-network-diagnostics/network-check-target-wrpvz","openshift-network-operator/iptables-alerter-wgtb2","kube-system/konnectivity-agent-r96vp","openshift-cluster-node-tuning-operator/tuned-pzhtb","openshift-multus/multus-additional-cni-plugins-zsprg","openshift-multus/network-metrics-daemon-8g898","openshift-ovn-kubernetes/ovnkube-node-gzlrx","kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl"] May 29 13:42:17.920923 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.920901 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:17.922232 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.922149 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:17.923289 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.923233 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7lblt" May 29 13:42:17.923931 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.923910 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 13:42:17.924024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.923959 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 13:42:17.924024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.923985 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6cjbk\"" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.924676 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.924723 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r6rvh\"" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.924676 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:17.924785 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.925104 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 13:42:17.925533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.925341 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 13:42:17.925961 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.925704 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 13:42:17.926221 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.926062 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5dvpd\"" May 29 13:42:17.926221 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.926090 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 13:42:17.926374 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.926315 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 13:42:17.926442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.926384 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 13:42:17.927068 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.927051 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:17.928307 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.928282 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:17.930670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.930155 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 13:42:17.930670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.930191 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 13:42:17.930670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.930235 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7hggn\"" May 29 13:42:17.930670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.930429 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.931083 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.931067 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 13:42:17.931571 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.931548 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltcdh\"" May 29 13:42:17.931799 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.931768 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 13:42:17.933178 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.933160 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 13:42:17.933307 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.933291 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q2ncd\"" May 29 13:42:17.933630 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.933614 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 13:42:17.933824 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.933800 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 13:42:17.935419 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.934819 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.935497 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.935475 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:17.935610 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:17.935586 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:17.937564 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.937544 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 13:42:17.937893 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.937843 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzqgh\"" May 29 13:42:17.938086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.938045 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 13:42:17.938468 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.938454 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:17.940063 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.940042 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:17.940718 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.940698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cnibin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.940815 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.940763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-etc-kubernetes\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.940815 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.940793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6a78835-f073-4672-b831-8b73f37dc8ab-konnectivity-ca\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:17.941053 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c376ca09-36c0-4d9c-ae34-3373a99c30b4-iptables-alerter-script\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:17.941200 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.941322 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmsd\" (UniqueName: \"kubernetes.io/projected/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-kube-api-access-xbmsd\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:17.941469 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941109 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 13:42:17.941531 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-bin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.941598 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941525 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-conf-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.941598 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpk7\" (UniqueName: \"kubernetes.io/projected/c376ca09-36c0-4d9c-ae34-3373a99c30b4-kube-api-access-9tpk7\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:17.941598 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d1e520-cbc2-4d71-9117-9c1efa012450-hosts-file\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:17.941739 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-sys\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.941739 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-var-lib-kubelet\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.941739 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-os-release\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.941893 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.941893 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.941893 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941862 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.942035 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-host\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.942035 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-etc-tuned\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.942035 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cnibin\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.942035 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941949 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jj8l\"" May 29 13:42:17.942229 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942052 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 13:42:17.942229 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942078 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 13:42:17.942229 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942157 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 13:42:17.942229 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942209 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 13:42:17.942442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.941952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.942442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.942442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cni-binary-copy\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.942442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942350 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 13:42:17.942442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942390 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlxq\" (UniqueName: \"kubernetes.io/projected/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-kube-api-access-wtlxq\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942496 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysconfig\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942575 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-kubernetes\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.942680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-conf\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-run\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x56f\" (UniqueName: \"kubernetes.io/projected/201c88d5-b244-4d02-9d80-8235b7028202-kube-api-access-5x56f\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmvt\" (UniqueName: \"kubernetes.io/projected/b9a878eb-416d-4400-9342-fae2ce8ba6fd-kube-api-access-pkmvt\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d1e520-cbc2-4d71-9117-9c1efa012450-tmp-dir\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942838 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-tmp\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-host\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-os-release\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-socket-dir-parent\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942941 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vl45n\"" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.942951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-k8s-cni-cncf-io\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943107 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-netns\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943601 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-multus\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943601 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6a78835-f073-4672-b831-8b73f37dc8ab-agent-certs\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:17.943601 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c376ca09-36c0-4d9c-ae34-3373a99c30b4-host-slash\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:17.943785 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-lib-modules\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943836 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-modprobe-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.943879 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:17.943879 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-system-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943941 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943891 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-kubelet\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.943941 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943913 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-hostroot\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.944041 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.943965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-daemon-config\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.944041 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.944015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-multus-certs\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:17.944134 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.944061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws58z\" (UniqueName: \"kubernetes.io/projected/e8d1e520-cbc2-4d71-9117-9c1efa012450-kube-api-access-ws58z\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:17.944134 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.944122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-systemd\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:17.944229 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.944147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-serviceca\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:17.973456 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.973425 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 13:37:16 +0000 UTC" deadline="2028-02-15 19:30:05.171677452 +0000 UTC" May 29 13:42:17.973456 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:17.973455 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15053h47m47.198226109s" May 29 13:42:18.019991 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.019968 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 13:42:18.030702 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.030677 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 13:42:18.044696 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044670 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-system-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.044801 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-log-socket\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.044801 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ws58z\" (UniqueName: \"kubernetes.io/projected/e8d1e520-cbc2-4d71-9117-9c1efa012450-kube-api-access-ws58z\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.044801 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044778 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-serviceca\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.044801 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044795 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cnibin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.044990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044811 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.044990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.044990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044926 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cnibin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.044990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.044789 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-system-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045029 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmsd\" (UniqueName: \"kubernetes.io/projected/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-kube-api-access-xbmsd\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045049 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-bin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-bin\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045186 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpk7\" (UniqueName: \"kubernetes.io/projected/c376ca09-36c0-4d9c-ae34-3373a99c30b4-kube-api-access-9tpk7\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.045209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045202 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d1e520-cbc2-4d71-9117-9c1efa012450-hosts-file\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045227 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-os-release\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-serviceca\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045289 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-etc-tuned\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045290 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d1e520-cbc2-4d71-9117-9c1efa012450-hosts-file\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-os-release\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045325 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cnibin\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cnibin\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-bin\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovn-node-metrics-cert\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045517 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysconfig\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.045544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045542 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-kubernetes\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045557 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-conf\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045576 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-run\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045573 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045594 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-kubernetes\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5x56f\" (UniqueName: \"kubernetes.io/projected/201c88d5-b244-4d02-9d80-8235b7028202-kube-api-access-5x56f\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-run\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045651 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-host\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysctl-conf\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045666 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-os-release\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045681 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-tmp\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045691 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-host\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045702 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-socket-dir-parent\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045581 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-sysconfig\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045757 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-socket-dir-parent\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-os-release\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045768 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-multus\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.046142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-cni-multus\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045854 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-daemon-config\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045883 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-multus-certs\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045954 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-multus-certs\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.045907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-socket-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-registration-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046122 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c376ca09-36c0-4d9c-ae34-3373a99c30b4-host-slash\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046143 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-lib-modules\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-kubelet\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-slash\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-ovn\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-lib-modules\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-env-overrides\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046378 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c376ca09-36c0-4d9c-ae34-3373a99c30b4-host-slash\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046417 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-script-lib\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-daemon-config\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.046924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046447 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-modprobe-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046475 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046501 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-hostroot\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046529 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlw6p\" (UniqueName: \"kubernetes.io/projected/b01e0990-f3cf-496b-8266-d89ed137c0d5-kube-api-access-tlw6p\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-device-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-sys-fs\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046541 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-modprobe-d\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-netns\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046576 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-hostroot\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046761 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-systemd\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046783 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-etc-kubernetes\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-netd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046825 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-etc-systemd\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046831 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6a78835-f073-4672-b831-8b73f37dc8ab-konnectivity-ca\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046856 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c376ca09-36c0-4d9c-ae34-3373a99c30b4-iptables-alerter-script\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046873 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-etc-kubernetes\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.047754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046881 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-conf-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-etc-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-node-log\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046962 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-sys\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.046988 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-var-lib-kubelet\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047014 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047046 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047073 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047102 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-var-lib-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047185 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-host\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047208 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047234 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047259 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cni-binary-copy\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlxq\" (UniqueName: \"kubernetes.io/projected/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-kube-api-access-wtlxq\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.048594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99gzx\" (UniqueName: \"kubernetes.io/projected/b9a1b756-b2c0-4420-95cf-d951f5234073-kube-api-access-99gzx\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-systemd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6a78835-f073-4672-b831-8b73f37dc8ab-konnectivity-ca\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gvf\" (UniqueName: \"kubernetes.io/projected/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-kube-api-access-z4gvf\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047421 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmvt\" (UniqueName: \"kubernetes.io/projected/b9a878eb-416d-4400-9342-fae2ce8ba6fd-kube-api-access-pkmvt\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047446 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-kubelet\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047479 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d1e520-cbc2-4d71-9117-9c1efa012450-tmp-dir\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047508 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-k8s-cni-cncf-io\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047535 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-netns\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-systemd-units\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047592 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6a78835-f073-4672-b831-8b73f37dc8ab-agent-certs\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-config\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047745 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-host\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a878eb-416d-4400-9342-fae2ce8ba6fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.047967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-cni-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048165 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c376ca09-36c0-4d9c-ae34-3373a99c30b4-iptables-alerter-script\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048232 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-multus-conf-dir\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.049428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048309 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-sys\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c88d5-b244-4d02-9d80-8235b7028202-var-lib-kubelet\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-cni-binary-copy\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-tmp\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048630 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-k8s-cni-cncf-io\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/201c88d5-b244-4d02-9d80-8235b7028202-etc-tuned\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048666 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d1e520-cbc2-4d71-9117-9c1efa012450-tmp-dir\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-var-lib-kubelet\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048679 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-host-run-netns\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048910 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.048976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.050220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.049394 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a878eb-416d-4400-9342-fae2ce8ba6fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.050989 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.050968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6a78835-f073-4672-b831-8b73f37dc8ab-agent-certs\") pod \"konnectivity-agent-r96vp\" (UID: \"f6a78835-f073-4672-b831-8b73f37dc8ab\") " pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:18.053155 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.053134 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:18.053252 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.053163 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:18.053252 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.053178 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:18.053375 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.053276 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:18.553228415 +0000 UTC m=+3.087134433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:18.055496 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.055352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmsd\" (UniqueName: \"kubernetes.io/projected/a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab-kube-api-access-xbmsd\") pod \"node-ca-l9j5k\" (UID: \"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab\") " pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.056436 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.056411 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws58z\" (UniqueName: \"kubernetes.io/projected/e8d1e520-cbc2-4d71-9117-9c1efa012450-kube-api-access-ws58z\") pod \"node-resolver-jmf9q\" (UID: \"e8d1e520-cbc2-4d71-9117-9c1efa012450\") " pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.056531 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.056440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x56f\" (UniqueName: \"kubernetes.io/projected/201c88d5-b244-4d02-9d80-8235b7028202-kube-api-access-5x56f\") pod \"tuned-pzhtb\" (UID: \"201c88d5-b244-4d02-9d80-8235b7028202\") " pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.056591 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.056571 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpk7\" (UniqueName: \"kubernetes.io/projected/c376ca09-36c0-4d9c-ae34-3373a99c30b4-kube-api-access-9tpk7\") pod \"iptables-alerter-wgtb2\" (UID: \"c376ca09-36c0-4d9c-ae34-3373a99c30b4\") " pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.056929 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.056912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlxq\" (UniqueName: \"kubernetes.io/projected/f403b18d-1117-4910-9d4b-bc1cfd2aa1a9-kube-api-access-wtlxq\") pod \"multus-7lblt\" (UID: \"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9\") " pod="openshift-multus/multus-7lblt" May 29 13:42:18.057243 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.057222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmvt\" (UniqueName: \"kubernetes.io/projected/b9a878eb-416d-4400-9342-fae2ce8ba6fd-kube-api-access-pkmvt\") pod \"multus-additional-cni-plugins-zsprg\" (UID: \"b9a878eb-416d-4400-9342-fae2ce8ba6fd\") " pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.148570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148542 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.148570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148573 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-socket-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148589 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-registration-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148606 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-kubelet\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148622 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-slash\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-slash\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148680 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-registration-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.148701 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148713 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-socket-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148730 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-ovn\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-ovn\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.148793 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148782 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148820 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-env-overrides\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148819 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148705 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-kubelet\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.148853 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:18.648832259 +0000 UTC m=+3.182738280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148879 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-script-lib\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148921 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlw6p\" (UniqueName: \"kubernetes.io/projected/b01e0990-f3cf-496b-8266-d89ed137c0d5-kube-api-access-tlw6p\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148952 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-device-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.148980 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-sys-fs\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149015 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-netns\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-device-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149062 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-netd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149104 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-run-netns\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-sys-fs\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149115 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-etc-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149147 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-node-log\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149119 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-netd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149169 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-etc-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149175 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-var-lib-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-var-lib-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149211 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-node-log\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149208 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149259 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99gzx\" (UniqueName: \"kubernetes.io/projected/b9a1b756-b2c0-4420-95cf-d951f5234073-kube-api-access-99gzx\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149263 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-env-overrides\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-systemd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149315 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gvf\" (UniqueName: \"kubernetes.io/projected/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-kube-api-access-z4gvf\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149340 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-systemd\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149347 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-systemd-units\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149403 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-config\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149431 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-log-socket\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149452 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-script-lib\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149472 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.149908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149476 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-systemd-units\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149508 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-log-socket\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149545 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-run-openvswitch\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149576 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-bin\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149603 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovn-node-metrics-cert\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1b756-b2c0-4420-95cf-d951f5234073-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149621 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-host-cni-bin\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.150537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.149928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovnkube-config\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.152050 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.152033 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-ovn-node-metrics-cert\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.157220 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.157193 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlw6p\" (UniqueName: \"kubernetes.io/projected/b01e0990-f3cf-496b-8266-d89ed137c0d5-kube-api-access-tlw6p\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.157561 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.157543 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99gzx\" (UniqueName: \"kubernetes.io/projected/b9a1b756-b2c0-4420-95cf-d951f5234073-kube-api-access-99gzx\") pod \"aws-ebs-csi-driver-node-fkzfl\" (UID: \"b9a1b756-b2c0-4420-95cf-d951f5234073\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.158672 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.158650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gvf\" (UniqueName: \"kubernetes.io/projected/3aaa700c-e92c-4f83-b4d0-11d6b1c7c476-kube-api-access-z4gvf\") pod \"ovnkube-node-gzlrx\" (UID: \"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.236802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.236728 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:18.246601 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.246576 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9j5k" May 29 13:42:18.256284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.256264 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7lblt" May 29 13:42:18.262738 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.262719 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wgtb2" May 29 13:42:18.270231 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.270214 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jmf9q" May 29 13:42:18.277715 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.277696 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsprg" May 29 13:42:18.284240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.284222 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" May 29 13:42:18.289858 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.289835 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:18.295447 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.295427 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" May 29 13:42:18.638875 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.638843 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf403b18d_1117_4910_9d4b_bc1cfd2aa1a9.slice/crio-ea4bc7276379a475cb2e970b305ffe856e13a7a0e794b94682b8493cd3921d32 WatchSource:0}: Error finding container ea4bc7276379a475cb2e970b305ffe856e13a7a0e794b94682b8493cd3921d32: Status 404 returned error can't find the container with id ea4bc7276379a475cb2e970b305ffe856e13a7a0e794b94682b8493cd3921d32 May 29 13:42:18.639865 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.639841 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d1e520_cbc2_4d71_9117_9c1efa012450.slice/crio-db937d5453d594aa84be66a449d0c229a1128e9365e53d657181f4005c2106ae WatchSource:0}: Error finding container db937d5453d594aa84be66a449d0c229a1128e9365e53d657181f4005c2106ae: Status 404 returned error can't find the container with id db937d5453d594aa84be66a449d0c229a1128e9365e53d657181f4005c2106ae May 29 13:42:18.641152 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.641078 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0886c7f_a0f0_4e97_a7da_8a1a394ef0ab.slice/crio-e8c47c4bbe07d0f215a1b9a0d63e9cf66b506458d385a0a2f72488cc8d392f9b WatchSource:0}: Error finding container e8c47c4bbe07d0f215a1b9a0d63e9cf66b506458d385a0a2f72488cc8d392f9b: Status 404 returned error can't find the container with id e8c47c4bbe07d0f215a1b9a0d63e9cf66b506458d385a0a2f72488cc8d392f9b May 29 13:42:18.641978 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.641940 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201c88d5_b244_4d02_9d80_8235b7028202.slice/crio-10a38323868dad46ba6d1bc7ab87f7ac8e9f272d76419a9e868260d49ebafcd9 WatchSource:0}: Error finding container 10a38323868dad46ba6d1bc7ab87f7ac8e9f272d76419a9e868260d49ebafcd9: Status 404 returned error can't find the container with id 10a38323868dad46ba6d1bc7ab87f7ac8e9f272d76419a9e868260d49ebafcd9 May 29 13:42:18.645276 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.645252 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a1b756_b2c0_4420_95cf_d951f5234073.slice/crio-43c21e12d6172d0bff3128629a4d077162bb7d9d2079b9d9e3108d3ad909bfd4 WatchSource:0}: Error finding container 43c21e12d6172d0bff3128629a4d077162bb7d9d2079b9d9e3108d3ad909bfd4: Status 404 returned error can't find the container with id 43c21e12d6172d0bff3128629a4d077162bb7d9d2079b9d9e3108d3ad909bfd4 May 29 13:42:18.645949 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.645930 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a78835_f073_4672_b831_8b73f37dc8ab.slice/crio-2bffacd86c7f5d5dc9198e2072641204b2062029a15c277275714cda4c828287 WatchSource:0}: Error finding container 2bffacd86c7f5d5dc9198e2072641204b2062029a15c277275714cda4c828287: Status 404 returned error can't find the container with id 2bffacd86c7f5d5dc9198e2072641204b2062029a15c277275714cda4c828287 May 29 13:42:18.646546 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.646527 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a878eb_416d_4400_9342_fae2ce8ba6fd.slice/crio-b46838a4ef02ef40c2b5c8468c6f61d92791133dc08ce3d92065cce8677d836a WatchSource:0}: Error finding container b46838a4ef02ef40c2b5c8468c6f61d92791133dc08ce3d92065cce8677d836a: Status 404 returned error can't find the container with id b46838a4ef02ef40c2b5c8468c6f61d92791133dc08ce3d92065cce8677d836a May 29 13:42:18.647432 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.647275 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aaa700c_e92c_4f83_b4d0_11d6b1c7c476.slice/crio-0a098c6b3340448ab6722e596a013801947592c5164cd9bd51d94145722ae628 WatchSource:0}: Error finding container 0a098c6b3340448ab6722e596a013801947592c5164cd9bd51d94145722ae628: Status 404 returned error can't find the container with id 0a098c6b3340448ab6722e596a013801947592c5164cd9bd51d94145722ae628 May 29 13:42:18.648863 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:42:18.648760 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc376ca09_36c0_4d9c_ae34_3373a99c30b4.slice/crio-574d61db826c73ff407d52f870ae1785416bf58bd8ec08476503b7d87d4d6d8d WatchSource:0}: Error finding container 574d61db826c73ff407d52f870ae1785416bf58bd8ec08476503b7d87d4d6d8d: Status 404 returned error can't find the container with id 574d61db826c73ff407d52f870ae1785416bf58bd8ec08476503b7d87d4d6d8d May 29 13:42:18.652722 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.652699 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:18.652779 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.652756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:18.652878 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.652862 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:18.652955 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.652933 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:19.652914876 +0000 UTC m=+4.186820895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:18.652955 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.652873 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:18.653078 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.652969 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:18.653078 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.652982 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:18.653078 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:18.653020 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:19.653007661 +0000 UTC m=+4.186913681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:18.974746 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.974579 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 13:37:16 +0000 UTC" deadline="2028-02-01 19:42:10.991772389 +0000 UTC" May 29 13:42:18.974746 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:18.974745 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14717h59m52.017030366s" May 29 13:42:19.052538 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.052510 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:19.052673 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.052648 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:19.062759 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.062725 2568 generic.go:358] "Generic (PLEG): container finished" podID="9f04d31d2308764f443098729df95f23" containerID="c8adba382ab1efd3347d33e221e5c772d25d4b5c1b60140391a6d16196036c3a" exitCode=0 May 29 13:42:19.063429 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.063377 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" event={"ID":"9f04d31d2308764f443098729df95f23","Type":"ContainerDied","Data":"c8adba382ab1efd3347d33e221e5c772d25d4b5c1b60140391a6d16196036c3a"} May 29 13:42:19.074304 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.073545 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" event={"ID":"e3df1bb21d6366b73602f6da128df9ea","Type":"ContainerStarted","Data":"0cd44dbc79f1bc3efb96df86b3546dd26506b260a9757c721a99df2786e8fc17"} May 29 13:42:19.079463 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.079414 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"0a098c6b3340448ab6722e596a013801947592c5164cd9bd51d94145722ae628"} May 29 13:42:19.083282 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.082564 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" event={"ID":"201c88d5-b244-4d02-9d80-8235b7028202","Type":"ContainerStarted","Data":"10a38323868dad46ba6d1bc7ab87f7ac8e9f272d76419a9e868260d49ebafcd9"} May 29 13:42:19.084851 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.084828 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9j5k" event={"ID":"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab","Type":"ContainerStarted","Data":"e8c47c4bbe07d0f215a1b9a0d63e9cf66b506458d385a0a2f72488cc8d392f9b"} May 29 13:42:19.091987 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.091940 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jmf9q" event={"ID":"e8d1e520-cbc2-4d71-9117-9c1efa012450","Type":"ContainerStarted","Data":"db937d5453d594aa84be66a449d0c229a1128e9365e53d657181f4005c2106ae"} May 29 13:42:19.095116 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.095068 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7lblt" event={"ID":"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9","Type":"ContainerStarted","Data":"ea4bc7276379a475cb2e970b305ffe856e13a7a0e794b94682b8493cd3921d32"} May 29 13:42:19.098058 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.098036 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wgtb2" event={"ID":"c376ca09-36c0-4d9c-ae34-3373a99c30b4","Type":"ContainerStarted","Data":"574d61db826c73ff407d52f870ae1785416bf58bd8ec08476503b7d87d4d6d8d"} May 29 13:42:19.103737 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.103714 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerStarted","Data":"b46838a4ef02ef40c2b5c8468c6f61d92791133dc08ce3d92065cce8677d836a"} May 29 13:42:19.106758 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.106734 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r96vp" event={"ID":"f6a78835-f073-4672-b831-8b73f37dc8ab","Type":"ContainerStarted","Data":"2bffacd86c7f5d5dc9198e2072641204b2062029a15c277275714cda4c828287"} May 29 13:42:19.111055 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.111033 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" event={"ID":"b9a1b756-b2c0-4420-95cf-d951f5234073","Type":"ContainerStarted","Data":"43c21e12d6172d0bff3128629a4d077162bb7d9d2079b9d9e3108d3ad909bfd4"} May 29 13:42:19.663482 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.663445 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:19.663666 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:19.663514 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:19.663727 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663659 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:19.663727 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663675 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:19.663727 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663694 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:19.663727 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663708 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:19.663923 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663738 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:21.663718654 +0000 UTC m=+6.197624666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:19.663923 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:19.663762 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:21.663749658 +0000 UTC m=+6.197655674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:20.063424 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:20.059439 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:20.063424 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:20.059598 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:20.138908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:20.138874 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" event={"ID":"9f04d31d2308764f443098729df95f23","Type":"ContainerStarted","Data":"72c94fb21fa8d5fa4261f985bb966ee4ede5cae1215c8ecfd89426c170ebbdfb"} May 29 13:42:20.156105 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:20.155689 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-53.ec2.internal" podStartSLOduration=3.15567246 podStartE2EDuration="3.15567246s" podCreationTimestamp="2026-05-29 13:42:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:42:19.093911066 +0000 UTC m=+3.627817093" watchObservedRunningTime="2026-05-29 13:42:20.15567246 +0000 UTC m=+4.689578488" May 29 13:42:21.052770 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:21.052739 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:21.052965 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.052885 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:21.684952 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:21.685024 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685181 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685202 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685216 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685275 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:25.685256407 +0000 UTC m=+10.219162429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685555 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:21.685692 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:21.685623 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:25.685606774 +0000 UTC m=+10.219512795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:22.054763 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:22.054684 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:22.054913 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:22.054791 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:23.052480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:23.052441 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:23.052929 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:23.052579 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:24.053908 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:24.053411 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:24.053908 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:24.053536 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:25.052755 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:25.052111 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:25.052755 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.052259 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:25.716675 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:25.716621 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:25.716703 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716779 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716856 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:33.716834496 +0000 UTC m=+18.250740523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716877 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716896 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716909 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:25.717182 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:25.716962 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:33.716945028 +0000 UTC m=+18.250851046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:26.054079 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:26.053580 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:26.054079 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:26.053691 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:27.052005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:27.051975 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:27.052495 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:27.052115 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:28.051951 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:28.051916 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:28.052160 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:28.052018 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:29.052479 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:29.052451 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:29.052848 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:29.052557 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:30.052270 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.052240 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:30.052452 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:30.052385 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:30.298902 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.298849 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-53.ec2.internal" podStartSLOduration=13.298832268 podStartE2EDuration="13.298832268s" podCreationTimestamp="2026-05-29 13:42:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:42:20.156090458 +0000 UTC m=+4.689996487" watchObservedRunningTime="2026-05-29 13:42:30.298832268 +0000 UTC m=+14.832738337" May 29 13:42:30.299530 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.299512 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n5rdx"] May 29 13:42:30.315640 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.315586 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.315749 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:30.315671 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:30.451241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.451207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.451427 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.451249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-kubelet-config\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.451427 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.451274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-dbus\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.551804 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.551748 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.551964 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.551816 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-kubelet-config\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.551964 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.551844 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-dbus\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.551964 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:30.551901 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:30.552115 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.551961 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-kubelet-config\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:30.552115 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:30.551973 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:42:31.051953447 +0000 UTC m=+15.585859452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:30.552115 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:30.552060 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07be88d-e070-47b9-a01b-edd852b778ae-dbus\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:31.052543 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:31.052503 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:31.052708 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:31.052634 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:31.054667 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:31.054642 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:31.054817 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:31.054801 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:31.054875 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:31.054863 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:42:32.054843452 +0000 UTC m=+16.588749473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:32.052482 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:32.052450 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:32.052918 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:32.052506 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:32.052918 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:32.052596 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:32.052918 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:32.052761 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:32.061014 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:32.060985 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:32.061154 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:32.061093 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:32.061207 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:32.061159 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:42:34.061143547 +0000 UTC m=+18.595049563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:33.052661 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:33.052626 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:33.053104 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.052753 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:33.774821 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:33.774780 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:33.774991 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:33.774836 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:33.774991 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.774945 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:33.774991 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.774957 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:33.774991 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.774971 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:33.774991 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.774984 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:33.775230 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.775015 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:49.774996592 +0000 UTC m=+34.308902622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:33.775230 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:33.775033 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:49.775025129 +0000 UTC m=+34.308931135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:34.055805 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:34.055710 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:34.055805 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:34.055724 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:34.056266 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:34.055831 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:34.056266 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:34.055927 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:34.076829 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:34.076801 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:34.076989 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:34.076969 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:34.077056 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:34.077044 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:42:38.077024445 +0000 UTC m=+22.610930455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:35.052327 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:35.052294 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:35.052506 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:35.052443 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:36.055004 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:36.054971 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:36.055432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:36.054971 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:36.055432 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:36.055077 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:36.055432 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:36.055239 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:37.052351 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:37.052321 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:37.052491 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:37.052435 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:38.053083 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.052692 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:38.053083 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.052698 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:38.053971 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:38.053147 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:38.053971 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:38.053284 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:38.108767 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.108741 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:38.108952 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:38.108870 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:38.108952 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:38.108941 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:42:46.108921937 +0000 UTC m=+30.642827958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:38.170050 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170021 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"d101d4ad7f4f88300aea06ce76a3bf0f25277c2b270c9f20d851513231dcc317"} May 29 13:42:38.170240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170055 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"cd69b82d3e6c669946d64609875723a3212796c62225a27e04e5615c42741bd8"} May 29 13:42:38.170240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170071 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"78110ea30e6a0548b031ba73e144c6b90330c5f17cb66012474eb969d5fc7b72"} May 29 13:42:38.170240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170083 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"1e0c0868d9ac1b3a3d1f2f6884ecef679235136d9682c5e9914f19b1a6b96b9c"} May 29 13:42:38.170240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170094 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"b790f5e9de06563831e13eb3b2a81192c3c1952a764ebf52dbc14900476b9496"} May 29 13:42:38.170240 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.170108 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"c54c491f2d8849b90d6ab90a2ec1040c01a73f8ada2acf03002674aa65d5475b"} May 29 13:42:38.171277 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.171252 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" event={"ID":"201c88d5-b244-4d02-9d80-8235b7028202","Type":"ContainerStarted","Data":"a41b64dfaf64e8c121f6cdd6d7b302874966c1846fa5bd74471862ca205e7276"} May 29 13:42:38.172474 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.172452 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9j5k" event={"ID":"a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab","Type":"ContainerStarted","Data":"e59ef404f3b594f8235dea5cd43def992d28303735b08aec455e630a11c3ccb8"} May 29 13:42:38.173604 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.173586 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jmf9q" event={"ID":"e8d1e520-cbc2-4d71-9117-9c1efa012450","Type":"ContainerStarted","Data":"879b0036615df890cacdbd18e855a82eab1fef6563f6ed32050ccc399a54c802"} May 29 13:42:38.174797 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.174778 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7lblt" event={"ID":"f403b18d-1117-4910-9d4b-bc1cfd2aa1a9","Type":"ContainerStarted","Data":"ec0e4a0cb876b8cea6689d173bc4b526e13b0f5fc0091d479b6d2a1ad5874be8"} May 29 13:42:38.176101 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.176078 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="cba71116c56a3ddf98ca6e66969c6341927004228e47c68e26e812141e43d314" exitCode=0 May 29 13:42:38.176202 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.176156 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"cba71116c56a3ddf98ca6e66969c6341927004228e47c68e26e812141e43d314"} May 29 13:42:38.177435 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.177419 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r96vp" event={"ID":"f6a78835-f073-4672-b831-8b73f37dc8ab","Type":"ContainerStarted","Data":"11e8be9abc68fafef374dd2e0c8e79d8404d6d1944f403d334a1f1e689508bf8"} May 29 13:42:38.178761 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.178743 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" event={"ID":"b9a1b756-b2c0-4420-95cf-d951f5234073","Type":"ContainerStarted","Data":"ead675e939b6fcd8a1f33f6e46061fad9ddc645e50f23fdee0400ed354967e4b"} May 29 13:42:38.191180 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.191142 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pzhtb" podStartSLOduration=3.662667662 podStartE2EDuration="22.19113266s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.644170097 +0000 UTC m=+3.178076111" lastFinishedPulling="2026-05-29 13:42:37.172635092 +0000 UTC m=+21.706541109" observedRunningTime="2026-05-29 13:42:38.191056017 +0000 UTC m=+22.724962044" watchObservedRunningTime="2026-05-29 13:42:38.19113266 +0000 UTC m=+22.725038687" May 29 13:42:38.207377 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.207336 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r96vp" podStartSLOduration=3.719588087 podStartE2EDuration="22.207326552s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.647599915 +0000 UTC m=+3.181505920" lastFinishedPulling="2026-05-29 13:42:37.135338373 +0000 UTC m=+21.669244385" observedRunningTime="2026-05-29 13:42:38.207179177 +0000 UTC m=+22.741085220" watchObservedRunningTime="2026-05-29 13:42:38.207326552 +0000 UTC m=+22.741232582" May 29 13:42:38.223494 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.223462 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l9j5k" podStartSLOduration=3.69245603 podStartE2EDuration="22.223452818s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.643739325 +0000 UTC m=+3.177645331" lastFinishedPulling="2026-05-29 13:42:37.174736103 +0000 UTC m=+21.708642119" observedRunningTime="2026-05-29 13:42:38.223039593 +0000 UTC m=+22.756945622" watchObservedRunningTime="2026-05-29 13:42:38.223452818 +0000 UTC m=+22.757358845" May 29 13:42:38.242316 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.242285 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7lblt" podStartSLOduration=3.708481507 podStartE2EDuration="22.242276462s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.640667925 +0000 UTC m=+3.174573934" lastFinishedPulling="2026-05-29 13:42:37.174462869 +0000 UTC m=+21.708368889" observedRunningTime="2026-05-29 13:42:38.242114333 +0000 UTC m=+22.776020360" watchObservedRunningTime="2026-05-29 13:42:38.242276462 +0000 UTC m=+22.776182488" May 29 13:42:38.258665 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.258632 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jmf9q" podStartSLOduration=3.76532833 podStartE2EDuration="22.258622811s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.642012013 +0000 UTC m=+3.175918018" lastFinishedPulling="2026-05-29 13:42:37.135306478 +0000 UTC m=+21.669212499" observedRunningTime="2026-05-29 13:42:38.258251855 +0000 UTC m=+22.792157883" watchObservedRunningTime="2026-05-29 13:42:38.258622811 +0000 UTC m=+22.792528837" May 29 13:42:38.700718 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.700666 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 13:42:38.999870 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:38.999771 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T13:42:38.700713335Z","UUID":"db3f44c4-9c09-49d8-b070-aab1b26b8ef5","Handler":null,"Name":"","Endpoint":""} May 29 13:42:39.003085 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.003059 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 13:42:39.003085 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.003090 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 13:42:39.052250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.052218 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:39.052414 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:39.052329 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:39.182381 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.182337 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wgtb2" event={"ID":"c376ca09-36c0-4d9c-ae34-3373a99c30b4","Type":"ContainerStarted","Data":"c6d24c0ece1910b555324939b00852c9b9030c08d7d0d481b71b6c4e60b52242"} May 29 13:42:39.184372 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.184320 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" event={"ID":"b9a1b756-b2c0-4420-95cf-d951f5234073","Type":"ContainerStarted","Data":"5ec496fc2936a7dc425998cb1848c011662ad935fde99b0e97dbbdde1199fd32"} May 29 13:42:39.201495 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:39.201204 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wgtb2" podStartSLOduration=4.673592289 podStartE2EDuration="23.20119096s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.651245384 +0000 UTC m=+3.185151389" lastFinishedPulling="2026-05-29 13:42:37.178844049 +0000 UTC m=+21.712750060" observedRunningTime="2026-05-29 13:42:39.201007243 +0000 UTC m=+23.734913270" watchObservedRunningTime="2026-05-29 13:42:39.20119096 +0000 UTC m=+23.735096990" May 29 13:42:40.052284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:40.052247 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:40.052284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:40.052280 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:40.052501 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:40.052387 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:40.052501 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:40.052476 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:40.188700 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:40.188669 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"8cc7800464deb0adf1f229e1e88675c35a05d719ae01c1aec134705e5598265d"} May 29 13:42:40.190350 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:40.190321 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" event={"ID":"b9a1b756-b2c0-4420-95cf-d951f5234073","Type":"ContainerStarted","Data":"8149ecae73eb67c95225a4c45a7671e92bc5d74d72ac144aff6210bbd43bc2bd"} May 29 13:42:40.210876 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:40.210817 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkzfl" podStartSLOduration=3.043173151 podStartE2EDuration="24.210798624s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.647098951 +0000 UTC m=+3.181004959" lastFinishedPulling="2026-05-29 13:42:39.814724421 +0000 UTC m=+24.348630432" observedRunningTime="2026-05-29 13:42:40.210394364 +0000 UTC m=+24.744300390" watchObservedRunningTime="2026-05-29 13:42:40.210798624 +0000 UTC m=+24.744704651" May 29 13:42:41.052048 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:41.051857 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:41.052238 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:41.052161 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:42.052334 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:42.052301 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:42.052334 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:42.052330 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:42.052956 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:42.052443 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:42.052956 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:42.052554 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:42.710203 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:42.710167 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:42.710880 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:42.710852 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:43.052157 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.052132 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:43.052284 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:43.052264 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:43.200711 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.200304 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" event={"ID":"3aaa700c-e92c-4f83-b4d0-11d6b1c7c476","Type":"ContainerStarted","Data":"c65fe0c280831456547bbd5358c07a37162c424ae8dcae88825e2d00e4506aa4"} May 29 13:42:43.200711 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.200660 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:43.200711 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.200694 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:43.200711 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.200709 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:43.201401 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.200722 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:43.201544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.201520 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r96vp" May 29 13:42:43.219868 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.219717 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:43.219957 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.219942 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:42:43.236753 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:43.236715 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" podStartSLOduration=8.675003436 podStartE2EDuration="27.236701927s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.649303269 +0000 UTC m=+3.183209275" lastFinishedPulling="2026-05-29 13:42:37.211001744 +0000 UTC m=+21.744907766" observedRunningTime="2026-05-29 13:42:43.236022759 +0000 UTC m=+27.769928786" watchObservedRunningTime="2026-05-29 13:42:43.236701927 +0000 UTC m=+27.770607954" May 29 13:42:44.055028 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:44.055002 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:44.055028 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:44.055029 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:44.055209 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:44.055117 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:44.055209 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:44.055199 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:44.203924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:44.203893 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="731e607773379dbe44ba1814c02ca9432115980779bef0e9f5e7a2d000ec5127" exitCode=0 May 29 13:42:44.204444 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:44.203960 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"731e607773379dbe44ba1814c02ca9432115980779bef0e9f5e7a2d000ec5127"} May 29 13:42:45.052456 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.052428 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:45.052582 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:45.052534 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:45.074465 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.074442 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8g898"] May 29 13:42:45.077094 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.077065 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n5rdx"] May 29 13:42:45.077197 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.077166 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:45.077275 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:45.077253 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:45.077930 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.077908 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrpvz"] May 29 13:42:45.078046 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.077995 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:45.078103 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:45.078072 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:45.207747 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:45.207722 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:45.208415 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:45.208387 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:46.169696 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:46.169521 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:46.169820 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:46.169669 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 13:42:46.169820 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:46.169790 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret podName:b07be88d-e070-47b9-a01b-edd852b778ae nodeName:}" failed. No retries permitted until 2026-05-29 13:43:02.169773497 +0000 UTC m=+46.703679515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret") pod "global-pull-secret-syncer-n5rdx" (UID: "b07be88d-e070-47b9-a01b-edd852b778ae") : object "kube-system"/"original-pull-secret" not registered May 29 13:42:46.211100 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:46.211073 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="f51a34ba1a748785a1272f65ab8f5a683d26022b1f6cb40b12a07c8a26d42285" exitCode=0 May 29 13:42:46.211438 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:46.211142 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"f51a34ba1a748785a1272f65ab8f5a683d26022b1f6cb40b12a07c8a26d42285"} May 29 13:42:47.052227 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:47.052200 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:47.052311 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:47.052209 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:47.052311 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:47.052298 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:47.052394 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:47.052211 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:47.052443 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:47.052389 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:47.052503 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:47.052482 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:47.215204 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:47.215174 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="cb120855fd9e8fe0d4176c77e58e27c286ca5aef05cef49808d03e78254b3bba" exitCode=0 May 29 13:42:47.215641 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:47.215246 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"cb120855fd9e8fe0d4176c77e58e27c286ca5aef05cef49808d03e78254b3bba"} May 29 13:42:49.052572 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:49.052494 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:49.053077 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:49.052494 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:49.053077 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.052613 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrpvz" podUID="d80ca010-603a-47ed-888b-caf0f451dfd4" May 29 13:42:49.053077 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:49.052494 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:49.053077 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.052697 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:42:49.053077 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.052764 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5rdx" podUID="b07be88d-e070-47b9-a01b-edd852b778ae" May 29 13:42:49.800515 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:49.800485 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:49.800540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800644 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800681 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800698 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800711 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:21.800691179 +0000 UTC m=+66.334597184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800712 2568 projected.go:194] Error preparing data for projected volume kube-api-access-9s8bq for pod openshift-network-diagnostics/network-check-target-wrpvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:49.800790 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:49.800763 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq podName:d80ca010-603a-47ed-888b-caf0f451dfd4 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:21.80075436 +0000 UTC m=+66.334660366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s8bq" (UniqueName: "kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq") pod "network-check-target-wrpvz" (UID: "d80ca010-603a-47ed-888b-caf0f451dfd4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 13:42:50.753315 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.753290 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-53.ec2.internal" event="NodeReady" May 29 13:42:50.753834 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.753417 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 13:42:50.807885 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.807851 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ps7sb"] May 29 13:42:50.828215 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.828183 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ttwj6"] May 29 13:42:50.842603 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.842576 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ps7sb"] May 29 13:42:50.842603 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.842606 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttwj6"] May 29 13:42:50.842765 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.842696 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttwj6" May 29 13:42:50.842765 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.842696 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:50.846011 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.845987 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 13:42:50.846144 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846036 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 13:42:50.846144 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846056 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfdw\"" May 29 13:42:50.846144 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846139 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 13:42:50.846411 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846393 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25vw9\"" May 29 13:42:50.846540 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846427 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 13:42:50.846540 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:50.846469 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 13:42:51.008732 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.008732 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c84lx\" (UniqueName: \"kubernetes.io/projected/6b273daf-4e71-4fa8-a925-13388d952fea-kube-api-access-c84lx\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.008952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b273daf-4e71-4fa8-a925-13388d952fea-config-volume\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.008952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008786 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vds\" (UniqueName: \"kubernetes.io/projected/b2deb9de-7828-420b-8170-20e978ab1375-kube-api-access-c4vds\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.008952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b273daf-4e71-4fa8-a925-13388d952fea-tmp-dir\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.008952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.008877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.051940 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.051911 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:42:51.052114 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.051963 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:42:51.052114 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.051911 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:42:51.054978 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.054953 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 13:42:51.055124 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.055091 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chjd5\"" May 29 13:42:51.055187 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.055127 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km4z9\"" May 29 13:42:51.055187 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.055173 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 13:42:51.055464 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.055437 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 13:42:51.055556 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.055471 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 13:42:51.109685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109659 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b273daf-4e71-4fa8-a925-13388d952fea-config-volume\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.109825 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109698 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vds\" (UniqueName: \"kubernetes.io/projected/b2deb9de-7828-420b-8170-20e978ab1375-kube-api-access-c4vds\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.109825 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109805 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b273daf-4e71-4fa8-a925-13388d952fea-tmp-dir\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.109948 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.109948 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109917 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.110050 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.109964 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c84lx\" (UniqueName: \"kubernetes.io/projected/6b273daf-4e71-4fa8-a925-13388d952fea-kube-api-access-c84lx\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.110050 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.110029 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:42:51.110148 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.110056 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:42:51.110148 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.110087 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:51.610069839 +0000 UTC m=+36.143975861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:42:51.110148 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.110117 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:42:51.610097927 +0000 UTC m=+36.144003936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:42:51.110312 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.110279 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b273daf-4e71-4fa8-a925-13388d952fea-config-volume\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.110381 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.110283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b273daf-4e71-4fa8-a925-13388d952fea-tmp-dir\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.121907 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.121874 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c84lx\" (UniqueName: \"kubernetes.io/projected/6b273daf-4e71-4fa8-a925-13388d952fea-kube-api-access-c84lx\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.121907 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.121896 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vds\" (UniqueName: \"kubernetes.io/projected/b2deb9de-7828-420b-8170-20e978ab1375-kube-api-access-c4vds\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.614568 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.614532 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:51.614756 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:51.614577 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:51.614756 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.614708 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:42:51.614756 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.614727 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:42:51.614896 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.614789 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:52.614769283 +0000 UTC m=+37.148675296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:42:51.614896 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:51.614810 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:42:52.614800191 +0000 UTC m=+37.148706201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:42:52.623760 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:52.623721 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:52.624174 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:52.623777 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:52.624174 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:52.623895 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:42:52.624174 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:52.623928 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:42:52.624174 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:52.623962 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:54.623943422 +0000 UTC m=+39.157849447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:42:52.624174 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:52.623978 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:42:54.623972109 +0000 UTC m=+39.157878113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:42:53.229333 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:53.229085 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerStarted","Data":"496a5557a44dcb0983a00de49373e73038debaf36f9f126914ab80ad116971f2"} May 29 13:42:54.233345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:54.233310 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="496a5557a44dcb0983a00de49373e73038debaf36f9f126914ab80ad116971f2" exitCode=0 May 29 13:42:54.233712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:54.233399 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"496a5557a44dcb0983a00de49373e73038debaf36f9f126914ab80ad116971f2"} May 29 13:42:54.639028 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:54.638998 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:54.639175 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:54.639051 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:54.639175 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:54.639149 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:42:54.639287 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:54.639206 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:58.63919221 +0000 UTC m=+43.173098228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:42:54.639287 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:54.639233 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:42:54.639409 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:54.639314 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:42:58.639296203 +0000 UTC m=+43.173202225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:42:55.238032 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:55.237996 2568 generic.go:358] "Generic (PLEG): container finished" podID="b9a878eb-416d-4400-9342-fae2ce8ba6fd" containerID="7e607f7cc573adc325120b0d89417a21d7009f820757e79256bac09d53dc615d" exitCode=0 May 29 13:42:55.238032 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:55.238040 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerDied","Data":"7e607f7cc573adc325120b0d89417a21d7009f820757e79256bac09d53dc615d"} May 29 13:42:56.242373 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:56.242336 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsprg" event={"ID":"b9a878eb-416d-4400-9342-fae2ce8ba6fd","Type":"ContainerStarted","Data":"e3b7aa2128bf2decc805a724d0945130c85930b94553787fa39ae3056a2d651a"} May 29 13:42:56.267442 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:56.267398 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zsprg" podStartSLOduration=5.80828439 podStartE2EDuration="40.267384326s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:42:18.648323639 +0000 UTC m=+3.182229657" lastFinishedPulling="2026-05-29 13:42:53.107423589 +0000 UTC m=+37.641329593" observedRunningTime="2026-05-29 13:42:56.265312932 +0000 UTC m=+40.799218960" watchObservedRunningTime="2026-05-29 13:42:56.267384326 +0000 UTC m=+40.801290352" May 29 13:42:58.664044 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:58.664004 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:42:58.664044 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:42:58.664045 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:42:58.664547 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:58.664133 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:42:58.664547 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:58.664144 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:42:58.664547 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:58.664183 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:43:06.66416986 +0000 UTC m=+51.198075864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:42:58.664547 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:42:58.664196 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:06.664190213 +0000 UTC m=+51.198096217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:43:02.187509 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:02.187474 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:43:02.190399 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:02.190373 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07be88d-e070-47b9-a01b-edd852b778ae-original-pull-secret\") pod \"global-pull-secret-syncer-n5rdx\" (UID: \"b07be88d-e070-47b9-a01b-edd852b778ae\") " pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:43:02.478085 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:02.478009 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5rdx" May 29 13:43:02.666400 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:02.666352 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n5rdx"] May 29 13:43:02.669511 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:43:02.669488 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07be88d_e070_47b9_a01b_edd852b778ae.slice/crio-b110b4e1e26ecf98d888ce9cba2eb2191e7a5e567813a142d4955f9db86acb10 WatchSource:0}: Error finding container b110b4e1e26ecf98d888ce9cba2eb2191e7a5e567813a142d4955f9db86acb10: Status 404 returned error can't find the container with id b110b4e1e26ecf98d888ce9cba2eb2191e7a5e567813a142d4955f9db86acb10 May 29 13:43:03.256228 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:03.256188 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n5rdx" event={"ID":"b07be88d-e070-47b9-a01b-edd852b778ae","Type":"ContainerStarted","Data":"b110b4e1e26ecf98d888ce9cba2eb2191e7a5e567813a142d4955f9db86acb10"} May 29 13:43:06.721539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:06.721503 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:43:06.721962 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:06.721544 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:43:06.721962 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:06.721659 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:43:06.721962 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:06.721731 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:22.721711613 +0000 UTC m=+67.255617640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:43:06.721962 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:06.721746 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:43:06.721962 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:06.721785 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:43:22.72177449 +0000 UTC m=+67.255680500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:43:07.268425 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:07.268389 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n5rdx" event={"ID":"b07be88d-e070-47b9-a01b-edd852b778ae","Type":"ContainerStarted","Data":"d23c95d02061bb0252ac84e18f64a4c11e9581bd12d4f0d8c1f0960726ac1198"} May 29 13:43:07.287472 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:07.287429 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n5rdx" podStartSLOduration=33.767827794 podStartE2EDuration="37.287415558s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:43:02.671629498 +0000 UTC m=+47.205535502" lastFinishedPulling="2026-05-29 13:43:06.191217243 +0000 UTC m=+50.725123266" observedRunningTime="2026-05-29 13:43:07.28724658 +0000 UTC m=+51.821152619" watchObservedRunningTime="2026-05-29 13:43:07.287415558 +0000 UTC m=+51.821321584" May 29 13:43:15.218502 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:15.218470 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzlrx" May 29 13:43:21.828701 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.828664 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:43:21.829075 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.828723 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:43:21.831754 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.831735 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 13:43:21.831813 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.831774 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 13:43:21.839346 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:21.839327 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 13:43:21.839430 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:21.839417 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.839396473 +0000 UTC m=+130.373302495 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : secret "metrics-daemon-secret" not found May 29 13:43:21.841764 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.841747 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 13:43:21.852525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.852505 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s8bq\" (UniqueName: \"kubernetes.io/projected/d80ca010-603a-47ed-888b-caf0f451dfd4-kube-api-access-9s8bq\") pod \"network-check-target-wrpvz\" (UID: \"d80ca010-603a-47ed-888b-caf0f451dfd4\") " pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:43:21.966632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.966613 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chjd5\"" May 29 13:43:21.974322 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:21.974305 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:43:22.109198 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:22.109127 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrpvz"] May 29 13:43:22.112603 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:43:22.112572 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80ca010_603a_47ed_888b_caf0f451dfd4.slice/crio-c43f7a78b98a503b11d14b3e3e84d383cab59c545e7e96ef861ae698152e85bf WatchSource:0}: Error finding container c43f7a78b98a503b11d14b3e3e84d383cab59c545e7e96ef861ae698152e85bf: Status 404 returned error can't find the container with id c43f7a78b98a503b11d14b3e3e84d383cab59c545e7e96ef861ae698152e85bf May 29 13:43:22.297264 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:22.297219 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrpvz" event={"ID":"d80ca010-603a-47ed-888b-caf0f451dfd4","Type":"ContainerStarted","Data":"c43f7a78b98a503b11d14b3e3e84d383cab59c545e7e96ef861ae698152e85bf"} May 29 13:43:22.736006 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:22.735972 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:43:22.736183 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:22.736020 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:43:22.736183 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:22.736164 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:43:22.736292 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:22.736223 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:43:54.736206152 +0000 UTC m=+99.270112161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:43:22.736292 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:22.736163 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:43:22.736398 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:22.736313 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:54.736299856 +0000 UTC m=+99.270205861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:43:26.305154 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:26.305116 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrpvz" event={"ID":"d80ca010-603a-47ed-888b-caf0f451dfd4","Type":"ContainerStarted","Data":"6286ae90ddd55340c64fae46ef2f651457ae77e503e941359b2477c1bcd0af40"} May 29 13:43:26.305674 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:26.305257 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:43:26.322939 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:26.322894 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrpvz" podStartSLOduration=67.233030144 podStartE2EDuration="1m10.322881424s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:43:22.114255657 +0000 UTC m=+66.648161670" lastFinishedPulling="2026-05-29 13:43:25.204106928 +0000 UTC m=+69.738012950" observedRunningTime="2026-05-29 13:43:26.322452878 +0000 UTC m=+70.856358905" watchObservedRunningTime="2026-05-29 13:43:26.322881424 +0000 UTC m=+70.856787450" May 29 13:43:54.750242 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:54.750195 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:43:54.750242 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:54.750247 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:43:54.750717 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:54.750346 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 13:43:54.750717 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:54.750357 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 13:43:54.750717 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:54.750419 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls podName:6b273daf-4e71-4fa8-a925-13388d952fea nodeName:}" failed. No retries permitted until 2026-05-29 13:44:58.750402925 +0000 UTC m=+163.284308949 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls") pod "dns-default-ttwj6" (UID: "6b273daf-4e71-4fa8-a925-13388d952fea") : secret "dns-default-metrics-tls" not found May 29 13:43:54.750717 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:43:54.750439 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert podName:b2deb9de-7828-420b-8170-20e978ab1375 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:58.7504259 +0000 UTC m=+163.284331904 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert") pod "ingress-canary-ps7sb" (UID: "b2deb9de-7828-420b-8170-20e978ab1375") : secret "canary-serving-cert" not found May 29 13:43:57.309559 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:43:57.309525 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrpvz" May 29 13:44:21.842193 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.842164 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bpvbz"] May 29 13:44:21.844017 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.843994 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.845485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.845467 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-544d49f6d6-hxbqp"] May 29 13:44:21.846988 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.846965 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.847189 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.847128 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 13:44:21.847280 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.847136 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 29 13:44:21.847616 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.847596 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 29 13:44:21.847719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.847624 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 13:44:21.847719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.847675 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qpkx5\"" May 29 13:44:21.850338 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850321 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 29 13:44:21.850572 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850551 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 29 13:44:21.850655 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850635 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 13:44:21.850769 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850750 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 29 13:44:21.850844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850779 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 29 13:44:21.850844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850794 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dl8sl\"" May 29 13:44:21.850844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.850807 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 13:44:21.855076 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.855057 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 29 13:44:21.859051 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.859036 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bpvbz"] May 29 13:44:21.861492 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.861472 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-544d49f6d6-hxbqp"] May 29 13:44:21.920857 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.920832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.920960 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.920868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.920960 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.920919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5gc\" (UniqueName: \"kubernetes.io/projected/0ab0aaec-b6fb-40b2-92c0-740a29e15770-kube-api-access-rj5gc\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.920960 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.920956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.921072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.920989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.921072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9fj\" (UniqueName: \"kubernetes.io/projected/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-kube-api-access-cd9fj\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.921072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-snapshots\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.921072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab0aaec-b6fb-40b2-92c0-740a29e15770-serving-cert\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.921072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-default-certificate\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.921256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-stats-auth\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:21.921256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.921141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-tmp\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:21.958677 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.958657 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fv5ml"] May 29 13:44:21.960461 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.960448 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:21.963427 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.963411 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hwtfp\"" May 29 13:44:21.964243 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.964220 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 29 13:44:21.964342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.964284 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 29 13:44:21.964342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.964307 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 29 13:44:21.964342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.964313 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 29 13:44:21.972883 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.972865 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 29 13:44:21.978605 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:21.978583 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fv5ml"] May 29 13:44:22.022256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d753d83-9c48-4011-9dcf-e1440be747a5-serving-cert\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.022345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-trusted-ca\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.022345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-stats-auth\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.022345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022307 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-tmp\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022523 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-config\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.022523 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6msb\" (UniqueName: \"kubernetes.io/projected/7d753d83-9c48-4011-9dcf-e1440be747a5-kube-api-access-s6msb\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.022523 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022450 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022523 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022489 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.022657 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.022567 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 13:44:22.022657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022607 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5gc\" (UniqueName: \"kubernetes.io/projected/0ab0aaec-b6fb-40b2-92c0-740a29e15770-kube-api-access-rj5gc\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022657 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.022621 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:22.522602276 +0000 UTC m=+127.056508294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : secret "router-metrics-certs-default" not found May 29 13:44:22.022657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022648 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-tmp\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022700 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022727 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9fj\" (UniqueName: \"kubernetes.io/projected/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-kube-api-access-cd9fj\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022758 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-snapshots\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.022782 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:22.522765978 +0000 UTC m=+127.056672000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022813 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab0aaec-b6fb-40b2-92c0-740a29e15770-serving-cert\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.022844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.022843 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-default-certificate\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.023250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.023074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.023303 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.023282 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ab0aaec-b6fb-40b2-92c0-740a29e15770-snapshots\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.023645 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.023622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab0aaec-b6fb-40b2-92c0-740a29e15770-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.024865 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.024845 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-stats-auth\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.025636 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.025619 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-default-certificate\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.025694 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.025650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab0aaec-b6fb-40b2-92c0-740a29e15770-serving-cert\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.032595 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.032575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9fj\" (UniqueName: \"kubernetes.io/projected/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-kube-api-access-cd9fj\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.033891 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.033871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5gc\" (UniqueName: \"kubernetes.io/projected/0ab0aaec-b6fb-40b2-92c0-740a29e15770-kube-api-access-rj5gc\") pod \"insights-operator-78bdfb888c-bpvbz\" (UID: \"0ab0aaec-b6fb-40b2-92c0-740a29e15770\") " pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.049038 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.049016 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x"] May 29 13:44:22.051437 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.051420 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd"] May 29 13:44:22.051570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.051554 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" May 29 13:44:22.053215 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.053197 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.056720 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.056699 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 29 13:44:22.056937 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.056924 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 29 13:44:22.056992 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.056926 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 29 13:44:22.056992 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.056975 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gsjhv\"" May 29 13:44:22.058965 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.058944 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lfmq7\"" May 29 13:44:22.073048 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.073031 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x"] May 29 13:44:22.073668 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.073651 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd"] May 29 13:44:22.123529 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123484 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d753d83-9c48-4011-9dcf-e1440be747a5-serving-cert\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.123529 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-trusted-ca\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.123636 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfch\" (UniqueName: \"kubernetes.io/projected/3acb9d55-3a16-4de8-bb64-e1064726042a-kube-api-access-5nfch\") pod \"network-check-source-7f44b6dd87-hbj7x\" (UID: \"3acb9d55-3a16-4de8-bb64-e1064726042a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" May 29 13:44:22.123636 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123555 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-config\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.123702 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123663 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6msb\" (UniqueName: \"kubernetes.io/projected/7d753d83-9c48-4011-9dcf-e1440be747a5-kube-api-access-s6msb\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.123815 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.123852 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.123837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4w76\" (UniqueName: \"kubernetes.io/projected/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-kube-api-access-h4w76\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.124329 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.124305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-config\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.124715 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.124696 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d753d83-9c48-4011-9dcf-e1440be747a5-trusted-ca\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.125821 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.125805 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d753d83-9c48-4011-9dcf-e1440be747a5-serving-cert\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.137480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.137462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6msb\" (UniqueName: \"kubernetes.io/projected/7d753d83-9c48-4011-9dcf-e1440be747a5-kube-api-access-s6msb\") pod \"console-operator-76dff48d59-fv5ml\" (UID: \"7d753d83-9c48-4011-9dcf-e1440be747a5\") " pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.155277 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.155254 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" May 29 13:44:22.224342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.224313 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfch\" (UniqueName: \"kubernetes.io/projected/3acb9d55-3a16-4de8-bb64-e1064726042a-kube-api-access-5nfch\") pod \"network-check-source-7f44b6dd87-hbj7x\" (UID: \"3acb9d55-3a16-4de8-bb64-e1064726042a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" May 29 13:44:22.224533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.224445 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.224533 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.224482 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4w76\" (UniqueName: \"kubernetes.io/projected/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-kube-api-access-h4w76\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.224652 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.224596 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 13:44:22.224707 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.224679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls podName:62819a6c-630d-49cc-a54e-6b0e5b6e35cd nodeName:}" failed. No retries permitted until 2026-05-29 13:44:22.724661128 +0000 UTC m=+127.258567153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls") pod "cluster-samples-operator-697587599-755dd" (UID: "62819a6c-630d-49cc-a54e-6b0e5b6e35cd") : secret "samples-operator-tls" not found May 29 13:44:22.240462 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.240436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfch\" (UniqueName: \"kubernetes.io/projected/3acb9d55-3a16-4de8-bb64-e1064726042a-kube-api-access-5nfch\") pod \"network-check-source-7f44b6dd87-hbj7x\" (UID: \"3acb9d55-3a16-4de8-bb64-e1064726042a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" May 29 13:44:22.241664 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.241638 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4w76\" (UniqueName: \"kubernetes.io/projected/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-kube-api-access-h4w76\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.269279 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.269257 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:22.274580 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.274557 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bpvbz"] May 29 13:44:22.277638 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:22.277615 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab0aaec_b6fb_40b2_92c0_740a29e15770.slice/crio-0d2f93000be512fc5f8823d1b4157f733b8b931ef2dee9d9ecc8650c8fa90084 WatchSource:0}: Error finding container 0d2f93000be512fc5f8823d1b4157f733b8b931ef2dee9d9ecc8650c8fa90084: Status 404 returned error can't find the container with id 0d2f93000be512fc5f8823d1b4157f733b8b931ef2dee9d9ecc8650c8fa90084 May 29 13:44:22.361860 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.361835 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" May 29 13:44:22.391332 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.391270 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fv5ml"] May 29 13:44:22.395032 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:22.395009 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d753d83_9c48_4011_9dcf_e1440be747a5.slice/crio-812e8a31d8e62fbd9d92ddd08fe0a26e77e0441efc3bdfdaf0657e83d68b49c0 WatchSource:0}: Error finding container 812e8a31d8e62fbd9d92ddd08fe0a26e77e0441efc3bdfdaf0657e83d68b49c0: Status 404 returned error can't find the container with id 812e8a31d8e62fbd9d92ddd08fe0a26e77e0441efc3bdfdaf0657e83d68b49c0 May 29 13:44:22.404713 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.404683 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" event={"ID":"7d753d83-9c48-4011-9dcf-e1440be747a5","Type":"ContainerStarted","Data":"812e8a31d8e62fbd9d92ddd08fe0a26e77e0441efc3bdfdaf0657e83d68b49c0"} May 29 13:44:22.406301 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.406262 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" event={"ID":"0ab0aaec-b6fb-40b2-92c0-740a29e15770","Type":"ContainerStarted","Data":"0d2f93000be512fc5f8823d1b4157f733b8b931ef2dee9d9ecc8650c8fa90084"} May 29 13:44:22.481181 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.481152 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x"] May 29 13:44:22.485264 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:22.484000 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acb9d55_3a16_4de8_bb64_e1064726042a.slice/crio-974ed1899b9fd569d70ae2aceca6ae999a0e4a70197476e7e99d363581577343 WatchSource:0}: Error finding container 974ed1899b9fd569d70ae2aceca6ae999a0e4a70197476e7e99d363581577343: Status 404 returned error can't find the container with id 974ed1899b9fd569d70ae2aceca6ae999a0e4a70197476e7e99d363581577343 May 29 13:44:22.526566 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.526543 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.526681 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.526601 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:22.526751 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.526699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:23.526686317 +0000 UTC m=+128.060592322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:22.526751 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.526706 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 13:44:22.526861 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.526769 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:23.526752722 +0000 UTC m=+128.060658732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : secret "router-metrics-certs-default" not found May 29 13:44:22.728479 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:22.728406 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:22.728603 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.728524 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 13:44:22.728603 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:22.728574 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls podName:62819a6c-630d-49cc-a54e-6b0e5b6e35cd nodeName:}" failed. No retries permitted until 2026-05-29 13:44:23.728560082 +0000 UTC m=+128.262466101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls") pod "cluster-samples-operator-697587599-755dd" (UID: "62819a6c-630d-49cc-a54e-6b0e5b6e35cd") : secret "samples-operator-tls" not found May 29 13:44:23.409810 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.409744 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" event={"ID":"3acb9d55-3a16-4de8-bb64-e1064726042a","Type":"ContainerStarted","Data":"8f98372356be3f81424eeeeda09d8e70196a57cef6d64ff906f9cfe483766c56"} May 29 13:44:23.409810 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.409788 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" event={"ID":"3acb9d55-3a16-4de8-bb64-e1064726042a","Type":"ContainerStarted","Data":"974ed1899b9fd569d70ae2aceca6ae999a0e4a70197476e7e99d363581577343"} May 29 13:44:23.428861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.428808 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hbj7x" podStartSLOduration=1.428792115 podStartE2EDuration="1.428792115s" podCreationTimestamp="2026-05-29 13:44:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:44:23.428667755 +0000 UTC m=+127.962573782" watchObservedRunningTime="2026-05-29 13:44:23.428792115 +0000 UTC m=+127.962698141" May 29 13:44:23.535636 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.535597 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:23.535792 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.535704 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:23.536230 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:23.535860 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.535842312 +0000 UTC m=+130.069748331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:23.536400 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:23.536226 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 13:44:23.536400 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:23.536301 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.536281519 +0000 UTC m=+130.070187529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : secret "router-metrics-certs-default" not found May 29 13:44:23.737410 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:23.737169 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:23.737410 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:23.737279 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 13:44:23.737410 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:23.737374 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls podName:62819a6c-630d-49cc-a54e-6b0e5b6e35cd nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.737337484 +0000 UTC m=+130.271243494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls") pod "cluster-samples-operator-697587599-755dd" (UID: "62819a6c-630d-49cc-a54e-6b0e5b6e35cd") : secret "samples-operator-tls" not found May 29 13:44:25.414327 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.414289 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" event={"ID":"0ab0aaec-b6fb-40b2-92c0-740a29e15770","Type":"ContainerStarted","Data":"2dcdcd6c21d9564d1dcf76f63e0c27027b4e7fb3a9ef9f5b43ad38972ea1fca6"} May 29 13:44:25.415702 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.415683 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/0.log" May 29 13:44:25.415815 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.415719 2568 generic.go:358] "Generic (PLEG): container finished" podID="7d753d83-9c48-4011-9dcf-e1440be747a5" containerID="6e431b8528468baff40386e8f2f4a5829dab94200b2480323e42a7229915afc6" exitCode=255 May 29 13:44:25.415815 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.415741 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" event={"ID":"7d753d83-9c48-4011-9dcf-e1440be747a5","Type":"ContainerDied","Data":"6e431b8528468baff40386e8f2f4a5829dab94200b2480323e42a7229915afc6"} May 29 13:44:25.416006 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.415989 2568 scope.go:117] "RemoveContainer" containerID="6e431b8528468baff40386e8f2f4a5829dab94200b2480323e42a7229915afc6" May 29 13:44:25.438490 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.438452 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" podStartSLOduration=1.9529402120000001 podStartE2EDuration="4.43843951s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:22.279927043 +0000 UTC m=+126.813833052" lastFinishedPulling="2026-05-29 13:44:24.765426335 +0000 UTC m=+129.299332350" observedRunningTime="2026-05-29 13:44:25.438344153 +0000 UTC m=+129.972250180" watchObservedRunningTime="2026-05-29 13:44:25.43843951 +0000 UTC m=+129.972345534" May 29 13:44:25.554212 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.553812 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:25.554212 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.553925 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:25.554212 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.554195 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 13:44:25.554469 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.554216 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:29.554191975 +0000 UTC m=+134.088098013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:25.554469 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.554271 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:29.554252393 +0000 UTC m=+134.088158399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : secret "router-metrics-certs-default" not found May 29 13:44:25.755427 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.755323 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:25.755556 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.755474 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 13:44:25.755556 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.755544 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls podName:62819a6c-630d-49cc-a54e-6b0e5b6e35cd nodeName:}" failed. No retries permitted until 2026-05-29 13:44:29.755526364 +0000 UTC m=+134.289432369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls") pod "cluster-samples-operator-697587599-755dd" (UID: "62819a6c-630d-49cc-a54e-6b0e5b6e35cd") : secret "samples-operator-tls" not found May 29 13:44:25.855998 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:25.855964 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:44:25.856148 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.856104 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 13:44:25.856188 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:25.856170 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs podName:b01e0990-f3cf-496b-8266-d89ed137c0d5 nodeName:}" failed. No retries permitted until 2026-05-29 13:46:27.856154525 +0000 UTC m=+252.390060530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs") pod "network-metrics-daemon-8g898" (UID: "b01e0990-f3cf-496b-8266-d89ed137c0d5") : secret "metrics-daemon-secret" not found May 29 13:44:26.419607 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.419577 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/1.log" May 29 13:44:26.420064 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.419956 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/0.log" May 29 13:44:26.420064 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.420000 2568 generic.go:358] "Generic (PLEG): container finished" podID="7d753d83-9c48-4011-9dcf-e1440be747a5" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" exitCode=255 May 29 13:44:26.420166 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.420091 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" event={"ID":"7d753d83-9c48-4011-9dcf-e1440be747a5","Type":"ContainerDied","Data":"07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af"} May 29 13:44:26.420166 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.420131 2568 scope.go:117] "RemoveContainer" containerID="6e431b8528468baff40386e8f2f4a5829dab94200b2480323e42a7229915afc6" May 29 13:44:26.420330 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:26.420311 2568 scope.go:117] "RemoveContainer" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" May 29 13:44:26.420574 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:26.420550 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fv5ml_openshift-console-operator(7d753d83-9c48-4011-9dcf-e1440be747a5)\"" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podUID="7d753d83-9c48-4011-9dcf-e1440be747a5" May 29 13:44:27.422898 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:27.422875 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/1.log" May 29 13:44:27.423250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:27.423164 2568 scope.go:117] "RemoveContainer" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" May 29 13:44:27.423329 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:27.423311 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fv5ml_openshift-console-operator(7d753d83-9c48-4011-9dcf-e1440be747a5)\"" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podUID="7d753d83-9c48-4011-9dcf-e1440be747a5" May 29 13:44:27.504996 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:27.504971 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jmf9q_e8d1e520-cbc2-4d71-9117-9c1efa012450/dns-node-resolver/0.log" May 29 13:44:28.832338 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.832302 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ljj5d"] May 29 13:44:28.834966 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.834949 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:28.837888 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.837866 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 29 13:44:28.839210 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.839193 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 29 13:44:28.839299 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.839235 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 29 13:44:28.839398 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.839379 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bpzvw\"" May 29 13:44:28.839619 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.839603 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 29 13:44:28.843249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.843224 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ljj5d"] May 29 13:44:28.904938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.904916 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9j5k_a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab/node-ca/0.log" May 29 13:44:28.979620 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.979593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/38150311-089c-4103-a491-d6a905f0cf1c-signing-cabundle\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:28.979709 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.979623 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4kj\" (UniqueName: \"kubernetes.io/projected/38150311-089c-4103-a491-d6a905f0cf1c-kube-api-access-hh4kj\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:28.979788 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:28.979765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/38150311-089c-4103-a491-d6a905f0cf1c-signing-key\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.080745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.080710 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/38150311-089c-4103-a491-d6a905f0cf1c-signing-cabundle\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.080745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.080752 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4kj\" (UniqueName: \"kubernetes.io/projected/38150311-089c-4103-a491-d6a905f0cf1c-kube-api-access-hh4kj\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.080880 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.080803 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/38150311-089c-4103-a491-d6a905f0cf1c-signing-key\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.081349 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.081329 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/38150311-089c-4103-a491-d6a905f0cf1c-signing-cabundle\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.083197 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.083156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/38150311-089c-4103-a491-d6a905f0cf1c-signing-key\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.090425 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.090402 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4kj\" (UniqueName: \"kubernetes.io/projected/38150311-089c-4103-a491-d6a905f0cf1c-kube-api-access-hh4kj\") pod \"service-ca-67d667c7d-ljj5d\" (UID: \"38150311-089c-4103-a491-d6a905f0cf1c\") " pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.143943 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.143922 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" May 29 13:44:29.285462 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.285435 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ljj5d"] May 29 13:44:29.288243 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:29.288219 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38150311_089c_4103_a491_d6a905f0cf1c.slice/crio-b8b27568b92a13c478f3a7d69809c14c063d38bcffc3b246cf7c56c7b385b5ce WatchSource:0}: Error finding container b8b27568b92a13c478f3a7d69809c14c063d38bcffc3b246cf7c56c7b385b5ce: Status 404 returned error can't find the container with id b8b27568b92a13c478f3a7d69809c14c063d38bcffc3b246cf7c56c7b385b5ce May 29 13:44:29.428100 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.428029 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" event={"ID":"38150311-089c-4103-a491-d6a905f0cf1c","Type":"ContainerStarted","Data":"b8b27568b92a13c478f3a7d69809c14c063d38bcffc3b246cf7c56c7b385b5ce"} May 29 13:44:29.585066 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.585027 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:29.585193 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.585111 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:29.585193 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:29.585169 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 13:44:29.585272 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:29.585209 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:37.585196956 +0000 UTC m=+142.119102960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:29.585272 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:29.585224 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:37.585218621 +0000 UTC m=+142.119124626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : secret "router-metrics-certs-default" not found May 29 13:44:29.786113 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:29.786036 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:29.786260 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:29.786207 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 13:44:29.786328 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:29.786285 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls podName:62819a6c-630d-49cc-a54e-6b0e5b6e35cd nodeName:}" failed. No retries permitted until 2026-05-29 13:44:37.786265686 +0000 UTC m=+142.320171705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls") pod "cluster-samples-operator-697587599-755dd" (UID: "62819a6c-630d-49cc-a54e-6b0e5b6e35cd") : secret "samples-operator-tls" not found May 29 13:44:31.434262 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:31.434229 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" event={"ID":"38150311-089c-4103-a491-d6a905f0cf1c","Type":"ContainerStarted","Data":"c5a5aa42efb76cb7d33d739060a235d344ca557af5ebc6daa4b01916119ca446"} May 29 13:44:31.452952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:31.452904 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ljj5d" podStartSLOduration=1.798024178 podStartE2EDuration="3.452891827s" podCreationTimestamp="2026-05-29 13:44:28 +0000 UTC" firstStartedPulling="2026-05-29 13:44:29.290017404 +0000 UTC m=+133.823923408" lastFinishedPulling="2026-05-29 13:44:30.944885044 +0000 UTC m=+135.478791057" observedRunningTime="2026-05-29 13:44:31.452645703 +0000 UTC m=+135.986551731" watchObservedRunningTime="2026-05-29 13:44:31.452891827 +0000 UTC m=+135.986797854" May 29 13:44:32.269811 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:32.269767 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:32.269811 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:32.269813 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:32.270250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:32.270235 2568 scope.go:117] "RemoveContainer" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" May 29 13:44:32.270496 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:32.270473 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fv5ml_openshift-console-operator(7d753d83-9c48-4011-9dcf-e1440be747a5)\"" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podUID="7d753d83-9c48-4011-9dcf-e1440be747a5" May 29 13:44:37.656390 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.656341 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:37.656755 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.656469 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:37.656755 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:37.656629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle podName:bf94d73a-85d6-4a8e-890c-d35dd9a04e66 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:53.656608143 +0000 UTC m=+158.190514166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle") pod "router-default-544d49f6d6-hxbqp" (UID: "bf94d73a-85d6-4a8e-890c-d35dd9a04e66") : configmap references non-existent config key: service-ca.crt May 29 13:44:37.658736 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.658713 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-metrics-certs\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:37.857833 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.857799 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:37.860153 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.860130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62819a6c-630d-49cc-a54e-6b0e5b6e35cd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-755dd\" (UID: \"62819a6c-630d-49cc-a54e-6b0e5b6e35cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:37.966045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:37.965970 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" May 29 13:44:38.090113 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:38.090059 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd"] May 29 13:44:38.452483 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:38.452450 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" event={"ID":"62819a6c-630d-49cc-a54e-6b0e5b6e35cd","Type":"ContainerStarted","Data":"c247a503460eb9de4fbd8a2a915f8ea15526620f93ce3edde30b8b04f1e6dd26"} May 29 13:44:40.459745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:40.459662 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" event={"ID":"62819a6c-630d-49cc-a54e-6b0e5b6e35cd","Type":"ContainerStarted","Data":"93199a6de7395b718783969ae8bdf4366ffea8c949793324a6b051814543115a"} May 29 13:44:40.459745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:40.459705 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" event={"ID":"62819a6c-630d-49cc-a54e-6b0e5b6e35cd","Type":"ContainerStarted","Data":"ffdd212e08deef0b7d77fd822ef86e655b0b131ed1fdd72d13fb999a04a97f60"} May 29 13:44:40.479874 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:40.479826 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-755dd" podStartSLOduration=16.46826674 podStartE2EDuration="18.479812316s" podCreationTimestamp="2026-05-29 13:44:22 +0000 UTC" firstStartedPulling="2026-05-29 13:44:38.129051565 +0000 UTC m=+142.662957570" lastFinishedPulling="2026-05-29 13:44:40.140597141 +0000 UTC m=+144.674503146" observedRunningTime="2026-05-29 13:44:40.479169059 +0000 UTC m=+145.013075088" watchObservedRunningTime="2026-05-29 13:44:40.479812316 +0000 UTC m=+145.013718342" May 29 13:44:43.052809 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.052779 2568 scope.go:117] "RemoveContainer" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" May 29 13:44:43.468379 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.468349 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:44:43.468725 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.468710 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/1.log" May 29 13:44:43.468797 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.468744 2568 generic.go:358] "Generic (PLEG): container finished" podID="7d753d83-9c48-4011-9dcf-e1440be747a5" containerID="af1334196c4052193546aff6e2a930335c78cf803ec28a99051215d143f8c7d0" exitCode=255 May 29 13:44:43.468836 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.468807 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" event={"ID":"7d753d83-9c48-4011-9dcf-e1440be747a5","Type":"ContainerDied","Data":"af1334196c4052193546aff6e2a930335c78cf803ec28a99051215d143f8c7d0"} May 29 13:44:43.468869 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.468847 2568 scope.go:117] "RemoveContainer" containerID="07522a3cf1b493ce7720b553523fd5659a05517ba42f890d673bfda84a6fd1af" May 29 13:44:43.469159 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:43.469136 2568 scope.go:117] "RemoveContainer" containerID="af1334196c4052193546aff6e2a930335c78cf803ec28a99051215d143f8c7d0" May 29 13:44:43.469350 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:43.469332 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-fv5ml_openshift-console-operator(7d753d83-9c48-4011-9dcf-e1440be747a5)\"" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podUID="7d753d83-9c48-4011-9dcf-e1440be747a5" May 29 13:44:44.472842 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:44.472812 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:44:49.293838 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.293804 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jfxpt"] May 29 13:44:49.296775 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.296746 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.300934 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.300912 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 13:44:49.301031 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.300964 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8ccsm\"" May 29 13:44:49.301120 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.300973 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 13:44:49.309301 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.309277 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jfxpt"] May 29 13:44:49.340632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.340599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2405d54-9058-4736-8acb-396d547a789f-crio-socket\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.340632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.340640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2405d54-9058-4736-8acb-396d547a789f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.340809 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.340662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2405d54-9058-4736-8acb-396d547a789f-data-volume\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.340809 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.340696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2405d54-9058-4736-8acb-396d547a789f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.340809 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.340718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbd94\" (UniqueName: \"kubernetes.io/projected/c2405d54-9058-4736-8acb-396d547a789f-kube-api-access-jbd94\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.370091 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.370071 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dd7bf9b4-xgsd4"] May 29 13:44:49.372480 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.372466 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.375487 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.375461 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 13:44:49.375573 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.375544 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 13:44:49.375640 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.375605 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 13:44:49.375757 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.375734 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfktx\"" May 29 13:44:49.381628 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.381611 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 13:44:49.396374 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.396340 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd7bf9b4-xgsd4"] May 29 13:44:49.441673 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-certificates\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.441765 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441718 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2405d54-9058-4736-8acb-396d547a789f-crio-socket\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.441765 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4mwm\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-kube-api-access-p4mwm\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.441861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441762 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2405d54-9058-4736-8acb-396d547a789f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.441861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-trusted-ca\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.441861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441791 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2405d54-9058-4736-8acb-396d547a789f-crio-socket\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.441861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-installation-pull-secrets\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.441976 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac8030f-83d7-4d19-ab33-0c52dbada050-ca-trust-extracted\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.441976 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441966 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2405d54-9058-4736-8acb-396d547a789f-data-volume\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.442045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.441986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-bound-sa-token\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.442045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442018 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2405d54-9058-4736-8acb-396d547a789f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.442139 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-tls\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.442191 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442175 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbd94\" (UniqueName: \"kubernetes.io/projected/c2405d54-9058-4736-8acb-396d547a789f-kube-api-access-jbd94\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.442244 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-image-registry-private-configuration\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.442296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442250 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2405d54-9058-4736-8acb-396d547a789f-data-volume\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.442296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.442292 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2405d54-9058-4736-8acb-396d547a789f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.444179 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.444162 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2405d54-9058-4736-8acb-396d547a789f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.452392 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.452352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbd94\" (UniqueName: \"kubernetes.io/projected/c2405d54-9058-4736-8acb-396d547a789f-kube-api-access-jbd94\") pod \"insights-runtime-extractor-jfxpt\" (UID: \"c2405d54-9058-4736-8acb-396d547a789f\") " pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.543070 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543043 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-certificates\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543186 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4mwm\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-kube-api-access-p4mwm\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543186 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543152 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-trusted-ca\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543302 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543184 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-installation-pull-secrets\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543302 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543214 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac8030f-83d7-4d19-ab33-0c52dbada050-ca-trust-extracted\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543302 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543246 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-bound-sa-token\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543302 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543287 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-tls\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543522 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543329 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-image-registry-private-configuration\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543946 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-certificates\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.543946 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.543884 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ac8030f-83d7-4d19-ab33-0c52dbada050-ca-trust-extracted\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.544113 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.544024 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ac8030f-83d7-4d19-ab33-0c52dbada050-trusted-ca\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.545564 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.545546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-image-registry-private-configuration\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.545946 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.545918 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ac8030f-83d7-4d19-ab33-0c52dbada050-installation-pull-secrets\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.546122 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.546101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-registry-tls\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.552600 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.552576 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4mwm\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-kube-api-access-p4mwm\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.552784 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.552766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ac8030f-83d7-4d19-ab33-0c52dbada050-bound-sa-token\") pod \"image-registry-5dd7bf9b4-xgsd4\" (UID: \"0ac8030f-83d7-4d19-ab33-0c52dbada050\") " pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.606320 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.606301 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jfxpt" May 29 13:44:49.681034 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.680998 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:49.727648 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.727620 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jfxpt"] May 29 13:44:49.731088 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:49.731057 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2405d54_9058_4736_8acb_396d547a789f.slice/crio-4b9f2aa972d2573ebc0b98a94ce0171dd8a496db9d883c8b8246c1055b968afa WatchSource:0}: Error finding container 4b9f2aa972d2573ebc0b98a94ce0171dd8a496db9d883c8b8246c1055b968afa: Status 404 returned error can't find the container with id 4b9f2aa972d2573ebc0b98a94ce0171dd8a496db9d883c8b8246c1055b968afa May 29 13:44:49.806292 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:49.806205 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd7bf9b4-xgsd4"] May 29 13:44:49.809874 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:49.809842 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac8030f_83d7_4d19_ab33_0c52dbada050.slice/crio-03b36ed33147e9d6c866f4ce1b40463dd27dd0343bd37feef6bb9defc5a7837b WatchSource:0}: Error finding container 03b36ed33147e9d6c866f4ce1b40463dd27dd0343bd37feef6bb9defc5a7837b: Status 404 returned error can't find the container with id 03b36ed33147e9d6c866f4ce1b40463dd27dd0343bd37feef6bb9defc5a7837b May 29 13:44:50.487830 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.487804 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jfxpt" event={"ID":"c2405d54-9058-4736-8acb-396d547a789f","Type":"ContainerStarted","Data":"fd1730b3b98d74efb4fa550a642081b6464bc16a45c09f3c6b71246f6e3a3eaf"} May 29 13:44:50.488211 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.487838 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jfxpt" event={"ID":"c2405d54-9058-4736-8acb-396d547a789f","Type":"ContainerStarted","Data":"4b9f2aa972d2573ebc0b98a94ce0171dd8a496db9d883c8b8246c1055b968afa"} May 29 13:44:50.489232 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.489196 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" event={"ID":"0ac8030f-83d7-4d19-ab33-0c52dbada050","Type":"ContainerStarted","Data":"2bae00f0cdab8e7503aca8e6fe72afd040e46bb3ed848c5aad82be7ba3f5a767"} May 29 13:44:50.489342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.489232 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" event={"ID":"0ac8030f-83d7-4d19-ab33-0c52dbada050","Type":"ContainerStarted","Data":"03b36ed33147e9d6c866f4ce1b40463dd27dd0343bd37feef6bb9defc5a7837b"} May 29 13:44:50.489426 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.489336 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:44:50.513850 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:50.513779 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" podStartSLOduration=1.513760611 podStartE2EDuration="1.513760611s" podCreationTimestamp="2026-05-29 13:44:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:44:50.511489327 +0000 UTC m=+155.045395354" watchObservedRunningTime="2026-05-29 13:44:50.513760611 +0000 UTC m=+155.047666639" May 29 13:44:51.493812 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:51.493773 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jfxpt" event={"ID":"c2405d54-9058-4736-8acb-396d547a789f","Type":"ContainerStarted","Data":"3715d5d52eb9417fcb9e8eead35a616942ed40dab33f21b763ebb4e690eef6ea"} May 29 13:44:52.269990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:52.269903 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:52.269990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:52.269953 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:44:52.270297 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:52.270284 2568 scope.go:117] "RemoveContainer" containerID="af1334196c4052193546aff6e2a930335c78cf803ec28a99051215d143f8c7d0" May 29 13:44:52.270475 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:52.270457 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-fv5ml_openshift-console-operator(7d753d83-9c48-4011-9dcf-e1440be747a5)\"" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podUID="7d753d83-9c48-4011-9dcf-e1440be747a5" May 29 13:44:52.497821 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:52.497784 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jfxpt" event={"ID":"c2405d54-9058-4736-8acb-396d547a789f","Type":"ContainerStarted","Data":"cdf241c25f8b74e7df0aa057985aea1df530b3f07fddf4805b88097fe1dc6f85"} May 29 13:44:52.519293 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:52.519255 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jfxpt" podStartSLOduration=1.31948892 podStartE2EDuration="3.51924265s" podCreationTimestamp="2026-05-29 13:44:49 +0000 UTC" firstStartedPulling="2026-05-29 13:44:49.782431258 +0000 UTC m=+154.316337263" lastFinishedPulling="2026-05-29 13:44:51.982184988 +0000 UTC m=+156.516090993" observedRunningTime="2026-05-29 13:44:52.51745017 +0000 UTC m=+157.051356198" watchObservedRunningTime="2026-05-29 13:44:52.51924265 +0000 UTC m=+157.053148678" May 29 13:44:53.671589 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:53.671558 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:53.672106 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:53.672084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf94d73a-85d6-4a8e-890c-d35dd9a04e66-service-ca-bundle\") pod \"router-default-544d49f6d6-hxbqp\" (UID: \"bf94d73a-85d6-4a8e-890c-d35dd9a04e66\") " pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:53.856078 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:53.856038 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ps7sb" podUID="b2deb9de-7828-420b-8170-20e978ab1375" May 29 13:44:53.861178 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:53.861153 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ttwj6" podUID="6b273daf-4e71-4fa8-a925-13388d952fea" May 29 13:44:53.963879 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:53.963807 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:54.072034 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:54.072001 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8g898" podUID="b01e0990-f3cf-496b-8266-d89ed137c0d5" May 29 13:44:54.095665 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.095642 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-544d49f6d6-hxbqp"] May 29 13:44:54.097666 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:54.097641 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf94d73a_85d6_4a8e_890c_d35dd9a04e66.slice/crio-8c13acc4f5c8e7320462570798840b57f17227ee68729517d4b9497938957270 WatchSource:0}: Error finding container 8c13acc4f5c8e7320462570798840b57f17227ee68729517d4b9497938957270: Status 404 returned error can't find the container with id 8c13acc4f5c8e7320462570798840b57f17227ee68729517d4b9497938957270 May 29 13:44:54.504024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.503951 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:44:54.504024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.503964 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" event={"ID":"bf94d73a-85d6-4a8e-890c-d35dd9a04e66","Type":"ContainerStarted","Data":"650fd5c24497a4571987fa2834b2cd3a40aa2440520e3999f80acb4ca73df1c3"} May 29 13:44:54.504024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.503996 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" event={"ID":"bf94d73a-85d6-4a8e-890c-d35dd9a04e66","Type":"ContainerStarted","Data":"8c13acc4f5c8e7320462570798840b57f17227ee68729517d4b9497938957270"} May 29 13:44:54.526695 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.526649 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" podStartSLOduration=33.526637122 podStartE2EDuration="33.526637122s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:44:54.525526283 +0000 UTC m=+159.059432311" watchObservedRunningTime="2026-05-29 13:44:54.526637122 +0000 UTC m=+159.060543165" May 29 13:44:54.964511 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.964484 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:54.966930 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:54.966909 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:55.506939 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:55.506907 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:55.508196 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:55.508174 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-544d49f6d6-hxbqp" May 29 13:44:58.808348 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:58.808305 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:44:58.808728 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:58.808407 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:44:58.810669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:58.810642 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b273daf-4e71-4fa8-a925-13388d952fea-metrics-tls\") pod \"dns-default-ttwj6\" (UID: \"6b273daf-4e71-4fa8-a925-13388d952fea\") " pod="openshift-dns/dns-default-ttwj6" May 29 13:44:58.810783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:58.810765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2deb9de-7828-420b-8170-20e978ab1375-cert\") pod \"ingress-canary-ps7sb\" (UID: \"b2deb9de-7828-420b-8170-20e978ab1375\") " pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:44:59.008416 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.008388 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25vw9\"" May 29 13:44:59.016029 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.015998 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ps7sb" May 29 13:44:59.138664 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.138636 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ps7sb"] May 29 13:44:59.141312 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:44:59.141283 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2deb9de_7828_420b_8170_20e978ab1375.slice/crio-d27201c4b4094032a23dc1c26160a81131f09df56fd523fba933c377f518ca90 WatchSource:0}: Error finding container d27201c4b4094032a23dc1c26160a81131f09df56fd523fba933c377f518ca90: Status 404 returned error can't find the container with id d27201c4b4094032a23dc1c26160a81131f09df56fd523fba933c377f518ca90 May 29 13:44:59.517730 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.517680 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ps7sb" event={"ID":"b2deb9de-7828-420b-8170-20e978ab1375","Type":"ContainerStarted","Data":"d27201c4b4094032a23dc1c26160a81131f09df56fd523fba933c377f518ca90"} May 29 13:44:59.626730 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.626460 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f"] May 29 13:44:59.628919 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.628850 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.632973 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.632891 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 13:44:59.634398 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.634374 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 29 13:44:59.634703 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.634682 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 29 13:44:59.634922 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.634873 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 13:44:59.635249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.635045 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pwpgj\"" May 29 13:44:59.635325 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.635255 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 13:44:59.640195 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.640155 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f"] May 29 13:44:59.715993 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.715961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.716136 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.716005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.716136 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.716095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1fb9e8-97d6-43d7-82bd-e490063208f3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.716136 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.716120 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7gr\" (UniqueName: \"kubernetes.io/projected/5a1fb9e8-97d6-43d7-82bd-e490063208f3-kube-api-access-gj7gr\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.817526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.817446 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1fb9e8-97d6-43d7-82bd-e490063208f3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.817526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.817493 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7gr\" (UniqueName: \"kubernetes.io/projected/5a1fb9e8-97d6-43d7-82bd-e490063208f3-kube-api-access-gj7gr\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.817994 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.817564 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.817994 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.817603 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.817994 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:59.817709 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 29 13:44:59.817994 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:44:59.817779 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls podName:5a1fb9e8-97d6-43d7-82bd-e490063208f3 nodeName:}" failed. No retries permitted until 2026-05-29 13:45:00.317758991 +0000 UTC m=+164.851665004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-jjn9f" (UID: "5a1fb9e8-97d6-43d7-82bd-e490063208f3") : secret "prometheus-operator-tls" not found May 29 13:44:59.818216 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.818109 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1fb9e8-97d6-43d7-82bd-e490063208f3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.820701 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.820676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:44:59.831163 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:44:59.831128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7gr\" (UniqueName: \"kubernetes.io/projected/5a1fb9e8-97d6-43d7-82bd-e490063208f3-kube-api-access-gj7gr\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:45:00.323634 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:00.323594 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:45:00.326218 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:00.326193 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1fb9e8-97d6-43d7-82bd-e490063208f3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjn9f\" (UID: \"5a1fb9e8-97d6-43d7-82bd-e490063208f3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:45:00.541118 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:00.541089 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" May 29 13:45:00.680395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:00.680348 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f"] May 29 13:45:00.682294 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:00.682270 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1fb9e8_97d6_43d7_82bd_e490063208f3.slice/crio-d1963754736bc426b242cffad45df6e74c9987ffb2071bda6a138ffacd3c0d9f WatchSource:0}: Error finding container d1963754736bc426b242cffad45df6e74c9987ffb2071bda6a138ffacd3c0d9f: Status 404 returned error can't find the container with id d1963754736bc426b242cffad45df6e74c9987ffb2071bda6a138ffacd3c0d9f May 29 13:45:01.524142 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:01.524095 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ps7sb" event={"ID":"b2deb9de-7828-420b-8170-20e978ab1375","Type":"ContainerStarted","Data":"fe361ec52a2cee4836c35c5824270817775a4425ed5e76af0b9177a1e4437fc0"} May 29 13:45:01.525190 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:01.525160 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" event={"ID":"5a1fb9e8-97d6-43d7-82bd-e490063208f3","Type":"ContainerStarted","Data":"d1963754736bc426b242cffad45df6e74c9987ffb2071bda6a138ffacd3c0d9f"} May 29 13:45:01.543949 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:01.543892 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ps7sb" podStartSLOduration=130.129516676 podStartE2EDuration="2m11.543877079s" podCreationTimestamp="2026-05-29 13:42:50 +0000 UTC" firstStartedPulling="2026-05-29 13:44:59.143170331 +0000 UTC m=+163.677076336" lastFinishedPulling="2026-05-29 13:45:00.55753073 +0000 UTC m=+165.091436739" observedRunningTime="2026-05-29 13:45:01.541530066 +0000 UTC m=+166.075436145" watchObservedRunningTime="2026-05-29 13:45:01.543877079 +0000 UTC m=+166.077783106" May 29 13:45:02.531660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:02.531625 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" event={"ID":"5a1fb9e8-97d6-43d7-82bd-e490063208f3","Type":"ContainerStarted","Data":"34f5d8943db9ede8e9142f814c0247660ed3222529fe64c959ef93bd6b978401"} May 29 13:45:02.531660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:02.531662 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" event={"ID":"5a1fb9e8-97d6-43d7-82bd-e490063208f3","Type":"ContainerStarted","Data":"85570b187ce0683691a53d701a784333ca916c97afa6555e3a18876b35ae3d84"} May 29 13:45:02.551749 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:02.551704 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjn9f" podStartSLOduration=2.294018189 podStartE2EDuration="3.551687225s" podCreationTimestamp="2026-05-29 13:44:59 +0000 UTC" firstStartedPulling="2026-05-29 13:45:00.684717492 +0000 UTC m=+165.218623498" lastFinishedPulling="2026-05-29 13:45:01.942386529 +0000 UTC m=+166.476292534" observedRunningTime="2026-05-29 13:45:02.550673066 +0000 UTC m=+167.084579097" watchObservedRunningTime="2026-05-29 13:45:02.551687225 +0000 UTC m=+167.085593251" May 29 13:45:04.021068 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.021036 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6"] May 29 13:45:04.024112 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.024091 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mjwz9"] May 29 13:45:04.024318 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.024298 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.026733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.026709 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.029505 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.029475 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 13:45:04.029646 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.029621 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjbq9\"" May 29 13:45:04.029785 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.029765 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 13:45:04.031470 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.031055 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 13:45:04.031470 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.031155 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 13:45:04.031470 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.031286 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-77lb6\"" May 29 13:45:04.031470 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.031411 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 13:45:04.032780 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.032763 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 13:45:04.042671 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.042644 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6"] May 29 13:45:04.054914 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.054884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-wtmp\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.055045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.054939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-root\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.055279 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.055489 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-sys\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s259r\" (UniqueName: \"kubernetes.io/projected/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-api-access-s259r\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055732 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-metrics-client-ca\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxftz\" (UniqueName: \"kubernetes.io/projected/11038da5-667b-40b0-9ae4-5273668343cf-kube-api-access-nxftz\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.055966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.056135 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.056171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-textfile\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.056241 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.056210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.056745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.056243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.157524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157493 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-root\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157545 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157566 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-sys\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157592 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s259r\" (UniqueName: \"kubernetes.io/projected/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-api-access-s259r\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157616 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-root\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157657 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-sys\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.157716 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157699 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-metrics-client-ca\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157725 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxftz\" (UniqueName: \"kubernetes.io/projected/11038da5-667b-40b0-9ae4-5273668343cf-kube-api-access-nxftz\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:45:04.157735 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157750 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:45:04.157795 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls podName:11038da5-667b-40b0-9ae4-5273668343cf nodeName:}" failed. No retries permitted until 2026-05-29 13:45:04.657773062 +0000 UTC m=+169.191679071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls") pod "node-exporter-mjwz9" (UID: "11038da5-667b-40b0-9ae4-5273668343cf") : secret "node-exporter-tls" not found May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157776 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157835 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-textfile\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157909 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.157939 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.158006 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-wtmp\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158109 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.158093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.158706 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.158154 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-wtmp\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158759 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.158711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-metrics-client-ca\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.158989 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.158964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.159250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.159223 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.159505 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.159480 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-textfile\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.159883 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.159855 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.160842 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.160817 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.161857 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.161814 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.161951 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.161872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.167541 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.167500 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s259r\" (UniqueName: \"kubernetes.io/projected/22f3f8d3-0e15-4a37-b9d2-2381e9c2d266-kube-api-access-s259r\") pod \"kube-state-metrics-54fd6bc5c4-4frm6\" (UID: \"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.167896 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.167878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxftz\" (UniqueName: \"kubernetes.io/projected/11038da5-667b-40b0-9ae4-5273668343cf-kube-api-access-nxftz\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.335342 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.335312 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" May 29 13:45:04.463436 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.463409 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6"] May 29 13:45:04.466097 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:04.466060 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f3f8d3_0e15_4a37_b9d2_2381e9c2d266.slice/crio-0f4b0f66530abac267ec0cf7bac1d1b8dfda5a95af56633aaef11a00adc9af4f WatchSource:0}: Error finding container 0f4b0f66530abac267ec0cf7bac1d1b8dfda5a95af56633aaef11a00adc9af4f: Status 404 returned error can't find the container with id 0f4b0f66530abac267ec0cf7bac1d1b8dfda5a95af56633aaef11a00adc9af4f May 29 13:45:04.537853 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.537790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" event={"ID":"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266","Type":"ContainerStarted","Data":"0f4b0f66530abac267ec0cf7bac1d1b8dfda5a95af56633aaef11a00adc9af4f"} May 29 13:45:04.661634 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.661551 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.663833 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.663816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11038da5-667b-40b0-9ae4-5273668343cf-node-exporter-tls\") pod \"node-exporter-mjwz9\" (UID: \"11038da5-667b-40b0-9ae4-5273668343cf\") " pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.941084 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:04.941012 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjwz9" May 29 13:45:04.949392 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:04.949350 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11038da5_667b_40b0_9ae4_5273668343cf.slice/crio-5841e2040241691b836f1c5285ff7b5424801ceedad4630e4506a48e6a31d10a WatchSource:0}: Error finding container 5841e2040241691b836f1c5285ff7b5424801ceedad4630e4506a48e6a31d10a: Status 404 returned error can't find the container with id 5841e2040241691b836f1c5285ff7b5424801ceedad4630e4506a48e6a31d10a May 29 13:45:05.052574 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:05.052546 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:45:05.541795 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:05.541753 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwz9" event={"ID":"11038da5-667b-40b0-9ae4-5273668343cf","Type":"ContainerStarted","Data":"5841e2040241691b836f1c5285ff7b5424801ceedad4630e4506a48e6a31d10a"} May 29 13:45:06.055111 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.055084 2568 scope.go:117] "RemoveContainer" containerID="af1334196c4052193546aff6e2a930335c78cf803ec28a99051215d143f8c7d0" May 29 13:45:06.546471 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.546440 2568 generic.go:358] "Generic (PLEG): container finished" podID="11038da5-667b-40b0-9ae4-5273668343cf" containerID="40a882c33a30c0267613c0a1234780a071401e9ffbcc88f82b4c125178ca2dc8" exitCode=0 May 29 13:45:06.546664 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.546524 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwz9" event={"ID":"11038da5-667b-40b0-9ae4-5273668343cf","Type":"ContainerDied","Data":"40a882c33a30c0267613c0a1234780a071401e9ffbcc88f82b4c125178ca2dc8"} May 29 13:45:06.548527 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.548494 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" event={"ID":"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266","Type":"ContainerStarted","Data":"12fefacc56bf040482aecdd48c325242fcd11dd560a3bc440aa1b5ac866d2510"} May 29 13:45:06.548527 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.548527 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" event={"ID":"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266","Type":"ContainerStarted","Data":"3aea9baabf751abe5eac982b888c54cdac95fb8d46b5c28f3e76b4eab947a871"} May 29 13:45:06.548724 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.548540 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" event={"ID":"22f3f8d3-0e15-4a37-b9d2-2381e9c2d266","Type":"ContainerStarted","Data":"84504036fb90842ecc642fc5f94713ae909888cb68aaa0f0e9a086710f123e2b"} May 29 13:45:06.550268 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.550250 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:45:06.550401 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.550316 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" event={"ID":"7d753d83-9c48-4011-9dcf-e1440be747a5","Type":"ContainerStarted","Data":"58b368e14fe1f71ab07f85b018405b3b8c02a1dc2a9ea1619e5f22327ff8dfa2"} May 29 13:45:06.550838 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.550598 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:45:06.588440 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.588391 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" podStartSLOduration=43.219102818 podStartE2EDuration="45.588352332s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:22.397469308 +0000 UTC m=+126.931375329" lastFinishedPulling="2026-05-29 13:44:24.766718837 +0000 UTC m=+129.300624843" observedRunningTime="2026-05-29 13:45:06.587975057 +0000 UTC m=+171.121881083" watchObservedRunningTime="2026-05-29 13:45:06.588352332 +0000 UTC m=+171.122258359" May 29 13:45:06.609246 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.609200 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4frm6" podStartSLOduration=2.002299646 podStartE2EDuration="3.609187412s" podCreationTimestamp="2026-05-29 13:45:03 +0000 UTC" firstStartedPulling="2026-05-29 13:45:04.467972521 +0000 UTC m=+169.001878526" lastFinishedPulling="2026-05-29 13:45:06.074860282 +0000 UTC m=+170.608766292" observedRunningTime="2026-05-29 13:45:06.607971247 +0000 UTC m=+171.141877274" watchObservedRunningTime="2026-05-29 13:45:06.609187412 +0000 UTC m=+171.143093437" May 29 13:45:06.816345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:06.816277 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-fv5ml" May 29 13:45:07.555487 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:07.555453 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwz9" event={"ID":"11038da5-667b-40b0-9ae4-5273668343cf","Type":"ContainerStarted","Data":"85e5cd39ecb6e8345bacbcc60f680eff5027a0a94f28e90f67cefd4586777fea"} May 29 13:45:07.555487 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:07.555488 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwz9" event={"ID":"11038da5-667b-40b0-9ae4-5273668343cf","Type":"ContainerStarted","Data":"7fef3122a7a9fb6afb29e0352c0b05c7051d079465afdf2f44087ac692f17623"} May 29 13:45:07.578011 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:07.577964 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mjwz9" podStartSLOduration=3.452801133 podStartE2EDuration="4.577945735s" podCreationTimestamp="2026-05-29 13:45:03 +0000 UTC" firstStartedPulling="2026-05-29 13:45:04.95104793 +0000 UTC m=+169.484953935" lastFinishedPulling="2026-05-29 13:45:06.076192531 +0000 UTC m=+170.610098537" observedRunningTime="2026-05-29 13:45:07.57756819 +0000 UTC m=+172.111474217" watchObservedRunningTime="2026-05-29 13:45:07.577945735 +0000 UTC m=+172.111851762" May 29 13:45:08.052414 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.052378 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttwj6" May 29 13:45:08.055383 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.055347 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfdw\"" May 29 13:45:08.063774 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.063744 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttwj6" May 29 13:45:08.186840 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.186706 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttwj6"] May 29 13:45:08.189293 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:08.189260 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b273daf_4e71_4fa8_a925_13388d952fea.slice/crio-60bb93fdb7468200eccea155d6f694049b8731bad3389ceec1e123972a3fb520 WatchSource:0}: Error finding container 60bb93fdb7468200eccea155d6f694049b8731bad3389ceec1e123972a3fb520: Status 404 returned error can't find the container with id 60bb93fdb7468200eccea155d6f694049b8731bad3389ceec1e123972a3fb520 May 29 13:45:08.558941 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.558907 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttwj6" event={"ID":"6b273daf-4e71-4fa8-a925-13388d952fea","Type":"ContainerStarted","Data":"60bb93fdb7468200eccea155d6f694049b8731bad3389ceec1e123972a3fb520"} May 29 13:45:08.764692 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.764659 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7"] May 29 13:45:08.767112 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.767086 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:08.769916 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.769888 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 29 13:45:08.770194 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.770170 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-6wx9z\"" May 29 13:45:08.778765 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.778745 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7"] May 29 13:45:08.894684 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.894655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-7kxt7\" (UID: \"20e6c0f4-23e4-4363-99a0-33119406120b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:08.995784 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:08.995756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-7kxt7\" (UID: \"20e6c0f4-23e4-4363-99a0-33119406120b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:08.995926 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:45:08.995870 2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 29 13:45:08.995988 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:45:08.995932 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert podName:20e6c0f4-23e4-4363-99a0-33119406120b nodeName:}" failed. No retries permitted until 2026-05-29 13:45:09.495908605 +0000 UTC m=+174.029814623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-7kxt7" (UID: "20e6c0f4-23e4-4363-99a0-33119406120b") : secret "monitoring-plugin-cert" not found May 29 13:45:09.505735 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.505698 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-7kxt7\" (UID: \"20e6c0f4-23e4-4363-99a0-33119406120b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:09.508439 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.508410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e6c0f4-23e4-4363-99a0-33119406120b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-7kxt7\" (UID: \"20e6c0f4-23e4-4363-99a0-33119406120b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:09.680980 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.680960 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:09.688518 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.688469 2568 patch_prober.go:28] interesting pod/image-registry-5dd7bf9b4-xgsd4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 13:45:09.688662 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.688604 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" podUID="0ac8030f-83d7-4d19-ab33-0c52dbada050" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 13:45:09.815771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:09.815688 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7"] May 29 13:45:09.818472 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:09.818437 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e6c0f4_23e4_4363_99a0_33119406120b.slice/crio-fb6c93e1dc704b041cd45fb4c069d5cd2282351a00fb815cc62f9178f07d8842 WatchSource:0}: Error finding container fb6c93e1dc704b041cd45fb4c069d5cd2282351a00fb815cc62f9178f07d8842: Status 404 returned error can't find the container with id fb6c93e1dc704b041cd45fb4c069d5cd2282351a00fb815cc62f9178f07d8842 May 29 13:45:10.566923 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:10.566882 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" event={"ID":"20e6c0f4-23e4-4363-99a0-33119406120b","Type":"ContainerStarted","Data":"fb6c93e1dc704b041cd45fb4c069d5cd2282351a00fb815cc62f9178f07d8842"} May 29 13:45:10.568687 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:10.568629 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttwj6" event={"ID":"6b273daf-4e71-4fa8-a925-13388d952fea","Type":"ContainerStarted","Data":"609b22e12a9629f0a6f1f9e91034e49c1e1460e3d47737d46481aa05b7b093fc"} May 29 13:45:10.568687 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:10.568667 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttwj6" event={"ID":"6b273daf-4e71-4fa8-a925-13388d952fea","Type":"ContainerStarted","Data":"25797766ddcf1f8e6608657d715150cee144cc8d93e220155a83c77bde3bc971"} May 29 13:45:10.568957 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:10.568935 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ttwj6" May 29 13:45:10.588512 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:10.588461 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-ttwj6" podStartSLOduration=139.182162831 podStartE2EDuration="2m20.588445437s" podCreationTimestamp="2026-05-29 13:42:50 +0000 UTC" firstStartedPulling="2026-05-29 13:45:08.191218953 +0000 UTC m=+172.725124962" lastFinishedPulling="2026-05-29 13:45:09.597501556 +0000 UTC m=+174.131407568" observedRunningTime="2026-05-29 13:45:10.587222689 +0000 UTC m=+175.121128717" watchObservedRunningTime="2026-05-29 13:45:10.588445437 +0000 UTC m=+175.122351465" May 29 13:45:11.498440 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.498415 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dd7bf9b4-xgsd4" May 29 13:45:11.573223 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.573193 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" event={"ID":"20e6c0f4-23e4-4363-99a0-33119406120b","Type":"ContainerStarted","Data":"4b66279672f8dc46b7cf3a8f2de14a3dec6aec6f2ce5c85f0f927e9fa203dd66"} May 29 13:45:11.590813 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.590753 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" podStartSLOduration=2.129985014 podStartE2EDuration="3.590736481s" podCreationTimestamp="2026-05-29 13:45:08 +0000 UTC" firstStartedPulling="2026-05-29 13:45:09.820135339 +0000 UTC m=+174.354041345" lastFinishedPulling="2026-05-29 13:45:11.2808868 +0000 UTC m=+175.814792812" observedRunningTime="2026-05-29 13:45:11.59051506 +0000 UTC m=+176.124421101" watchObservedRunningTime="2026-05-29 13:45:11.590736481 +0000 UTC m=+176.124642510" May 29 13:45:11.914959 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.914885 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:11.916998 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.916974 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:11.920316 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.920294 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f8qqf\"" May 29 13:45:11.920498 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.920295 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 29 13:45:11.920498 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.920348 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 29 13:45:11.920498 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.920389 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 29 13:45:11.921082 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.921063 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 29 13:45:11.921192 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.921102 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 29 13:45:11.921192 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.921140 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 29 13:45:11.921498 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.921484 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 29 13:45:11.928382 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:11.928342 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:12.029416 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.029525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.029525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.029628 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcc2\" (UniqueName: \"kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.029663 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.029695 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.029678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131046 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131018 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131186 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131050 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131186 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131075 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131289 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131229 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcc2\" (UniqueName: \"kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131346 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131314 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131420 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131393 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131774 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131879 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.131987 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.131969 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.133652 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.133631 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.133732 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.133697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.148600 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.148575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcc2\" (UniqueName: \"kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2\") pod \"console-65d947d8b6-tdlpm\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.227651 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.227580 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:12.354274 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.354249 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:12.357691 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:12.357658 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cce56a8_dd87_465a_8dae_de96128ebc55.slice/crio-34c0288ef6c9351f4c683c5455ab1d10ef0e629883a50b63f971dd71dbdfc304 WatchSource:0}: Error finding container 34c0288ef6c9351f4c683c5455ab1d10ef0e629883a50b63f971dd71dbdfc304: Status 404 returned error can't find the container with id 34c0288ef6c9351f4c683c5455ab1d10ef0e629883a50b63f971dd71dbdfc304 May 29 13:45:12.576905 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.576868 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d947d8b6-tdlpm" event={"ID":"0cce56a8-dd87-465a-8dae-de96128ebc55","Type":"ContainerStarted","Data":"34c0288ef6c9351f4c683c5455ab1d10ef0e629883a50b63f971dd71dbdfc304"} May 29 13:45:12.577388 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.577151 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:12.582348 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:12.582328 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-7kxt7" May 29 13:45:15.587812 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:15.587786 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d947d8b6-tdlpm" event={"ID":"0cce56a8-dd87-465a-8dae-de96128ebc55","Type":"ContainerStarted","Data":"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0"} May 29 13:45:15.614506 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:15.614465 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65d947d8b6-tdlpm" podStartSLOduration=1.489340498 podStartE2EDuration="4.614449447s" podCreationTimestamp="2026-05-29 13:45:11 +0000 UTC" firstStartedPulling="2026-05-29 13:45:12.359408336 +0000 UTC m=+176.893314340" lastFinishedPulling="2026-05-29 13:45:15.484517284 +0000 UTC m=+180.018423289" observedRunningTime="2026-05-29 13:45:15.613797081 +0000 UTC m=+180.147703109" watchObservedRunningTime="2026-05-29 13:45:15.614449447 +0000 UTC m=+180.148355473" May 29 13:45:20.100810 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.100774 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:45:20.103799 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.103782 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.112993 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.112967 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 29 13:45:20.116289 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.116269 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:45:20.195620 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m26t\" (UniqueName: \"kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195864 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195864 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.195864 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.195852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297140 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297248 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297170 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297248 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297193 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297248 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7m26t\" (UniqueName: \"kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297421 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297329 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297421 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297405 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297436 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.297881 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.297858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.298034 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.298010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.298177 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.298153 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.298234 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.298162 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.299709 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.299689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.299811 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.299792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.306202 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.306183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m26t\" (UniqueName: \"kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t\") pod \"console-6bc65fd7fd-x4k5r\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.413407 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.413333 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:20.559616 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.559585 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:45:20.561931 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:45:20.561903 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff490883_72e5_4691_8803_8e4d517af1f1.slice/crio-299cabda803158ae9fac79052c722a0a7ef5617b45dc961d521b1b74e9fcee86 WatchSource:0}: Error finding container 299cabda803158ae9fac79052c722a0a7ef5617b45dc961d521b1b74e9fcee86: Status 404 returned error can't find the container with id 299cabda803158ae9fac79052c722a0a7ef5617b45dc961d521b1b74e9fcee86 May 29 13:45:20.575951 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.575920 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ttwj6" May 29 13:45:20.602204 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:20.602176 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc65fd7fd-x4k5r" event={"ID":"ff490883-72e5-4691-8803-8e4d517af1f1","Type":"ContainerStarted","Data":"299cabda803158ae9fac79052c722a0a7ef5617b45dc961d521b1b74e9fcee86"} May 29 13:45:21.606566 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:21.606532 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc65fd7fd-x4k5r" event={"ID":"ff490883-72e5-4691-8803-8e4d517af1f1","Type":"ContainerStarted","Data":"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1"} May 29 13:45:21.632060 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:21.632015 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bc65fd7fd-x4k5r" podStartSLOduration=1.6319997960000001 podStartE2EDuration="1.631999796s" podCreationTimestamp="2026-05-29 13:45:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:45:21.630902507 +0000 UTC m=+186.164808547" watchObservedRunningTime="2026-05-29 13:45:21.631999796 +0000 UTC m=+186.165905822" May 29 13:45:22.228413 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:22.228353 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:22.228597 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:22.228476 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:22.233235 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:22.233212 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:22.614092 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:22.614066 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:30.414260 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:30.414229 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:30.414743 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:30.414273 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:30.418977 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:30.418959 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:30.636087 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:30.636055 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:45:30.695529 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:30.695447 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:40.659228 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:40.659194 2568 generic.go:358] "Generic (PLEG): container finished" podID="0ab0aaec-b6fb-40b2-92c0-740a29e15770" containerID="2dcdcd6c21d9564d1dcf76f63e0c27027b4e7fb3a9ef9f5b43ad38972ea1fca6" exitCode=0 May 29 13:45:40.659658 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:40.659238 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" event={"ID":"0ab0aaec-b6fb-40b2-92c0-740a29e15770","Type":"ContainerDied","Data":"2dcdcd6c21d9564d1dcf76f63e0c27027b4e7fb3a9ef9f5b43ad38972ea1fca6"} May 29 13:45:40.659658 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:40.659599 2568 scope.go:117] "RemoveContainer" containerID="2dcdcd6c21d9564d1dcf76f63e0c27027b4e7fb3a9ef9f5b43ad38972ea1fca6" May 29 13:45:41.663886 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:41.663852 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bpvbz" event={"ID":"0ab0aaec-b6fb-40b2-92c0-740a29e15770","Type":"ContainerStarted","Data":"0fa419d7cb403a9b3d50251f2aabdd94f333499ad16cf53efca40f4826355b40"} May 29 13:45:55.715061 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.715015 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65d947d8b6-tdlpm" podUID="0cce56a8-dd87-465a-8dae-de96128ebc55" containerName="console" containerID="cri-o://5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0" gracePeriod=15 May 29 13:45:55.956710 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.956689 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d947d8b6-tdlpm_0cce56a8-dd87-465a-8dae-de96128ebc55/console/0.log" May 29 13:45:55.956825 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.956760 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:55.987492 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987432 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtcc2\" (UniqueName: \"kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987492 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987471 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987523 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987564 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987614 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987653 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config\") pod \"0cce56a8-dd87-465a-8dae-de96128ebc55\" (UID: \"0cce56a8-dd87-465a-8dae-de96128ebc55\") " May 29 13:45:55.987968 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.987931 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:45:55.988199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.988179 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config" (OuterVolumeSpecName: "console-config") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:45:55.988305 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.988209 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:45:55.989865 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.989830 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:45:55.990118 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.990097 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:45:55.990181 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:55.990136 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2" (OuterVolumeSpecName: "kube-api-access-gtcc2") pod "0cce56a8-dd87-465a-8dae-de96128ebc55" (UID: "0cce56a8-dd87-465a-8dae-de96128ebc55"). InnerVolumeSpecName "kube-api-access-gtcc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:45:56.088462 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088438 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-oauth-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.088462 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088462 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.088610 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088471 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cce56a8-dd87-465a-8dae-de96128ebc55-console-oauth-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.088610 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088481 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-console-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.088610 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088490 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtcc2\" (UniqueName: \"kubernetes.io/projected/0cce56a8-dd87-465a-8dae-de96128ebc55-kube-api-access-gtcc2\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.088610 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.088498 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cce56a8-dd87-465a-8dae-de96128ebc55-service-ca\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:45:56.713255 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713227 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d947d8b6-tdlpm_0cce56a8-dd87-465a-8dae-de96128ebc55/console/0.log" May 29 13:45:56.713432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713267 2568 generic.go:358] "Generic (PLEG): container finished" podID="0cce56a8-dd87-465a-8dae-de96128ebc55" containerID="5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0" exitCode=2 May 29 13:45:56.713432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713298 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d947d8b6-tdlpm" event={"ID":"0cce56a8-dd87-465a-8dae-de96128ebc55","Type":"ContainerDied","Data":"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0"} May 29 13:45:56.713432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713320 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d947d8b6-tdlpm" event={"ID":"0cce56a8-dd87-465a-8dae-de96128ebc55","Type":"ContainerDied","Data":"34c0288ef6c9351f4c683c5455ab1d10ef0e629883a50b63f971dd71dbdfc304"} May 29 13:45:56.713432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713335 2568 scope.go:117] "RemoveContainer" containerID="5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0" May 29 13:45:56.713432 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.713353 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d947d8b6-tdlpm" May 29 13:45:56.721214 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.720985 2568 scope.go:117] "RemoveContainer" containerID="5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0" May 29 13:45:56.721461 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:45:56.721262 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0\": container with ID starting with 5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0 not found: ID does not exist" containerID="5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0" May 29 13:45:56.721461 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.721287 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0"} err="failed to get container status \"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0\": rpc error: code = NotFound desc = could not find container \"5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0\": container with ID starting with 5c8484aab08737cf3afd06bb5b62977f44cdea301e098390718e44073904b2e0 not found: ID does not exist" May 29 13:45:56.732680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.732659 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:56.736131 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:56.736103 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d947d8b6-tdlpm"] May 29 13:45:58.056256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:45:58.056225 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cce56a8-dd87-465a-8dae-de96128ebc55" path="/var/lib/kubelet/pods/0cce56a8-dd87-465a-8dae-de96128ebc55/volumes" May 29 13:46:27.942512 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:27.942476 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:46:27.944784 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:27.944758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b01e0990-f3cf-496b-8266-d89ed137c0d5-metrics-certs\") pod \"network-metrics-daemon-8g898\" (UID: \"b01e0990-f3cf-496b-8266-d89ed137c0d5\") " pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:46:28.156749 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:28.156723 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km4z9\"" May 29 13:46:28.164238 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:28.164219 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8g898" May 29 13:46:28.285274 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:28.285246 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8g898"] May 29 13:46:28.288217 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:46:28.288189 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01e0990_f3cf_496b_8266_d89ed137c0d5.slice/crio-addb6178037c9f774e35941847cb9f273bd289c7fd26994bfb06b0723750638a WatchSource:0}: Error finding container addb6178037c9f774e35941847cb9f273bd289c7fd26994bfb06b0723750638a: Status 404 returned error can't find the container with id addb6178037c9f774e35941847cb9f273bd289c7fd26994bfb06b0723750638a May 29 13:46:28.803410 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:28.803374 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8g898" event={"ID":"b01e0990-f3cf-496b-8266-d89ed137c0d5","Type":"ContainerStarted","Data":"addb6178037c9f774e35941847cb9f273bd289c7fd26994bfb06b0723750638a"} May 29 13:46:29.809428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:29.809394 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8g898" event={"ID":"b01e0990-f3cf-496b-8266-d89ed137c0d5","Type":"ContainerStarted","Data":"21b6a9c8ed94815f13592c233dfe2d9dd799265c511e80c393c97f1feab1138c"} May 29 13:46:29.809428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:29.809434 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8g898" event={"ID":"b01e0990-f3cf-496b-8266-d89ed137c0d5","Type":"ContainerStarted","Data":"99957129a9d2b4131cb7e5c77dec8b768af124e678f8c73555926f5ccd181e22"} May 29 13:46:29.840131 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:29.840080 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8g898" podStartSLOduration=252.836091672 podStartE2EDuration="4m13.840067979s" podCreationTimestamp="2026-05-29 13:42:16 +0000 UTC" firstStartedPulling="2026-05-29 13:46:28.289826689 +0000 UTC m=+252.823732697" lastFinishedPulling="2026-05-29 13:46:29.293802994 +0000 UTC m=+253.827709004" observedRunningTime="2026-05-29 13:46:29.837603059 +0000 UTC m=+254.371509085" watchObservedRunningTime="2026-05-29 13:46:29.840067979 +0000 UTC m=+254.373974006" May 29 13:46:32.724289 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.724255 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:46:32.724771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.724666 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cce56a8-dd87-465a-8dae-de96128ebc55" containerName="console" May 29 13:46:32.724771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.724683 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cce56a8-dd87-465a-8dae-de96128ebc55" containerName="console" May 29 13:46:32.724771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.724754 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="0cce56a8-dd87-465a-8dae-de96128ebc55" containerName="console" May 29 13:46:32.726946 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.726921 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.741256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.741213 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:46:32.888217 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888406 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888406 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888406 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888513 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888513 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.888513 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.888474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgd55\" (UniqueName: \"kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989384 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989268 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989384 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989309 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgd55\" (UniqueName: \"kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989384 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989340 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989699 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989401 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989699 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989423 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989699 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989450 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.989699 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.989472 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.990260 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.990167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.990260 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.990176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.990260 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.990222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.990551 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.990349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.992050 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.992026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.992171 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.992082 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:32.998697 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:32.998675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgd55\" (UniqueName: \"kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55\") pod \"console-575fdcbdb7-cqz7z\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:33.041968 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:33.041942 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:33.171388 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:33.171236 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:46:33.174088 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:46:33.174060 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47587f0d_ea9c_43cd_a8e2_997eaee5d25d.slice/crio-f8a50c8ea531fb6d2e94e5eda08deae9b031b639552f90dff5e339aed0b24912 WatchSource:0}: Error finding container f8a50c8ea531fb6d2e94e5eda08deae9b031b639552f90dff5e339aed0b24912: Status 404 returned error can't find the container with id f8a50c8ea531fb6d2e94e5eda08deae9b031b639552f90dff5e339aed0b24912 May 29 13:46:33.821116 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:33.821080 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575fdcbdb7-cqz7z" event={"ID":"47587f0d-ea9c-43cd-a8e2-997eaee5d25d","Type":"ContainerStarted","Data":"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c"} May 29 13:46:33.821116 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:33.821119 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575fdcbdb7-cqz7z" event={"ID":"47587f0d-ea9c-43cd-a8e2-997eaee5d25d","Type":"ContainerStarted","Data":"f8a50c8ea531fb6d2e94e5eda08deae9b031b639552f90dff5e339aed0b24912"} May 29 13:46:33.842747 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:33.842703 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-575fdcbdb7-cqz7z" podStartSLOduration=1.84268926 podStartE2EDuration="1.84268926s" podCreationTimestamp="2026-05-29 13:46:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:46:33.840341838 +0000 UTC m=+258.374247866" watchObservedRunningTime="2026-05-29 13:46:33.84268926 +0000 UTC m=+258.376595287" May 29 13:46:43.042222 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:43.042129 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:43.042222 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:43.042181 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:43.046807 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:43.046786 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:43.853670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:43.853637 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:46:43.903051 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:46:43.903016 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:47:08.927166 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:08.927103 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6bc65fd7fd-x4k5r" podUID="ff490883-72e5-4691-8803-8e4d517af1f1" containerName="console" containerID="cri-o://0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1" gracePeriod=15 May 29 13:47:09.165437 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.165417 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bc65fd7fd-x4k5r_ff490883-72e5-4691-8803-8e4d517af1f1/console/0.log" May 29 13:47:09.165553 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.165476 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:47:09.250525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250461 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250506 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250530 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250575 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250593 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250614 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m26t\" (UniqueName: \"kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250669 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250663 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca\") pod \"ff490883-72e5-4691-8803-8e4d517af1f1\" (UID: \"ff490883-72e5-4691-8803-8e4d517af1f1\") " May 29 13:47:09.250990 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.250964 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:47:09.251089 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.251071 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:47:09.251149 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.251066 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config" (OuterVolumeSpecName: "console-config") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:47:09.251149 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.251139 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:47:09.252796 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.252776 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:47:09.252878 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.252824 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:47:09.252920 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.252877 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t" (OuterVolumeSpecName: "kube-api-access-7m26t") pod "ff490883-72e5-4691-8803-8e4d517af1f1" (UID: "ff490883-72e5-4691-8803-8e4d517af1f1"). InnerVolumeSpecName "kube-api-access-7m26t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:47:09.351184 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351160 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-trusted-ca-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351184 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351182 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-console-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351319 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351192 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m26t\" (UniqueName: \"kubernetes.io/projected/ff490883-72e5-4691-8803-8e4d517af1f1-kube-api-access-7m26t\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351319 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351202 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-service-ca\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351319 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351210 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-oauth-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351319 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351219 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff490883-72e5-4691-8803-8e4d517af1f1-oauth-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.351319 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.351227 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff490883-72e5-4691-8803-8e4d517af1f1-console-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:47:09.926878 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926851 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bc65fd7fd-x4k5r_ff490883-72e5-4691-8803-8e4d517af1f1/console/0.log" May 29 13:47:09.927049 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926891 2568 generic.go:358] "Generic (PLEG): container finished" podID="ff490883-72e5-4691-8803-8e4d517af1f1" containerID="0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1" exitCode=2 May 29 13:47:09.927049 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926927 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc65fd7fd-x4k5r" event={"ID":"ff490883-72e5-4691-8803-8e4d517af1f1","Type":"ContainerDied","Data":"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1"} May 29 13:47:09.927049 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926963 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc65fd7fd-x4k5r" May 29 13:47:09.927049 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926979 2568 scope.go:117] "RemoveContainer" containerID="0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1" May 29 13:47:09.927215 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.926969 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc65fd7fd-x4k5r" event={"ID":"ff490883-72e5-4691-8803-8e4d517af1f1","Type":"ContainerDied","Data":"299cabda803158ae9fac79052c722a0a7ef5617b45dc961d521b1b74e9fcee86"} May 29 13:47:09.935158 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.935142 2568 scope.go:117] "RemoveContainer" containerID="0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1" May 29 13:47:09.935429 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:47:09.935411 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1\": container with ID starting with 0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1 not found: ID does not exist" containerID="0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1" May 29 13:47:09.935507 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.935436 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1"} err="failed to get container status \"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1\": rpc error: code = NotFound desc = could not find container \"0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1\": container with ID starting with 0a073e48e4f810e88e2190126fa1b921b009232bd0ac754beb178384c83a19d1 not found: ID does not exist" May 29 13:47:09.961501 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.961473 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:47:09.969910 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:09.969890 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc65fd7fd-x4k5r"] May 29 13:47:10.056080 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:10.056060 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff490883-72e5-4691-8803-8e4d517af1f1" path="/var/lib/kubelet/pods/ff490883-72e5-4691-8803-8e4d517af1f1/volumes" May 29 13:47:15.939900 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:15.939874 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:47:15.941464 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:15.941444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:47:15.953156 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:15.953129 2568 kubelet.go:1628] "Image garbage collection succeeded" May 29 13:47:42.958760 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.958727 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:47:42.961301 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.959187 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff490883-72e5-4691-8803-8e4d517af1f1" containerName="console" May 29 13:47:42.961301 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.959206 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff490883-72e5-4691-8803-8e4d517af1f1" containerName="console" May 29 13:47:42.961301 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.959279 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff490883-72e5-4691-8803-8e4d517af1f1" containerName="console" May 29 13:47:42.962092 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.962071 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:42.974024 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:42.974002 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:47:43.104689 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104845 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104845 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104720 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104845 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104948 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104948 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.104948 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.104935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg444\" (UniqueName: \"kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.205833 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205805 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205841 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205870 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205891 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205921 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206005 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.205966 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg444\" (UniqueName: \"kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206289 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.206024 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206758 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.206731 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206845 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.206783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.206902 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.206883 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.207190 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.207169 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.208433 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.208409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.209112 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.209062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.215675 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.215651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg444\" (UniqueName: \"kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444\") pod \"console-d45c64cc8-4rws4\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.270989 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.270965 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:43.418921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.418863 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:47:43.420497 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:47:43.420473 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff5447b_26db_4b8b_96b6_6cfe94a92696.slice/crio-3ab5c0ee65a777ff1e4a744009a259ed5aa64518787522f8d3c1ec33e07dd050 WatchSource:0}: Error finding container 3ab5c0ee65a777ff1e4a744009a259ed5aa64518787522f8d3c1ec33e07dd050: Status 404 returned error can't find the container with id 3ab5c0ee65a777ff1e4a744009a259ed5aa64518787522f8d3c1ec33e07dd050 May 29 13:47:43.422599 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:43.422585 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 13:47:44.023685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:44.023647 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45c64cc8-4rws4" event={"ID":"2ff5447b-26db-4b8b-96b6-6cfe94a92696","Type":"ContainerStarted","Data":"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08"} May 29 13:47:44.023685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:44.023690 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45c64cc8-4rws4" event={"ID":"2ff5447b-26db-4b8b-96b6-6cfe94a92696","Type":"ContainerStarted","Data":"3ab5c0ee65a777ff1e4a744009a259ed5aa64518787522f8d3c1ec33e07dd050"} May 29 13:47:44.045487 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:44.045448 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d45c64cc8-4rws4" podStartSLOduration=2.045435057 podStartE2EDuration="2.045435057s" podCreationTimestamp="2026-05-29 13:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:47:44.044193644 +0000 UTC m=+328.578099671" watchObservedRunningTime="2026-05-29 13:47:44.045435057 +0000 UTC m=+328.579341084" May 29 13:47:53.271527 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:53.271493 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:53.271527 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:53.271533 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:53.275987 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:53.275963 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:54.056764 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:54.056738 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:47:54.108654 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:47:54.108621 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:48:19.129513 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.129451 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-575fdcbdb7-cqz7z" podUID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" containerName="console" containerID="cri-o://dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c" gracePeriod=15 May 29 13:48:19.369381 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.369339 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-575fdcbdb7-cqz7z_47587f0d-ea9c-43cd-a8e2-997eaee5d25d/console/0.log" May 29 13:48:19.369487 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.369423 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:48:19.471402 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471293 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471402 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471334 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471402 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471352 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgd55\" (UniqueName: \"kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471402 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471388 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471517 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471573 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471619 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert\") pod \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\" (UID: \"47587f0d-ea9c-43cd-a8e2-997eaee5d25d\") " May 29 13:48:19.471712 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471698 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca" (OuterVolumeSpecName: "service-ca") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:48:19.471924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471794 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:48:19.471924 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.471887 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config" (OuterVolumeSpecName: "console-config") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:48:19.472059 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.472040 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-service-ca\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.472115 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.472067 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-trusted-ca-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.472115 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.472069 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:48:19.473670 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.473647 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:48:19.474014 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.473990 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:48:19.474014 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.474003 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55" (OuterVolumeSpecName: "kube-api-access-tgd55") pod "47587f0d-ea9c-43cd-a8e2-997eaee5d25d" (UID: "47587f0d-ea9c-43cd-a8e2-997eaee5d25d"). InnerVolumeSpecName "kube-api-access-tgd55". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:48:19.573164 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.573135 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-oauth-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.573164 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.573161 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgd55\" (UniqueName: \"kubernetes.io/projected/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-kube-api-access-tgd55\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.573303 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.573172 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.573303 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.573181 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-console-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:19.573303 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:19.573190 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47587f0d-ea9c-43cd-a8e2-997eaee5d25d-oauth-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:20.124612 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-575fdcbdb7-cqz7z_47587f0d-ea9c-43cd-a8e2-997eaee5d25d/console/0.log" May 29 13:48:20.124733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124627 2568 generic.go:358] "Generic (PLEG): container finished" podID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" containerID="dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c" exitCode=2 May 29 13:48:20.124733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124656 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575fdcbdb7-cqz7z" event={"ID":"47587f0d-ea9c-43cd-a8e2-997eaee5d25d","Type":"ContainerDied","Data":"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c"} May 29 13:48:20.124733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124676 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575fdcbdb7-cqz7z" event={"ID":"47587f0d-ea9c-43cd-a8e2-997eaee5d25d","Type":"ContainerDied","Data":"f8a50c8ea531fb6d2e94e5eda08deae9b031b639552f90dff5e339aed0b24912"} May 29 13:48:20.124733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124681 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575fdcbdb7-cqz7z" May 29 13:48:20.124733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.124693 2568 scope.go:117] "RemoveContainer" containerID="dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c" May 29 13:48:20.134167 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.133945 2568 scope.go:117] "RemoveContainer" containerID="dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c" May 29 13:48:20.134427 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:48:20.134183 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c\": container with ID starting with dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c not found: ID does not exist" containerID="dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c" May 29 13:48:20.134427 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.134206 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c"} err="failed to get container status \"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c\": rpc error: code = NotFound desc = could not find container \"dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c\": container with ID starting with dfd43f74dcd9017b0b978ca7bdd0bac943b513eecde5e2215e9ed84b8ccb9a0c not found: ID does not exist" May 29 13:48:20.147257 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.147225 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:48:20.150708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:20.150686 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-575fdcbdb7-cqz7z"] May 29 13:48:22.056219 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:22.056187 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" path="/var/lib/kubelet/pods/47587f0d-ea9c-43cd-a8e2-997eaee5d25d/volumes" May 29 13:48:34.502577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.502544 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj"] May 29 13:48:34.503010 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.502814 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" containerName="console" May 29 13:48:34.503010 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.502824 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" containerName="console" May 29 13:48:34.503010 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.502872 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="47587f0d-ea9c-43cd-a8e2-997eaee5d25d" containerName="console" May 29 13:48:34.507176 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.507159 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.510720 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.510695 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:48:34.510837 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.510699 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:48:34.511989 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.511974 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:48:34.514786 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.514762 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj"] May 29 13:48:34.582996 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.582967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.583127 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.583022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.583127 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.583085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989pr\" (UniqueName: \"kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.684306 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.684278 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.684419 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.684324 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.684419 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.684399 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-989pr\" (UniqueName: \"kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.684744 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.684725 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.684779 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.684733 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.693731 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.693713 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-989pr\" (UniqueName: \"kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.816855 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.816796 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:34.938927 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:34.938905 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj"] May 29 13:48:34.941102 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:48:34.941071 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccf30ed_e626_4f48_a110_06952d4be681.slice/crio-f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939 WatchSource:0}: Error finding container f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939: Status 404 returned error can't find the container with id f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939 May 29 13:48:35.165145 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:35.165117 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" event={"ID":"4ccf30ed-e626-4f48-a110-06952d4be681","Type":"ContainerStarted","Data":"f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939"} May 29 13:48:44.191804 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:44.191768 2568 generic.go:358] "Generic (PLEG): container finished" podID="4ccf30ed-e626-4f48-a110-06952d4be681" containerID="8781b259212bb12f65cb13e465a99d0a53d5ccfa8f80002ea0a8c8960d888d69" exitCode=0 May 29 13:48:44.192226 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:44.191853 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" event={"ID":"4ccf30ed-e626-4f48-a110-06952d4be681","Type":"ContainerDied","Data":"8781b259212bb12f65cb13e465a99d0a53d5ccfa8f80002ea0a8c8960d888d69"} May 29 13:48:47.202255 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:47.202224 2568 generic.go:358] "Generic (PLEG): container finished" podID="4ccf30ed-e626-4f48-a110-06952d4be681" containerID="11757fb094bef0ac9101795a93c6cf84ffcbc2fb1af20d798f92ace506662676" exitCode=0 May 29 13:48:47.202633 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:47.202308 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" event={"ID":"4ccf30ed-e626-4f48-a110-06952d4be681","Type":"ContainerDied","Data":"11757fb094bef0ac9101795a93c6cf84ffcbc2fb1af20d798f92ace506662676"} May 29 13:48:53.222535 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:53.222459 2568 generic.go:358] "Generic (PLEG): container finished" podID="4ccf30ed-e626-4f48-a110-06952d4be681" containerID="b60bf58793ca78cd6f9ac0e60349384d5d0096040c0d6bf0e78fd2295ba64e0d" exitCode=0 May 29 13:48:53.222535 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:53.222526 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" event={"ID":"4ccf30ed-e626-4f48-a110-06952d4be681","Type":"ContainerDied","Data":"b60bf58793ca78cd6f9ac0e60349384d5d0096040c0d6bf0e78fd2295ba64e0d"} May 29 13:48:54.339108 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.339087 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:54.457242 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.457213 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle\") pod \"4ccf30ed-e626-4f48-a110-06952d4be681\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " May 29 13:48:54.457418 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.457285 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util\") pod \"4ccf30ed-e626-4f48-a110-06952d4be681\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " May 29 13:48:54.457418 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.457320 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-989pr\" (UniqueName: \"kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr\") pod \"4ccf30ed-e626-4f48-a110-06952d4be681\" (UID: \"4ccf30ed-e626-4f48-a110-06952d4be681\") " May 29 13:48:54.457861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.457838 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle" (OuterVolumeSpecName: "bundle") pod "4ccf30ed-e626-4f48-a110-06952d4be681" (UID: "4ccf30ed-e626-4f48-a110-06952d4be681"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:48:54.459516 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.459491 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr" (OuterVolumeSpecName: "kube-api-access-989pr") pod "4ccf30ed-e626-4f48-a110-06952d4be681" (UID: "4ccf30ed-e626-4f48-a110-06952d4be681"). InnerVolumeSpecName "kube-api-access-989pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:48:54.461408 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.461386 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util" (OuterVolumeSpecName: "util") pod "4ccf30ed-e626-4f48-a110-06952d4be681" (UID: "4ccf30ed-e626-4f48-a110-06952d4be681"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:48:54.558556 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.558499 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-989pr\" (UniqueName: \"kubernetes.io/projected/4ccf30ed-e626-4f48-a110-06952d4be681-kube-api-access-989pr\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:54.558556 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.558520 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:54.558556 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:54.558529 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccf30ed-e626-4f48-a110-06952d4be681-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:48:55.228789 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:55.228761 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" May 29 13:48:55.228789 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:55.228767 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg4tzj" event={"ID":"4ccf30ed-e626-4f48-a110-06952d4be681","Type":"ContainerDied","Data":"f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939"} May 29 13:48:55.228789 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:48:55.228795 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f817ab912bd11c3aaa9eadd8d25517da9a85574b3c2cd5398aa903a364f39939" May 29 13:49:02.580526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580482 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z"] May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580773 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="pull" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580784 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="pull" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580792 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="util" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580797 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="util" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580810 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="extract" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580818 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="extract" May 29 13:49:02.581033 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.580902 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ccf30ed-e626-4f48-a110-06952d4be681" containerName="extract" May 29 13:49:02.585478 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.585462 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.588643 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.588625 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-px6hg\"" May 29 13:49:02.589082 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.589060 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 29 13:49:02.589198 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.589180 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 29 13:49:02.599567 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.599544 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z"] May 29 13:49:02.718870 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.718840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lg8z\" (UniqueName: \"kubernetes.io/projected/0db87a7f-53f0-4940-b84a-8321eaf7e224-kube-api-access-6lg8z\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.719012 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.718884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0db87a7f-53f0-4940-b84a-8321eaf7e224-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.819755 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.819721 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lg8z\" (UniqueName: \"kubernetes.io/projected/0db87a7f-53f0-4940-b84a-8321eaf7e224-kube-api-access-6lg8z\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.819922 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.819770 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0db87a7f-53f0-4940-b84a-8321eaf7e224-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.820135 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.820116 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0db87a7f-53f0-4940-b84a-8321eaf7e224-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.833098 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.833028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lg8z\" (UniqueName: \"kubernetes.io/projected/0db87a7f-53f0-4940-b84a-8321eaf7e224-kube-api-access-6lg8z\") pod \"cert-manager-operator-controller-manager-54b9655956-ccr9z\" (UID: \"0db87a7f-53f0-4940-b84a-8321eaf7e224\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:02.894749 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:02.894714 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" May 29 13:49:03.023539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:03.023515 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z"] May 29 13:49:03.026347 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:03.026320 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db87a7f_53f0_4940_b84a_8321eaf7e224.slice/crio-79464d50d2765ae398555ac4e38a9b3aff7e7fd8a345cfe1659e5e5d1a9639d2 WatchSource:0}: Error finding container 79464d50d2765ae398555ac4e38a9b3aff7e7fd8a345cfe1659e5e5d1a9639d2: Status 404 returned error can't find the container with id 79464d50d2765ae398555ac4e38a9b3aff7e7fd8a345cfe1659e5e5d1a9639d2 May 29 13:49:03.254413 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:03.254298 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" event={"ID":"0db87a7f-53f0-4940-b84a-8321eaf7e224","Type":"ContainerStarted","Data":"79464d50d2765ae398555ac4e38a9b3aff7e7fd8a345cfe1659e5e5d1a9639d2"} May 29 13:49:05.263773 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:05.263727 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" event={"ID":"0db87a7f-53f0-4940-b84a-8321eaf7e224","Type":"ContainerStarted","Data":"f3586ab8cd851b65dd2a46739f62e52bdc830ad28668135db004a38f64c0687f"} May 29 13:49:05.292137 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:05.292084 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ccr9z" podStartSLOduration=1.67812116 podStartE2EDuration="3.292068777s" podCreationTimestamp="2026-05-29 13:49:02 +0000 UTC" firstStartedPulling="2026-05-29 13:49:03.028927597 +0000 UTC m=+407.562833606" lastFinishedPulling="2026-05-29 13:49:04.642875201 +0000 UTC m=+409.176781223" observedRunningTime="2026-05-29 13:49:05.290058122 +0000 UTC m=+409.823964150" watchObservedRunningTime="2026-05-29 13:49:05.292068777 +0000 UTC m=+409.825974804" May 29 13:49:06.845884 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.845856 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz"] May 29 13:49:06.848150 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.848134 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:06.851542 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.851519 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:49:06.851653 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.851604 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:49:06.852729 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.852714 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:49:06.860491 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.860471 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz"] May 29 13:49:06.957619 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.957592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:06.957783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.957647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sq5q\" (UniqueName: \"kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:06.957783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:06.957755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.059062 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.059030 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sq5q\" (UniqueName: \"kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.059227 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.059081 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.059227 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.059198 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.059564 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.059548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.059632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.059585 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.068714 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.068677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sq5q\" (UniqueName: \"kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.157519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.157460 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:07.285537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:07.285515 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz"] May 29 13:49:07.287190 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:07.287158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141eb9b6_b5e4_4751_8fe7_8e63a897469f.slice/crio-3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12 WatchSource:0}: Error finding container 3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12: Status 404 returned error can't find the container with id 3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12 May 29 13:49:08.273651 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:08.273616 2568 generic.go:358] "Generic (PLEG): container finished" podID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerID="e8a4fa5edc4edd9b92b825e1d5ea714c0e3ab5741e7b78d0dbbd9aab04ff869b" exitCode=0 May 29 13:49:08.274008 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:08.273686 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" event={"ID":"141eb9b6-b5e4-4751-8fe7-8e63a897469f","Type":"ContainerDied","Data":"e8a4fa5edc4edd9b92b825e1d5ea714c0e3ab5741e7b78d0dbbd9aab04ff869b"} May 29 13:49:08.274008 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:08.273711 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" event={"ID":"141eb9b6-b5e4-4751-8fe7-8e63a897469f","Type":"ContainerStarted","Data":"3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12"} May 29 13:49:11.285570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:11.285532 2568 generic.go:358] "Generic (PLEG): container finished" podID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerID="91a48b8dfa37a8dee3ac2a1798f43c048eac0a19bb8424fd8d5abcb7bbf441e7" exitCode=0 May 29 13:49:11.285992 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:11.285586 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" event={"ID":"141eb9b6-b5e4-4751-8fe7-8e63a897469f","Type":"ContainerDied","Data":"91a48b8dfa37a8dee3ac2a1798f43c048eac0a19bb8424fd8d5abcb7bbf441e7"} May 29 13:49:12.292552 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:12.292514 2568 generic.go:358] "Generic (PLEG): container finished" podID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerID="87bbc78d5576722615a192c25b6d087022160ea108f42246419610bdef4aaca8" exitCode=0 May 29 13:49:12.292916 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:12.292591 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" event={"ID":"141eb9b6-b5e4-4751-8fe7-8e63a897469f","Type":"ContainerDied","Data":"87bbc78d5576722615a192c25b6d087022160ea108f42246419610bdef4aaca8"} May 29 13:49:13.418387 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.418346 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:13.507570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.507536 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle\") pod \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " May 29 13:49:13.507570 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.507578 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util\") pod \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " May 29 13:49:13.507812 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.507599 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sq5q\" (UniqueName: \"kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q\") pod \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\" (UID: \"141eb9b6-b5e4-4751-8fe7-8e63a897469f\") " May 29 13:49:13.507937 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.507915 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle" (OuterVolumeSpecName: "bundle") pod "141eb9b6-b5e4-4751-8fe7-8e63a897469f" (UID: "141eb9b6-b5e4-4751-8fe7-8e63a897469f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:49:13.509636 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.509614 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q" (OuterVolumeSpecName: "kube-api-access-9sq5q") pod "141eb9b6-b5e4-4751-8fe7-8e63a897469f" (UID: "141eb9b6-b5e4-4751-8fe7-8e63a897469f"). InnerVolumeSpecName "kube-api-access-9sq5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:49:13.511940 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.511916 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util" (OuterVolumeSpecName: "util") pod "141eb9b6-b5e4-4751-8fe7-8e63a897469f" (UID: "141eb9b6-b5e4-4751-8fe7-8e63a897469f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:49:13.609017 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.608978 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:13.609017 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.609013 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141eb9b6-b5e4-4751-8fe7-8e63a897469f-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:13.609180 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:13.609028 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sq5q\" (UniqueName: \"kubernetes.io/projected/141eb9b6-b5e4-4751-8fe7-8e63a897469f-kube-api-access-9sq5q\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:14.300786 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:14.300751 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" event={"ID":"141eb9b6-b5e4-4751-8fe7-8e63a897469f","Type":"ContainerDied","Data":"3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12"} May 29 13:49:14.300786 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:14.300787 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b88a980b04aaf3a0e216d18e25df60266d2f5f9c4d0675d2a5bb26666e16e12" May 29 13:49:14.300786 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:14.300758 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9m6rz" May 29 13:49:18.603062 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603031 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-28j5l"] May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603293 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="pull" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603304 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="pull" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603314 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="extract" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603320 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="extract" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603336 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="util" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603341 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="util" May 29 13:49:18.603486 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.603403 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="141eb9b6-b5e4-4751-8fe7-8e63a897469f" containerName="extract" May 29 13:49:18.608850 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.608830 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.613007 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.612981 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2z6gs\"" May 29 13:49:18.613147 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.612981 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 29 13:49:18.613147 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.612982 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 29 13:49:18.617738 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.617714 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-28j5l"] May 29 13:49:18.656708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.656685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtngt\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-kube-api-access-dtngt\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.656827 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.656738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-bound-sa-token\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.757675 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.757651 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtngt\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-kube-api-access-dtngt\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.757786 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.757714 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-bound-sa-token\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.766426 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.766400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-bound-sa-token\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.766516 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.766461 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtngt\" (UniqueName: \"kubernetes.io/projected/1f110e6e-91f9-44d7-9141-d6e28999c028-kube-api-access-dtngt\") pod \"cert-manager-79c8d999ff-28j5l\" (UID: \"1f110e6e-91f9-44d7-9141-d6e28999c028\") " pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:18.934703 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:18.934620 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-28j5l" May 29 13:49:19.060853 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:19.060830 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-28j5l"] May 29 13:49:19.062526 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:19.062492 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f110e6e_91f9_44d7_9141_d6e28999c028.slice/crio-d722362f903bb6eff8950110137dac8d00cb3182d1450319cc8050469823d35a WatchSource:0}: Error finding container d722362f903bb6eff8950110137dac8d00cb3182d1450319cc8050469823d35a: Status 404 returned error can't find the container with id d722362f903bb6eff8950110137dac8d00cb3182d1450319cc8050469823d35a May 29 13:49:19.316322 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:19.316242 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-28j5l" event={"ID":"1f110e6e-91f9-44d7-9141-d6e28999c028","Type":"ContainerStarted","Data":"d722362f903bb6eff8950110137dac8d00cb3182d1450319cc8050469823d35a"} May 29 13:49:20.307043 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.307012 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv"] May 29 13:49:20.316156 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.316095 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.319544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.319522 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 29 13:49:20.319805 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.319788 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 29 13:49:20.320243 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.320202 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-thq52\"" May 29 13:49:20.321067 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.321045 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv"] May 29 13:49:20.369525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.369500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af63e06-7125-4a7d-8392-1a128e019665-tmp\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.369653 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.369631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98jc\" (UniqueName: \"kubernetes.io/projected/8af63e06-7125-4a7d-8392-1a128e019665-kube-api-access-q98jc\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.470028 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.469997 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q98jc\" (UniqueName: \"kubernetes.io/projected/8af63e06-7125-4a7d-8392-1a128e019665-kube-api-access-q98jc\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.470166 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.470048 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af63e06-7125-4a7d-8392-1a128e019665-tmp\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.470477 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.470456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af63e06-7125-4a7d-8392-1a128e019665-tmp\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.479097 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.479070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98jc\" (UniqueName: \"kubernetes.io/projected/8af63e06-7125-4a7d-8392-1a128e019665-kube-api-access-q98jc\") pod \"openshift-lws-operator-bfc7f696d-mqhkv\" (UID: \"8af63e06-7125-4a7d-8392-1a128e019665\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.628340 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.628311 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" May 29 13:49:20.773997 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:20.773966 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv"] May 29 13:49:20.776272 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:20.776237 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8af63e06_7125_4a7d_8392_1a128e019665.slice/crio-863ba586aa3ee9572f65ab479a1186015130505e166f113f00bc6126eab0858b WatchSource:0}: Error finding container 863ba586aa3ee9572f65ab479a1186015130505e166f113f00bc6126eab0858b: Status 404 returned error can't find the container with id 863ba586aa3ee9572f65ab479a1186015130505e166f113f00bc6126eab0858b May 29 13:49:21.326242 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:21.326206 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" event={"ID":"8af63e06-7125-4a7d-8392-1a128e019665","Type":"ContainerStarted","Data":"863ba586aa3ee9572f65ab479a1186015130505e166f113f00bc6126eab0858b"} May 29 13:49:23.335491 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:23.335456 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-28j5l" event={"ID":"1f110e6e-91f9-44d7-9141-d6e28999c028","Type":"ContainerStarted","Data":"5ec921e50d13a3091f713592f177764117ced904d6e12fd744a8ffd0fe2eb299"} May 29 13:49:23.353952 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:23.353896 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-28j5l" podStartSLOduration=1.6036395589999999 podStartE2EDuration="5.353879251s" podCreationTimestamp="2026-05-29 13:49:18 +0000 UTC" firstStartedPulling="2026-05-29 13:49:19.064388533 +0000 UTC m=+423.598294538" lastFinishedPulling="2026-05-29 13:49:22.814628221 +0000 UTC m=+427.348534230" observedRunningTime="2026-05-29 13:49:23.353168358 +0000 UTC m=+427.887074388" watchObservedRunningTime="2026-05-29 13:49:23.353879251 +0000 UTC m=+427.887785278" May 29 13:49:25.343969 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:25.343928 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" event={"ID":"8af63e06-7125-4a7d-8392-1a128e019665","Type":"ContainerStarted","Data":"132bf92810c9c2b530044c92b74220626e2b25c7c418f747bcad066273e097df"} May 29 13:49:25.369047 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:25.368999 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mqhkv" podStartSLOduration=1.407167563 podStartE2EDuration="5.368982595s" podCreationTimestamp="2026-05-29 13:49:20 +0000 UTC" firstStartedPulling="2026-05-29 13:49:20.778198517 +0000 UTC m=+425.312104526" lastFinishedPulling="2026-05-29 13:49:24.74001355 +0000 UTC m=+429.273919558" observedRunningTime="2026-05-29 13:49:25.367274092 +0000 UTC m=+429.901180119" watchObservedRunningTime="2026-05-29 13:49:25.368982595 +0000 UTC m=+429.902888622" May 29 13:49:27.677539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.677507 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg"] May 29 13:49:27.680544 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.680527 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.683660 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.683642 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:49:27.683752 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.683642 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:49:27.685019 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.685005 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:49:27.690808 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.690787 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg"] May 29 13:49:27.738422 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.738394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqj6b\" (UniqueName: \"kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.738537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.738426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.738537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.738452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.839745 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.839714 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.839917 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.839790 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqj6b\" (UniqueName: \"kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.839917 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.839812 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.840160 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.840139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.840227 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.840190 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.848923 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.848891 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqj6b\" (UniqueName: \"kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:27.989598 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:27.989516 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:28.115966 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:28.115941 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg"] May 29 13:49:28.117767 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:28.117731 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb55406f_d918_42ed_a4f2_d083b94a271b.slice/crio-b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1 WatchSource:0}: Error finding container b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1: Status 404 returned error can't find the container with id b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1 May 29 13:49:28.354176 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:28.354143 2568 generic.go:358] "Generic (PLEG): container finished" podID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerID="ecf7dd353fefbac13efb36d7d3cb9fd4b60dee9582dc3e31cf593f11e001eebc" exitCode=0 May 29 13:49:28.354317 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:28.354228 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" event={"ID":"bb55406f-d918-42ed-a4f2-d083b94a271b","Type":"ContainerDied","Data":"ecf7dd353fefbac13efb36d7d3cb9fd4b60dee9582dc3e31cf593f11e001eebc"} May 29 13:49:28.354317 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:28.354266 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" event={"ID":"bb55406f-d918-42ed-a4f2-d083b94a271b","Type":"ContainerStarted","Data":"b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1"} May 29 13:49:29.359224 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:29.359192 2568 generic.go:358] "Generic (PLEG): container finished" podID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerID="277c307ec96796770c60dea314e503557ce7cd82a12eea2196196fdf75ed02ac" exitCode=0 May 29 13:49:29.359623 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:29.359271 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" event={"ID":"bb55406f-d918-42ed-a4f2-d083b94a271b","Type":"ContainerDied","Data":"277c307ec96796770c60dea314e503557ce7cd82a12eea2196196fdf75ed02ac"} May 29 13:49:30.364145 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:30.364108 2568 generic.go:358] "Generic (PLEG): container finished" podID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerID="76c369e91a3bba17dcee0a421b7a8687af6cd9ee0e227a4a4192f95eadaec254" exitCode=0 May 29 13:49:30.364528 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:30.364183 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" event={"ID":"bb55406f-d918-42ed-a4f2-d083b94a271b","Type":"ContainerDied","Data":"76c369e91a3bba17dcee0a421b7a8687af6cd9ee0e227a4a4192f95eadaec254"} May 29 13:49:31.488933 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.488912 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:31.573978 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.573939 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqj6b\" (UniqueName: \"kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b\") pod \"bb55406f-d918-42ed-a4f2-d083b94a271b\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " May 29 13:49:31.574154 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.574010 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle\") pod \"bb55406f-d918-42ed-a4f2-d083b94a271b\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " May 29 13:49:31.574154 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.574042 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util\") pod \"bb55406f-d918-42ed-a4f2-d083b94a271b\" (UID: \"bb55406f-d918-42ed-a4f2-d083b94a271b\") " May 29 13:49:31.574737 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.574703 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle" (OuterVolumeSpecName: "bundle") pod "bb55406f-d918-42ed-a4f2-d083b94a271b" (UID: "bb55406f-d918-42ed-a4f2-d083b94a271b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:49:31.576224 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.576195 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b" (OuterVolumeSpecName: "kube-api-access-dqj6b") pod "bb55406f-d918-42ed-a4f2-d083b94a271b" (UID: "bb55406f-d918-42ed-a4f2-d083b94a271b"). InnerVolumeSpecName "kube-api-access-dqj6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:49:31.580577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.580517 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util" (OuterVolumeSpecName: "util") pod "bb55406f-d918-42ed-a4f2-d083b94a271b" (UID: "bb55406f-d918-42ed-a4f2-d083b94a271b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:49:31.675185 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.675126 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqj6b\" (UniqueName: \"kubernetes.io/projected/bb55406f-d918-42ed-a4f2-d083b94a271b-kube-api-access-dqj6b\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:31.675185 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.675150 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:31.675185 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:31.675159 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb55406f-d918-42ed-a4f2-d083b94a271b-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:49:32.372393 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:32.372351 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" May 29 13:49:32.372393 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:32.372345 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxsbg" event={"ID":"bb55406f-d918-42ed-a4f2-d083b94a271b","Type":"ContainerDied","Data":"b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1"} May 29 13:49:32.372603 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:32.372408 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b58d6af34e01e78f4f0a3a0e51c402de88d908f2597a3d82a1931f1d02625be1" May 29 13:49:41.434612 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434540 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q"] May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434816 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="util" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434826 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="util" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434835 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="extract" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434841 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="extract" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434860 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="pull" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434865 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="pull" May 29 13:49:41.435015 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.434913 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb55406f-d918-42ed-a4f2-d083b94a271b" containerName="extract" May 29 13:49:41.437023 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.437002 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.440470 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.440448 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 13:49:41.440651 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.440634 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zrrlh\"" May 29 13:49:41.440704 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.440681 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 13:49:41.440704 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.440691 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 13:49:41.441180 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.441161 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 13:49:41.459237 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.459214 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q"] May 29 13:49:41.556336 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.556307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/a068183b-a89e-4b19-b21d-d263aa78828d-kube-api-access-b4vgt\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.556526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.556350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.556526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.556434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.556526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.556453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.556526 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.556506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.657622 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.657592 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/a068183b-a89e-4b19-b21d-d263aa78828d-kube-api-access-b4vgt\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.657783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.657628 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.657783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.657669 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.657783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.657698 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.657783 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.657752 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.658230 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.658209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.660001 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.659972 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a068183b-a89e-4b19-b21d-d263aa78828d-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.660117 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.660099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.660231 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.660214 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a068183b-a89e-4b19-b21d-d263aa78828d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.666265 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.666235 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vgt\" (UniqueName: \"kubernetes.io/projected/a068183b-a89e-4b19-b21d-d263aa78828d-kube-api-access-b4vgt\") pod \"opendatahub-operator-controller-manager-5cf69667cd-c2q7q\" (UID: \"a068183b-a89e-4b19-b21d-d263aa78828d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.747300 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.747241 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:41.881561 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:41.881532 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q"] May 29 13:49:41.884303 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:49:41.884271 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda068183b_a89e_4b19_b21d_d263aa78828d.slice/crio-804f31940106601fc7ac7cbf2d6f80a76a0c2e726d45743e94b5ef0beb6abb1f WatchSource:0}: Error finding container 804f31940106601fc7ac7cbf2d6f80a76a0c2e726d45743e94b5ef0beb6abb1f: Status 404 returned error can't find the container with id 804f31940106601fc7ac7cbf2d6f80a76a0c2e726d45743e94b5ef0beb6abb1f May 29 13:49:42.405436 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:42.405401 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" event={"ID":"a068183b-a89e-4b19-b21d-d263aa78828d","Type":"ContainerStarted","Data":"804f31940106601fc7ac7cbf2d6f80a76a0c2e726d45743e94b5ef0beb6abb1f"} May 29 13:49:45.420500 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:45.420462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" event={"ID":"a068183b-a89e-4b19-b21d-d263aa78828d","Type":"ContainerStarted","Data":"1c434ddce7c8791fff0842d895224fb1da6dd877b5b8f97b1e3f94e15d4b60a8"} May 29 13:49:46.425074 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:46.425039 2568 generic.go:358] "Generic (PLEG): container finished" podID="a068183b-a89e-4b19-b21d-d263aa78828d" containerID="1c434ddce7c8791fff0842d895224fb1da6dd877b5b8f97b1e3f94e15d4b60a8" exitCode=0 May 29 13:49:46.425517 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:46.425100 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" event={"ID":"a068183b-a89e-4b19-b21d-d263aa78828d","Type":"ContainerDied","Data":"1c434ddce7c8791fff0842d895224fb1da6dd877b5b8f97b1e3f94e15d4b60a8"} May 29 13:49:47.430515 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:47.430475 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" event={"ID":"a068183b-a89e-4b19-b21d-d263aa78828d","Type":"ContainerStarted","Data":"2494689d35ca094d15af406b3d6d22cf2145734789de7fc4ed74b59d9d710c6c"} May 29 13:49:47.430890 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:47.430604 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:49:47.457506 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:47.457448 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" podStartSLOduration=1.539820092 podStartE2EDuration="6.45743145s" podCreationTimestamp="2026-05-29 13:49:41 +0000 UTC" firstStartedPulling="2026-05-29 13:49:41.885969529 +0000 UTC m=+446.419875535" lastFinishedPulling="2026-05-29 13:49:46.803580887 +0000 UTC m=+451.337486893" observedRunningTime="2026-05-29 13:49:47.455308227 +0000 UTC m=+451.989214253" watchObservedRunningTime="2026-05-29 13:49:47.45743145 +0000 UTC m=+451.991337478" May 29 13:49:58.435898 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:49:58.435859 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-c2q7q" May 29 13:50:01.745897 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.745857 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f"] May 29 13:50:01.751666 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.751638 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.756086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.756063 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:50:01.758580 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.758408 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:50:01.758870 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.758850 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:50:01.794995 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.794955 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f"] May 29 13:50:01.818025 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.817990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh7f\" (UniqueName: \"kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.818189 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.818043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.818189 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.818166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.850646 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.850608 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm"] May 29 13:50:01.853539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.853519 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:01.857189 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.857169 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 29 13:50:01.857904 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.857884 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sscw8\"" May 29 13:50:01.858019 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.857915 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 29 13:50:01.867666 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.867640 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm"] May 29 13:50:01.919181 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnz9z\" (UniqueName: \"kubernetes.io/projected/50f19631-bced-4e0a-9187-e2e410abdca9-kube-api-access-cnz9z\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:01.919375 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919222 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.919375 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:01.919375 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f19631-bced-4e0a-9187-e2e410abdca9-tmp\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:01.919565 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919397 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh7f\" (UniqueName: \"kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.919565 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919434 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.919674 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.919822 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.919802 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:01.930278 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:01.930250 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh7f\" (UniqueName: \"kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:02.020093 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.019981 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnz9z\" (UniqueName: \"kubernetes.io/projected/50f19631-bced-4e0a-9187-e2e410abdca9-kube-api-access-cnz9z\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.020093 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.020049 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.020304 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.020100 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f19631-bced-4e0a-9187-e2e410abdca9-tmp\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.020304 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:02.020192 2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 29 13:50:02.020304 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:02.020267 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs podName:50f19631-bced-4e0a-9187-e2e410abdca9 nodeName:}" failed. No retries permitted until 2026-05-29 13:50:02.520246883 +0000 UTC m=+467.054152902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs") pod "kube-auth-proxy-855f784d5b-hgmmm" (UID: "50f19631-bced-4e0a-9187-e2e410abdca9") : secret "kube-auth-proxy-tls" not found May 29 13:50:02.022734 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.022700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f19631-bced-4e0a-9187-e2e410abdca9-tmp\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.034132 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.034098 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnz9z\" (UniqueName: \"kubernetes.io/projected/50f19631-bced-4e0a-9187-e2e410abdca9-kube-api-access-cnz9z\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.060938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.060903 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:02.202312 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.202285 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f"] May 29 13:50:02.204223 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:02.204185 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22612492_0de1_42d4_9b2a_17d3e0aa65cf.slice/crio-be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1 WatchSource:0}: Error finding container be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1: Status 404 returned error can't find the container with id be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1 May 29 13:50:02.483770 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.483739 2568 generic.go:358] "Generic (PLEG): container finished" podID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerID="d5e197f11d575474c76705bd50f89de9c05969da944e26ad60ad927e10d72659" exitCode=0 May 29 13:50:02.483968 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.483833 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" event={"ID":"22612492-0de1-42d4-9b2a-17d3e0aa65cf","Type":"ContainerDied","Data":"d5e197f11d575474c76705bd50f89de9c05969da944e26ad60ad927e10d72659"} May 29 13:50:02.483968 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.483865 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" event={"ID":"22612492-0de1-42d4-9b2a-17d3e0aa65cf","Type":"ContainerStarted","Data":"be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1"} May 29 13:50:02.525723 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.525634 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.528045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.528015 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f19631-bced-4e0a-9187-e2e410abdca9-tls-certs\") pod \"kube-auth-proxy-855f784d5b-hgmmm\" (UID: \"50f19631-bced-4e0a-9187-e2e410abdca9\") " pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.766081 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.766050 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" May 29 13:50:02.894343 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:02.894311 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm"] May 29 13:50:02.898800 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:02.898771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f19631_bced_4e0a_9187_e2e410abdca9.slice/crio-ab8ba065bb605b266d3cdbb3ce06844149e98bab2e32c19df6826857f565617a WatchSource:0}: Error finding container ab8ba065bb605b266d3cdbb3ce06844149e98bab2e32c19df6826857f565617a: Status 404 returned error can't find the container with id ab8ba065bb605b266d3cdbb3ce06844149e98bab2e32c19df6826857f565617a May 29 13:50:03.489261 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:03.489213 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" event={"ID":"50f19631-bced-4e0a-9187-e2e410abdca9","Type":"ContainerStarted","Data":"ab8ba065bb605b266d3cdbb3ce06844149e98bab2e32c19df6826857f565617a"} May 29 13:50:04.496190 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:04.496127 2568 generic.go:358] "Generic (PLEG): container finished" podID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerID="0182296c794bcd24caa470ca0d302184e65a07a1c4cab9033199e1fdccad9f98" exitCode=0 May 29 13:50:04.496678 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:04.496225 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" event={"ID":"22612492-0de1-42d4-9b2a-17d3e0aa65cf","Type":"ContainerDied","Data":"0182296c794bcd24caa470ca0d302184e65a07a1c4cab9033199e1fdccad9f98"} May 29 13:50:06.505593 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:06.505561 2568 generic.go:358] "Generic (PLEG): container finished" podID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerID="8b55917dcea49bb4683219544a77572d5d232e998b9d2d34cf7f0c02533a77a4" exitCode=0 May 29 13:50:06.505989 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:06.505647 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" event={"ID":"22612492-0de1-42d4-9b2a-17d3e0aa65cf","Type":"ContainerDied","Data":"8b55917dcea49bb4683219544a77572d5d232e998b9d2d34cf7f0c02533a77a4"} May 29 13:50:06.507008 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:06.506985 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" event={"ID":"50f19631-bced-4e0a-9187-e2e410abdca9","Type":"ContainerStarted","Data":"9d48be730ed0c850ae12f6e2975cf8de28bf0455598aa8524806a0c5ec392ced"} May 29 13:50:06.547867 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:06.547815 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-855f784d5b-hgmmm" podStartSLOduration=2.864675797 podStartE2EDuration="5.547798566s" podCreationTimestamp="2026-05-29 13:50:01 +0000 UTC" firstStartedPulling="2026-05-29 13:50:02.900625366 +0000 UTC m=+467.434531371" lastFinishedPulling="2026-05-29 13:50:05.583748131 +0000 UTC m=+470.117654140" observedRunningTime="2026-05-29 13:50:06.547722211 +0000 UTC m=+471.081628250" watchObservedRunningTime="2026-05-29 13:50:06.547798566 +0000 UTC m=+471.081704591" May 29 13:50:07.634809 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.634785 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:07.676049 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.676018 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmh7f\" (UniqueName: \"kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f\") pod \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " May 29 13:50:07.676185 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.676059 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util\") pod \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " May 29 13:50:07.676185 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.676085 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle\") pod \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\" (UID: \"22612492-0de1-42d4-9b2a-17d3e0aa65cf\") " May 29 13:50:07.676936 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.676911 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle" (OuterVolumeSpecName: "bundle") pod "22612492-0de1-42d4-9b2a-17d3e0aa65cf" (UID: "22612492-0de1-42d4-9b2a-17d3e0aa65cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:50:07.678108 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.678079 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f" (OuterVolumeSpecName: "kube-api-access-fmh7f") pod "22612492-0de1-42d4-9b2a-17d3e0aa65cf" (UID: "22612492-0de1-42d4-9b2a-17d3e0aa65cf"). InnerVolumeSpecName "kube-api-access-fmh7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:50:07.680826 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.680792 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util" (OuterVolumeSpecName: "util") pod "22612492-0de1-42d4-9b2a-17d3e0aa65cf" (UID: "22612492-0de1-42d4-9b2a-17d3e0aa65cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:50:07.777599 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.777515 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmh7f\" (UniqueName: \"kubernetes.io/projected/22612492-0de1-42d4-9b2a-17d3e0aa65cf-kube-api-access-fmh7f\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:07.777599 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.777542 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:07.777599 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:07.777552 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22612492-0de1-42d4-9b2a-17d3e0aa65cf-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:08.516052 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:08.516019 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" event={"ID":"22612492-0de1-42d4-9b2a-17d3e0aa65cf","Type":"ContainerDied","Data":"be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1"} May 29 13:50:08.516052 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:08.516051 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be8047f8c60e8ff9d406e3dcfe4ad71ad23ccb5e1f668b8168b2ff4a43a4d6a1" May 29 13:50:08.516257 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:08.516086 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mt77f" May 29 13:50:12.802778 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.802747 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn"] May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803058 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="util" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803071 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="util" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803079 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="extract" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803085 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="extract" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803096 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="pull" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803102 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="pull" May 29 13:50:12.803249 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.803159 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="22612492-0de1-42d4-9b2a-17d3e0aa65cf" containerName="extract" May 29 13:50:12.805722 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.805698 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz"] May 29 13:50:12.805885 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.805862 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:12.808165 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.808142 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:12.810473 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.810451 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 29 13:50:12.810764 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.810744 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h6m8s\"" May 29 13:50:12.812096 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.812076 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8hs7z\"" May 29 13:50:12.812209 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.812085 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" May 29 13:50:12.819428 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.819406 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn"] May 29 13:50:12.822008 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.821983 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz"] May 29 13:50:12.922740 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.922712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbnd\" (UniqueName: \"kubernetes.io/projected/53fa3ef6-d568-407f-9755-25ca00c33372-kube-api-access-mwbnd\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:12.922900 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.922753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:12.922900 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.922796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgwg\" (UniqueName: \"kubernetes.io/projected/b7c44a0d-1430-46ce-9745-524e9e878067-kube-api-access-gdgwg\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:12.922900 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:12.922872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.024110 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.024083 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.024260 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.024130 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbnd\" (UniqueName: \"kubernetes.io/projected/53fa3ef6-d568-407f-9755-25ca00c33372-kube-api-access-mwbnd\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.024260 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:13.024244 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 29 13:50:13.024404 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.024258 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.024404 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:13.024318 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert podName:53fa3ef6-d568-407f-9755-25ca00c33372 nodeName:}" failed. No retries permitted until 2026-05-29 13:50:13.524298584 +0000 UTC m=+478.058204596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert") pod "kserve-controller-manager-7c99ffcdcd-qgsvn" (UID: "53fa3ef6-d568-407f-9755-25ca00c33372") : secret "kserve-webhook-server-cert" not found May 29 13:50:13.024404 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.024341 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgwg\" (UniqueName: \"kubernetes.io/projected/b7c44a0d-1430-46ce-9745-524e9e878067-kube-api-access-gdgwg\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.024550 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:13.024411 2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found May 29 13:50:13.024550 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:50:13.024473 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert podName:b7c44a0d-1430-46ce-9745-524e9e878067 nodeName:}" failed. No retries permitted until 2026-05-29 13:50:13.524456239 +0000 UTC m=+478.058362259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert") pod "llmisvc-controller-manager-c6b9847d7-dnqbz" (UID: "b7c44a0d-1430-46ce-9745-524e9e878067") : secret "llmisvc-webhook-server-cert" not found May 29 13:50:13.062071 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.062019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgwg\" (UniqueName: \"kubernetes.io/projected/b7c44a0d-1430-46ce-9745-524e9e878067-kube-api-access-gdgwg\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.066519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.066498 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbnd\" (UniqueName: \"kubernetes.io/projected/53fa3ef6-d568-407f-9755-25ca00c33372-kube-api-access-mwbnd\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.529679 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.529645 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.529849 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.529702 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.532398 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.532351 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53fa3ef6-d568-407f-9755-25ca00c33372-cert\") pod \"kserve-controller-manager-7c99ffcdcd-qgsvn\" (UID: \"53fa3ef6-d568-407f-9755-25ca00c33372\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.532525 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.532453 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7c44a0d-1430-46ce-9745-524e9e878067-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dnqbz\" (UID: \"b7c44a0d-1430-46ce-9745-524e9e878067\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.720657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.720628 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:13.729417 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.729390 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:13.886223 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.886199 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn"] May 29 13:50:13.888608 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:13.888583 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fa3ef6_d568_407f_9755_25ca00c33372.slice/crio-ef9b23637e90bd8062c03486b4cba2808f62853ade992df1313e392adeeda776 WatchSource:0}: Error finding container ef9b23637e90bd8062c03486b4cba2808f62853ade992df1313e392adeeda776: Status 404 returned error can't find the container with id ef9b23637e90bd8062c03486b4cba2808f62853ade992df1313e392adeeda776 May 29 13:50:13.909888 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:13.909863 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz"] May 29 13:50:13.911966 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:13.911932 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7c44a0d_1430_46ce_9745_524e9e878067.slice/crio-8d6c1e7a74038f278e36c13f855c879533919e6428ee1725552916d7b8a540c6 WatchSource:0}: Error finding container 8d6c1e7a74038f278e36c13f855c879533919e6428ee1725552916d7b8a540c6: Status 404 returned error can't find the container with id 8d6c1e7a74038f278e36c13f855c879533919e6428ee1725552916d7b8a540c6 May 29 13:50:14.540328 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:14.540286 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" event={"ID":"b7c44a0d-1430-46ce-9745-524e9e878067","Type":"ContainerStarted","Data":"8d6c1e7a74038f278e36c13f855c879533919e6428ee1725552916d7b8a540c6"} May 29 13:50:14.541916 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:14.541875 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" event={"ID":"53fa3ef6-d568-407f-9755-25ca00c33372","Type":"ContainerStarted","Data":"ef9b23637e90bd8062c03486b4cba2808f62853ade992df1313e392adeeda776"} May 29 13:50:17.065690 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.065658 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6"] May 29 13:50:17.070006 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.069975 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.098782 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.098758 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:50:17.098920 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.098758 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:50:17.100153 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.100135 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:50:17.165507 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.165481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4tq\" (UniqueName: \"kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.165648 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.165540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.165648 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.165600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.173379 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.173334 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6"] May 29 13:50:17.266259 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.266219 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4tq\" (UniqueName: \"kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.266259 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.266267 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.266520 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.266286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.266677 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.266655 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.266724 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.266689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.301333 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.301301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4tq\" (UniqueName: \"kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.382238 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.382208 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:17.703542 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:17.703502 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6"] May 29 13:50:18.561539 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.561501 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" event={"ID":"b7c44a0d-1430-46ce-9745-524e9e878067","Type":"ContainerStarted","Data":"4adb182b01d3e809e39e454feac44bfcb5a66420dd0d801f9ce26e47846105e2"} May 29 13:50:18.562026 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.561658 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:18.562847 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.562820 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" event={"ID":"53fa3ef6-d568-407f-9755-25ca00c33372","Type":"ContainerStarted","Data":"01832a9cb4a46712b283bf196c2d889bf0e1563d3b0679aad29e1a491e13e777"} May 29 13:50:18.563002 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.562981 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:50:18.564272 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.564245 2568 generic.go:358] "Generic (PLEG): container finished" podID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerID="d94914f42dafc704df505bf73e807a0d9ddbe2f6e2c37927cf2c236de0cb9907" exitCode=0 May 29 13:50:18.564422 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.564328 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" event={"ID":"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34","Type":"ContainerDied","Data":"d94914f42dafc704df505bf73e807a0d9ddbe2f6e2c37927cf2c236de0cb9907"} May 29 13:50:18.564422 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.564379 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" event={"ID":"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34","Type":"ContainerStarted","Data":"2b3709409c68890d7cf218e8e4cd562a6b3c55d06139b6b702a0a7809bebb0bc"} May 29 13:50:18.687343 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.687294 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" podStartSLOduration=3.102595972 podStartE2EDuration="6.687280017s" podCreationTimestamp="2026-05-29 13:50:12 +0000 UTC" firstStartedPulling="2026-05-29 13:50:13.913390175 +0000 UTC m=+478.447296181" lastFinishedPulling="2026-05-29 13:50:17.498074216 +0000 UTC m=+482.031980226" observedRunningTime="2026-05-29 13:50:18.643258017 +0000 UTC m=+483.177164048" watchObservedRunningTime="2026-05-29 13:50:18.687280017 +0000 UTC m=+483.221186046" May 29 13:50:18.750777 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:18.750722 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" podStartSLOduration=3.142261567 podStartE2EDuration="6.750704369s" podCreationTimestamp="2026-05-29 13:50:12 +0000 UTC" firstStartedPulling="2026-05-29 13:50:13.889855934 +0000 UTC m=+478.423761943" lastFinishedPulling="2026-05-29 13:50:17.49829874 +0000 UTC m=+482.032204745" observedRunningTime="2026-05-29 13:50:18.749627849 +0000 UTC m=+483.283533878" watchObservedRunningTime="2026-05-29 13:50:18.750704369 +0000 UTC m=+483.284610397" May 29 13:50:19.956771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.956731 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nxktq"] May 29 13:50:19.959041 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.959023 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:19.962964 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.962938 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 29 13:50:19.963206 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.963189 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jzmjd\"" May 29 13:50:19.963499 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.963483 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 29 13:50:19.983051 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:19.983022 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nxktq"] May 29 13:50:20.094861 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.094831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88tq\" (UniqueName: \"kubernetes.io/projected/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-kube-api-access-b88tq\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.095011 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.094906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.196239 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.196217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b88tq\" (UniqueName: \"kubernetes.io/projected/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-kube-api-access-b88tq\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.196407 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.196377 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.198556 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.198535 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.208537 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.208514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88tq\" (UniqueName: \"kubernetes.io/projected/7b4087d8-c56a-4cc7-b5ad-b69da62b4a77-kube-api-access-b88tq\") pod \"servicemesh-operator3-55f49c5f94-nxktq\" (UID: \"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.268975 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.268954 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:20.404125 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.404097 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nxktq"] May 29 13:50:20.406072 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:20.406040 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4087d8_c56a_4cc7_b5ad_b69da62b4a77.slice/crio-750f3fdc2a5f9f50c7563c0e2c377e9dc59513d909832b49ae57d75357d9cc57 WatchSource:0}: Error finding container 750f3fdc2a5f9f50c7563c0e2c377e9dc59513d909832b49ae57d75357d9cc57: Status 404 returned error can't find the container with id 750f3fdc2a5f9f50c7563c0e2c377e9dc59513d909832b49ae57d75357d9cc57 May 29 13:50:20.572419 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.572387 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" event={"ID":"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77","Type":"ContainerStarted","Data":"750f3fdc2a5f9f50c7563c0e2c377e9dc59513d909832b49ae57d75357d9cc57"} May 29 13:50:20.574345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.574319 2568 generic.go:358] "Generic (PLEG): container finished" podID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerID="76cb2ad0368580efde8d401d2a09ca66651ad7f9b7c3c12ab5c92bd0b69e70f7" exitCode=0 May 29 13:50:20.574464 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:20.574403 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" event={"ID":"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34","Type":"ContainerDied","Data":"76cb2ad0368580efde8d401d2a09ca66651ad7f9b7c3c12ab5c92bd0b69e70f7"} May 29 13:50:21.579920 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:21.579886 2568 generic.go:358] "Generic (PLEG): container finished" podID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerID="e0d4cc87b5794e594d444068b4ee09dc01786c6b0b1abd61cb0ef2fffa540fc4" exitCode=0 May 29 13:50:21.580299 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:21.579967 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" event={"ID":"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34","Type":"ContainerDied","Data":"e0d4cc87b5794e594d444068b4ee09dc01786c6b0b1abd61cb0ef2fffa540fc4"} May 29 13:50:22.718125 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.718102 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:22.817597 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.817564 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs4tq\" (UniqueName: \"kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq\") pod \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " May 29 13:50:22.817766 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.817682 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util\") pod \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " May 29 13:50:22.817766 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.817712 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle\") pod \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\" (UID: \"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34\") " May 29 13:50:22.818676 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.818644 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle" (OuterVolumeSpecName: "bundle") pod "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" (UID: "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:50:22.819685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.819659 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq" (OuterVolumeSpecName: "kube-api-access-zs4tq") pod "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" (UID: "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34"). InnerVolumeSpecName "kube-api-access-zs4tq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:50:22.823135 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.823112 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util" (OuterVolumeSpecName: "util") pod "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" (UID: "fb2eba25-ca57-4874-ae89-0fb8ac4e5c34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:50:22.919074 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.919002 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:22.919074 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.919032 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:22.919074 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:22.919046 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs4tq\" (UniqueName: \"kubernetes.io/projected/fb2eba25-ca57-4874-ae89-0fb8ac4e5c34-kube-api-access-zs4tq\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:50:23.595508 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:23.595462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" event={"ID":"fb2eba25-ca57-4874-ae89-0fb8ac4e5c34","Type":"ContainerDied","Data":"2b3709409c68890d7cf218e8e4cd562a6b3c55d06139b6b702a0a7809bebb0bc"} May 29 13:50:23.595508 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:23.595512 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b3709409c68890d7cf218e8e4cd562a6b3c55d06139b6b702a0a7809bebb0bc" May 29 13:50:23.595740 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:23.595487 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vzc6" May 29 13:50:25.604038 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:25.604003 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" event={"ID":"7b4087d8-c56a-4cc7-b5ad-b69da62b4a77","Type":"ContainerStarted","Data":"d5c646591089234e9c86c0d39714abb0b021e8a2bf8114d0602d8b0bd19c16de"} May 29 13:50:25.604472 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:25.604160 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:25.629629 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:25.629571 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" podStartSLOduration=2.189982274 podStartE2EDuration="6.629553264s" podCreationTimestamp="2026-05-29 13:50:19 +0000 UTC" firstStartedPulling="2026-05-29 13:50:20.408745081 +0000 UTC m=+484.942651086" lastFinishedPulling="2026-05-29 13:50:24.848316059 +0000 UTC m=+489.382222076" observedRunningTime="2026-05-29 13:50:25.626504531 +0000 UTC m=+490.160410560" watchObservedRunningTime="2026-05-29 13:50:25.629553264 +0000 UTC m=+490.163459292" May 29 13:50:32.202887 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.202847 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-b886db694-6t5sl"] May 29 13:50:32.203399 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203349 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="pull" May 29 13:50:32.203524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203428 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="pull" May 29 13:50:32.203524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203482 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="util" May 29 13:50:32.203524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203491 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="util" May 29 13:50:32.203524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203500 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="extract" May 29 13:50:32.203524 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203508 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="extract" May 29 13:50:32.203801 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.203606 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb2eba25-ca57-4874-ae89-0fb8ac4e5c34" containerName="extract" May 29 13:50:32.205951 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.205925 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.209116 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.209092 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" May 29 13:50:32.209250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.209168 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ftt6b\"" May 29 13:50:32.215181 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.215152 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b886db694-6t5sl"] May 29 13:50:32.298808 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.298774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-redirect-config\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.298993 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.298893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfkq\" (UniqueName: \"kubernetes.io/projected/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-kube-api-access-gdfkq\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.399352 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.399321 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfkq\" (UniqueName: \"kubernetes.io/projected/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-kube-api-access-gdfkq\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.399573 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.399420 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-redirect-config\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.400154 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.400128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-redirect-config\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.408899 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.408877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdfkq\" (UniqueName: \"kubernetes.io/projected/31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd-kube-api-access-gdfkq\") pod \"dashboard-redirect-b886db694-6t5sl\" (UID: \"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd\") " pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.518221 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.518141 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b886db694-6t5sl" May 29 13:50:32.644299 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:32.644256 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b886db694-6t5sl"] May 29 13:50:32.645639 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:32.645606 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31db1cf5_a9d6_4891_8b8c_2e6609ac8fdd.slice/crio-15692fb34285b662940f9258169f19f09eb84276c888d5499465283ad7168502 WatchSource:0}: Error finding container 15692fb34285b662940f9258169f19f09eb84276c888d5499465283ad7168502: Status 404 returned error can't find the container with id 15692fb34285b662940f9258169f19f09eb84276c888d5499465283ad7168502 May 29 13:50:33.637084 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:33.636997 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b886db694-6t5sl" event={"ID":"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd","Type":"ContainerStarted","Data":"15692fb34285b662940f9258169f19f09eb84276c888d5499465283ad7168502"} May 29 13:50:34.300151 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.300112 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7489m"] May 29 13:50:34.302967 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.302940 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.305978 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.305944 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 29 13:50:34.306096 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.305982 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 29 13:50:34.306096 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.305983 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 29 13:50:34.306344 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.306264 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vjw86\"" May 29 13:50:34.306510 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.306292 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 29 13:50:34.313443 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.313402 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7489m"] May 29 13:50:34.419666 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.419921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e15afe-fd9e-4337-a15e-0c896fb80b9a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.419921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.419921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.419921 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.420090 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fbwx\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-kube-api-access-4fbwx\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.420090 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.419990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521144 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521106 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521161 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521218 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521243 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fbwx\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-kube-api-access-4fbwx\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521288 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521319 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.521326 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.521344 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e15afe-fd9e-4337-a15e-0c896fb80b9a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.522416 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.522382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.524395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.524290 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.524395 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.524308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e15afe-fd9e-4337-a15e-0c896fb80b9a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.524567 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.524502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.524629 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.524577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66e15afe-fd9e-4337-a15e-0c896fb80b9a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.535900 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.535852 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fbwx\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-kube-api-access-4fbwx\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.537475 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.537426 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e15afe-fd9e-4337-a15e-0c896fb80b9a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7489m\" (UID: \"66e15afe-fd9e-4337-a15e-0c896fb80b9a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.616898 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.616862 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:34.785120 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:34.784528 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7489m"] May 29 13:50:36.610615 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:36.610581 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nxktq" May 29 13:50:37.253619 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:50:37.253581 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e15afe_fd9e_4337_a15e_0c896fb80b9a.slice/crio-7a0ada88f914b80412fce6177bcf8c3c25c6168eb671fe82138d8098b6a91e41 WatchSource:0}: Error finding container 7a0ada88f914b80412fce6177bcf8c3c25c6168eb671fe82138d8098b6a91e41: Status 404 returned error can't find the container with id 7a0ada88f914b80412fce6177bcf8c3c25c6168eb671fe82138d8098b6a91e41 May 29 13:50:37.657906 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:37.657866 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" event={"ID":"66e15afe-fd9e-4337-a15e-0c896fb80b9a","Type":"ContainerStarted","Data":"7a0ada88f914b80412fce6177bcf8c3c25c6168eb671fe82138d8098b6a91e41"} May 29 13:50:37.659256 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:37.659223 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b886db694-6t5sl" event={"ID":"31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd","Type":"ContainerStarted","Data":"2cbe766f2aa518624bd4b3b38508f296260e443050017d4199d01dc99d847048"} May 29 13:50:37.679617 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:37.679561 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-b886db694-6t5sl" podStartSLOduration=1.019312775 podStartE2EDuration="5.679541408s" podCreationTimestamp="2026-05-29 13:50:32 +0000 UTC" firstStartedPulling="2026-05-29 13:50:32.646993181 +0000 UTC m=+497.180899186" lastFinishedPulling="2026-05-29 13:50:37.30722181 +0000 UTC m=+501.841127819" observedRunningTime="2026-05-29 13:50:37.678620062 +0000 UTC m=+502.212526092" watchObservedRunningTime="2026-05-29 13:50:37.679541408 +0000 UTC m=+502.213447436" May 29 13:50:46.490982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:46.490944 2568 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 29 13:50:46.491262 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:46.491017 2568 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 29 13:50:46.693025 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:46.692982 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" event={"ID":"66e15afe-fd9e-4337-a15e-0c896fb80b9a","Type":"ContainerStarted","Data":"3c738411ffc3154a6c200bd4a5d82f22a91f88144cb9676a4212b171aa22dcc6"} May 29 13:50:46.693179 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:46.693163 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:46.716541 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:46.716497 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" podStartSLOduration=3.481354883 podStartE2EDuration="12.716481867s" podCreationTimestamp="2026-05-29 13:50:34 +0000 UTC" firstStartedPulling="2026-05-29 13:50:37.255578277 +0000 UTC m=+501.789484299" lastFinishedPulling="2026-05-29 13:50:46.490705274 +0000 UTC m=+511.024611283" observedRunningTime="2026-05-29 13:50:46.715313436 +0000 UTC m=+511.249219465" watchObservedRunningTime="2026-05-29 13:50:46.716481867 +0000 UTC m=+511.250387895" May 29 13:50:47.699251 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:47.699217 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7489m" May 29 13:50:49.570455 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:49.570425 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dnqbz" May 29 13:50:49.573620 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:50:49.573597 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-qgsvn" May 29 13:51:16.804147 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.804114 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj"] May 29 13:51:16.823008 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.822982 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj"] May 29 13:51:16.823158 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.823115 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:16.826376 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.826341 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 13:51:16.826519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.826379 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 13:51:16.826519 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.826406 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxrd4\"" May 29 13:51:16.972705 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.972674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks8rz\" (UniqueName: \"kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:16.972868 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.972736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:16.972868 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:16.972800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.073271 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.073247 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.073426 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.073302 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks8rz\" (UniqueName: \"kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.073426 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.073342 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.073691 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.073675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.073733 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.073689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.083277 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.083253 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks8rz\" (UniqueName: \"kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.140410 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.140388 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:17.276426 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.276350 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj"] May 29 13:51:17.281513 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:17.281480 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14786a5_bb57_4d7c_80c3_5b9e635e92d1.slice/crio-99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f WatchSource:0}: Error finding container 99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f: Status 404 returned error can't find the container with id 99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f May 29 13:51:17.409475 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.409449 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4"] May 29 13:51:17.413030 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.413014 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.421729 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.421706 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4"] May 29 13:51:17.478796 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.478769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xm4b\" (UniqueName: \"kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.478911 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.478825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.478911 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.478904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.580086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.580015 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.580086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.580067 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xm4b\" (UniqueName: \"kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.580278 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.580094 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.580488 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.580465 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.580568 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.580468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.590471 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.590453 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xm4b\" (UniqueName: \"kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.753250 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.753221 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:17.812661 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.812632 2568 generic.go:358] "Generic (PLEG): container finished" podID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerID="466c0ebd38f49eb9635f4f62732aa23875b928bcb189f3df12eeae733c8af2b8" exitCode=0 May 29 13:51:17.812979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.812671 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" event={"ID":"e14786a5-bb57-4d7c-80c3-5b9e635e92d1","Type":"ContainerDied","Data":"466c0ebd38f49eb9635f4f62732aa23875b928bcb189f3df12eeae733c8af2b8"} May 29 13:51:17.812979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.812693 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" event={"ID":"e14786a5-bb57-4d7c-80c3-5b9e635e92d1","Type":"ContainerStarted","Data":"99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f"} May 29 13:51:17.881708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:17.881592 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4"] May 29 13:51:17.884196 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:17.884173 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31787bee_77a8_4011_8661_237af2521d17.slice/crio-f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd WatchSource:0}: Error finding container f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd: Status 404 returned error can't find the container with id f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd May 29 13:51:18.007034 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.007003 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874"] May 29 13:51:18.010484 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.010465 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.019850 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.019828 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874"] May 29 13:51:18.084855 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.084790 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h42nf\" (UniqueName: \"kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.084855 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.084824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.084855 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.084842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.186108 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.186075 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h42nf\" (UniqueName: \"kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.186108 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.186113 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.186339 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.186131 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.186472 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.186452 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.186527 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.186508 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.195092 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.195070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h42nf\" (UniqueName: \"kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.347038 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.346970 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:18.410418 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.410376 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9"] May 29 13:51:18.414719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.414698 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.425791 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.425763 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9"] May 29 13:51:18.489131 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.488960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpsbd\" (UniqueName: \"kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.489131 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.489059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.489131 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.489105 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.534040 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.534018 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874"] May 29 13:51:18.535701 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:18.535670 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317a8976_6179_4b5d_9afe_a05c46ec29ec.slice/crio-88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9 WatchSource:0}: Error finding container 88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9: Status 404 returned error can't find the container with id 88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9 May 29 13:51:18.589653 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.589626 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.589750 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.589675 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.589750 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.589725 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpsbd\" (UniqueName: \"kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.589966 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.589949 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.590013 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.589998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.598751 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.598703 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpsbd\" (UniqueName: \"kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.726225 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.726200 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:18.818682 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.818647 2568 generic.go:358] "Generic (PLEG): container finished" podID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerID="0498f0e5f524f40b9a3013567d84645e76bcc791dbcf64ec89b78911b115a9f3" exitCode=0 May 29 13:51:18.819086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.818729 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" event={"ID":"e14786a5-bb57-4d7c-80c3-5b9e635e92d1","Type":"ContainerDied","Data":"0498f0e5f524f40b9a3013567d84645e76bcc791dbcf64ec89b78911b115a9f3"} May 29 13:51:18.820541 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.820473 2568 generic.go:358] "Generic (PLEG): container finished" podID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerID="d06cc3aa571c8a87af00bc204c5a0a0de2da311f94299d9c516b34b6018f9fb5" exitCode=0 May 29 13:51:18.820541 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.820535 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" event={"ID":"317a8976-6179-4b5d-9afe-a05c46ec29ec","Type":"ContainerDied","Data":"d06cc3aa571c8a87af00bc204c5a0a0de2da311f94299d9c516b34b6018f9fb5"} May 29 13:51:18.820685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.820560 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" event={"ID":"317a8976-6179-4b5d-9afe-a05c46ec29ec","Type":"ContainerStarted","Data":"88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9"} May 29 13:51:18.822281 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.822235 2568 generic.go:358] "Generic (PLEG): container finished" podID="31787bee-77a8-4011-8661-237af2521d17" containerID="7efc271680855da9d328ae990558d92e02b88d0228e06028aa3388ab5c891695" exitCode=0 May 29 13:51:18.822281 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.822271 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" event={"ID":"31787bee-77a8-4011-8661-237af2521d17","Type":"ContainerDied","Data":"7efc271680855da9d328ae990558d92e02b88d0228e06028aa3388ab5c891695"} May 29 13:51:18.822435 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.822293 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" event={"ID":"31787bee-77a8-4011-8661-237af2521d17","Type":"ContainerStarted","Data":"f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd"} May 29 13:51:18.857446 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:18.857418 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9"] May 29 13:51:18.862465 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:18.862436 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178aaf60_1415_49ec_8458_f33d7949de8e.slice/crio-5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34 WatchSource:0}: Error finding container 5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34: Status 404 returned error can't find the container with id 5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34 May 29 13:51:19.827120 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.827058 2568 generic.go:358] "Generic (PLEG): container finished" podID="178aaf60-1415-49ec-8458-f33d7949de8e" containerID="7c9ed47dc10a55cf86bbb1563777948e046a285bc63a21477367083e153065ba" exitCode=0 May 29 13:51:19.827482 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.827150 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" event={"ID":"178aaf60-1415-49ec-8458-f33d7949de8e","Type":"ContainerDied","Data":"7c9ed47dc10a55cf86bbb1563777948e046a285bc63a21477367083e153065ba"} May 29 13:51:19.827482 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.827191 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" event={"ID":"178aaf60-1415-49ec-8458-f33d7949de8e","Type":"ContainerStarted","Data":"5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34"} May 29 13:51:19.829258 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.829240 2568 generic.go:358] "Generic (PLEG): container finished" podID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerID="41e9859e94ebd1b8ff7abf6506d6ddbe647250ee36b8e0b953b31152b796c6a5" exitCode=0 May 29 13:51:19.829345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.829319 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" event={"ID":"e14786a5-bb57-4d7c-80c3-5b9e635e92d1","Type":"ContainerDied","Data":"41e9859e94ebd1b8ff7abf6506d6ddbe647250ee36b8e0b953b31152b796c6a5"} May 29 13:51:19.830946 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.830927 2568 generic.go:358] "Generic (PLEG): container finished" podID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerID="3c65ef2c729775f4f995e3160b67b7b16aa06c6306fb6e50508d3300b961dd81" exitCode=0 May 29 13:51:19.831045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.830996 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" event={"ID":"317a8976-6179-4b5d-9afe-a05c46ec29ec","Type":"ContainerDied","Data":"3c65ef2c729775f4f995e3160b67b7b16aa06c6306fb6e50508d3300b961dd81"} May 29 13:51:19.832697 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.832677 2568 generic.go:358] "Generic (PLEG): container finished" podID="31787bee-77a8-4011-8661-237af2521d17" containerID="586600cffd681258e9526b5e6e18320871b56d0861bd447c69f876353ffcfdb1" exitCode=0 May 29 13:51:19.832764 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:19.832709 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" event={"ID":"31787bee-77a8-4011-8661-237af2521d17","Type":"ContainerDied","Data":"586600cffd681258e9526b5e6e18320871b56d0861bd447c69f876353ffcfdb1"} May 29 13:51:20.837867 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.837835 2568 generic.go:358] "Generic (PLEG): container finished" podID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerID="7450cd9da73ded8e6c87a8335596e70a5e34522328c440ded589abee3c2198da" exitCode=0 May 29 13:51:20.838279 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.837918 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" event={"ID":"317a8976-6179-4b5d-9afe-a05c46ec29ec","Type":"ContainerDied","Data":"7450cd9da73ded8e6c87a8335596e70a5e34522328c440ded589abee3c2198da"} May 29 13:51:20.839845 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.839818 2568 generic.go:358] "Generic (PLEG): container finished" podID="31787bee-77a8-4011-8661-237af2521d17" containerID="d2f50e2a761259eff8afc4b06f8471bdb8122a279579e1888fa464cc6cf1351f" exitCode=0 May 29 13:51:20.839963 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.839898 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" event={"ID":"31787bee-77a8-4011-8661-237af2521d17","Type":"ContainerDied","Data":"d2f50e2a761259eff8afc4b06f8471bdb8122a279579e1888fa464cc6cf1351f"} May 29 13:51:20.841462 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.841443 2568 generic.go:358] "Generic (PLEG): container finished" podID="178aaf60-1415-49ec-8458-f33d7949de8e" containerID="7028bf9794b4f9bf95ab69298de23cd8e97421844b8934519b6a0a06805aa97c" exitCode=0 May 29 13:51:20.841551 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.841529 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" event={"ID":"178aaf60-1415-49ec-8458-f33d7949de8e","Type":"ContainerDied","Data":"7028bf9794b4f9bf95ab69298de23cd8e97421844b8934519b6a0a06805aa97c"} May 29 13:51:20.969719 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:20.969698 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:21.113698 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.113672 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle\") pod \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " May 29 13:51:21.113821 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.113748 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks8rz\" (UniqueName: \"kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz\") pod \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " May 29 13:51:21.113821 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.113802 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util\") pod \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\" (UID: \"e14786a5-bb57-4d7c-80c3-5b9e635e92d1\") " May 29 13:51:21.114193 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.114161 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle" (OuterVolumeSpecName: "bundle") pod "e14786a5-bb57-4d7c-80c3-5b9e635e92d1" (UID: "e14786a5-bb57-4d7c-80c3-5b9e635e92d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:21.115988 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.115962 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz" (OuterVolumeSpecName: "kube-api-access-ks8rz") pod "e14786a5-bb57-4d7c-80c3-5b9e635e92d1" (UID: "e14786a5-bb57-4d7c-80c3-5b9e635e92d1"). InnerVolumeSpecName "kube-api-access-ks8rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:51:21.119694 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.119671 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util" (OuterVolumeSpecName: "util") pod "e14786a5-bb57-4d7c-80c3-5b9e635e92d1" (UID: "e14786a5-bb57-4d7c-80c3-5b9e635e92d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:21.215245 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.215175 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks8rz\" (UniqueName: \"kubernetes.io/projected/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-kube-api-access-ks8rz\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:21.215245 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.215200 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:21.215245 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.215210 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14786a5-bb57-4d7c-80c3-5b9e635e92d1-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:21.846969 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.846929 2568 generic.go:358] "Generic (PLEG): container finished" podID="178aaf60-1415-49ec-8458-f33d7949de8e" containerID="2c56c5ffae4b19fe95cff78255873b6a1ef6eead6e35626f23d1f8412c0f4a71" exitCode=0 May 29 13:51:21.847406 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.847013 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" event={"ID":"178aaf60-1415-49ec-8458-f33d7949de8e","Type":"ContainerDied","Data":"2c56c5ffae4b19fe95cff78255873b6a1ef6eead6e35626f23d1f8412c0f4a71"} May 29 13:51:21.848653 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.848635 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" May 29 13:51:21.848772 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.848660 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj" event={"ID":"e14786a5-bb57-4d7c-80c3-5b9e635e92d1","Type":"ContainerDied","Data":"99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f"} May 29 13:51:21.848772 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:21.848686 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99de5342b24a2de87632834fa3f4f54e779a3c23d2c0b84b4d852edf1f318a6f" May 29 13:51:22.011296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.011270 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:22.031490 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.031471 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:22.122105 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122036 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle\") pod \"317a8976-6179-4b5d-9afe-a05c46ec29ec\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " May 29 13:51:22.122105 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122104 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xm4b\" (UniqueName: \"kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b\") pod \"31787bee-77a8-4011-8661-237af2521d17\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " May 29 13:51:22.122285 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122133 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle\") pod \"31787bee-77a8-4011-8661-237af2521d17\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " May 29 13:51:22.122285 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122166 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util\") pod \"31787bee-77a8-4011-8661-237af2521d17\" (UID: \"31787bee-77a8-4011-8661-237af2521d17\") " May 29 13:51:22.122285 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122186 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h42nf\" (UniqueName: \"kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf\") pod \"317a8976-6179-4b5d-9afe-a05c46ec29ec\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " May 29 13:51:22.122285 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122210 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util\") pod \"317a8976-6179-4b5d-9afe-a05c46ec29ec\" (UID: \"317a8976-6179-4b5d-9afe-a05c46ec29ec\") " May 29 13:51:22.123113 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122704 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle" (OuterVolumeSpecName: "bundle") pod "31787bee-77a8-4011-8661-237af2521d17" (UID: "31787bee-77a8-4011-8661-237af2521d17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:22.123113 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.122840 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle" (OuterVolumeSpecName: "bundle") pod "317a8976-6179-4b5d-9afe-a05c46ec29ec" (UID: "317a8976-6179-4b5d-9afe-a05c46ec29ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:22.124878 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.124852 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b" (OuterVolumeSpecName: "kube-api-access-6xm4b") pod "31787bee-77a8-4011-8661-237af2521d17" (UID: "31787bee-77a8-4011-8661-237af2521d17"). InnerVolumeSpecName "kube-api-access-6xm4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:51:22.124980 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.124884 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf" (OuterVolumeSpecName: "kube-api-access-h42nf") pod "317a8976-6179-4b5d-9afe-a05c46ec29ec" (UID: "317a8976-6179-4b5d-9afe-a05c46ec29ec"). InnerVolumeSpecName "kube-api-access-h42nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:51:22.127968 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.127933 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util" (OuterVolumeSpecName: "util") pod "317a8976-6179-4b5d-9afe-a05c46ec29ec" (UID: "317a8976-6179-4b5d-9afe-a05c46ec29ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:22.130292 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.130265 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util" (OuterVolumeSpecName: "util") pod "31787bee-77a8-4011-8661-237af2521d17" (UID: "31787bee-77a8-4011-8661-237af2521d17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:22.223001 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.222974 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.223001 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.223000 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xm4b\" (UniqueName: \"kubernetes.io/projected/31787bee-77a8-4011-8661-237af2521d17-kube-api-access-6xm4b\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.223001 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.223015 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.223199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.223027 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31787bee-77a8-4011-8661-237af2521d17-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.223199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.223039 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h42nf\" (UniqueName: \"kubernetes.io/projected/317a8976-6179-4b5d-9afe-a05c46ec29ec-kube-api-access-h42nf\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.223199 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.223050 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/317a8976-6179-4b5d-9afe-a05c46ec29ec-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:22.853680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.853640 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" event={"ID":"317a8976-6179-4b5d-9afe-a05c46ec29ec","Type":"ContainerDied","Data":"88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9"} May 29 13:51:22.853680 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.853670 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874" May 29 13:51:22.854232 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.853677 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b176427a2debf54344dad49efc697f83b8fc8b0b64f55a358a995614f0e7a9" May 29 13:51:22.855423 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.855400 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" May 29 13:51:22.855423 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.855406 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4" event={"ID":"31787bee-77a8-4011-8661-237af2521d17","Type":"ContainerDied","Data":"f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd"} May 29 13:51:22.855584 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.855435 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f641f54b15ae7fe0b8cb3c32f5b754ec178cdf534879d8a758b8c0bed1271fbd" May 29 13:51:22.983999 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:22.983980 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:23.131071 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.130991 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util\") pod \"178aaf60-1415-49ec-8458-f33d7949de8e\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " May 29 13:51:23.131071 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.131036 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpsbd\" (UniqueName: \"kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd\") pod \"178aaf60-1415-49ec-8458-f33d7949de8e\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " May 29 13:51:23.131071 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.131058 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle\") pod \"178aaf60-1415-49ec-8458-f33d7949de8e\" (UID: \"178aaf60-1415-49ec-8458-f33d7949de8e\") " May 29 13:51:23.131590 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.131564 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle" (OuterVolumeSpecName: "bundle") pod "178aaf60-1415-49ec-8458-f33d7949de8e" (UID: "178aaf60-1415-49ec-8458-f33d7949de8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:23.133204 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.133179 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd" (OuterVolumeSpecName: "kube-api-access-kpsbd") pod "178aaf60-1415-49ec-8458-f33d7949de8e" (UID: "178aaf60-1415-49ec-8458-f33d7949de8e"). InnerVolumeSpecName "kube-api-access-kpsbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:51:23.136648 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.136624 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util" (OuterVolumeSpecName: "util") pod "178aaf60-1415-49ec-8458-f33d7949de8e" (UID: "178aaf60-1415-49ec-8458-f33d7949de8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:51:23.232563 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.232536 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:23.232563 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.232561 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpsbd\" (UniqueName: \"kubernetes.io/projected/178aaf60-1415-49ec-8458-f33d7949de8e-kube-api-access-kpsbd\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:23.232740 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.232572 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/178aaf60-1415-49ec-8458-f33d7949de8e-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:51:23.861444 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.861409 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" event={"ID":"178aaf60-1415-49ec-8458-f33d7949de8e","Type":"ContainerDied","Data":"5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34"} May 29 13:51:23.861444 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.861448 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5410899364ff1960847f86f6733a62a764be4f60e1d11060af97859bf23c3e34" May 29 13:51:23.861858 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:23.861425 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9" May 29 13:51:39.377349 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377310 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84fd87ccd9-4l8qr"] May 29 13:51:39.377874 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377851 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="util" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377874 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="util" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377893 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="util" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377901 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="util" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377911 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="pull" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377920 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="pull" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377933 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="extract" May 29 13:51:39.377938 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377941 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377954 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377962 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377973 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377981 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377991 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.377998 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378011 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="util" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378019 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="util" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378028 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378037 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="pull" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378049 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378056 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378078 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="util" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378086 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="util" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378097 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378102 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378168 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="31787bee-77a8-4011-8661-237af2521d17" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378175 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="178aaf60-1415-49ec-8458-f33d7949de8e" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378181 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="317a8976-6179-4b5d-9afe-a05c46ec29ec" containerName="extract" May 29 13:51:39.378284 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.378189 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="e14786a5-bb57-4d7c-80c3-5b9e635e92d1" containerName="extract" May 29 13:51:39.380287 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.380267 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.394983 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.394955 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fd87ccd9-4l8qr"] May 29 13:51:39.475088 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475088 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-service-ca\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvznr\" (UniqueName: \"kubernetes.io/projected/855fd44d-dff5-479c-a53e-070fde14dcb8-kube-api-access-qvznr\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-oauth-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475296 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-oauth-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475448 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-trusted-ca-bundle\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.475507 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.475445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-console-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576746 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576718 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-console-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576912 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576763 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576912 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576788 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-service-ca\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576912 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576823 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvznr\" (UniqueName: \"kubernetes.io/projected/855fd44d-dff5-479c-a53e-070fde14dcb8-kube-api-access-qvznr\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576912 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576854 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-oauth-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.576912 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.576876 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-oauth-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.577188 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.577011 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-trusted-ca-bundle\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.577575 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.577548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-oauth-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.577704 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.577671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-service-ca\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.577704 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.577684 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-console-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.577850 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.577833 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/855fd44d-dff5-479c-a53e-070fde14dcb8-trusted-ca-bundle\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.579388 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.579346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-serving-cert\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.579483 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.579463 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/855fd44d-dff5-479c-a53e-070fde14dcb8-console-oauth-config\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.586717 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.586699 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvznr\" (UniqueName: \"kubernetes.io/projected/855fd44d-dff5-479c-a53e-070fde14dcb8-kube-api-access-qvznr\") pod \"console-84fd87ccd9-4l8qr\" (UID: \"855fd44d-dff5-479c-a53e-070fde14dcb8\") " pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.693775 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.693691 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:39.839019 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.838990 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fd87ccd9-4l8qr"] May 29 13:51:39.840236 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:39.840206 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855fd44d_dff5_479c_a53e_070fde14dcb8.slice/crio-8a6ad8a06e59ea4701367da5626d99cf4105e313fff591dbfb44c83a72358888 WatchSource:0}: Error finding container 8a6ad8a06e59ea4701367da5626d99cf4105e313fff591dbfb44c83a72358888: Status 404 returned error can't find the container with id 8a6ad8a06e59ea4701367da5626d99cf4105e313fff591dbfb44c83a72358888 May 29 13:51:39.928252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.928222 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fd87ccd9-4l8qr" event={"ID":"855fd44d-dff5-479c-a53e-070fde14dcb8","Type":"ContainerStarted","Data":"7e405715f665df256a2500d7efc1518f4acd64eb91c7cc6fef0c4bac63974eff"} May 29 13:51:39.928252 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.928258 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fd87ccd9-4l8qr" event={"ID":"855fd44d-dff5-479c-a53e-070fde14dcb8","Type":"ContainerStarted","Data":"8a6ad8a06e59ea4701367da5626d99cf4105e313fff591dbfb44c83a72358888"} May 29 13:51:39.952345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:39.952109 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84fd87ccd9-4l8qr" podStartSLOduration=0.952090205 podStartE2EDuration="952.090205ms" podCreationTimestamp="2026-05-29 13:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:51:39.951748033 +0000 UTC m=+564.485654062" watchObservedRunningTime="2026-05-29 13:51:39.952090205 +0000 UTC m=+564.485996233" May 29 13:51:43.431886 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.431841 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cwfdh"] May 29 13:51:43.434304 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.434288 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:43.437410 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.437387 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 13:51:43.437516 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.437482 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 13:51:43.437584 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.437533 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2xgsm\"" May 29 13:51:43.445341 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.445319 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cwfdh"] May 29 13:51:43.611771 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.611741 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9w25\" (UniqueName: \"kubernetes.io/projected/f7cff6bf-eff7-432c-85db-384939dd1758-kube-api-access-c9w25\") pod \"authorino-operator-657f44b778-cwfdh\" (UID: \"f7cff6bf-eff7-432c-85db-384939dd1758\") " pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:43.713197 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.713106 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9w25\" (UniqueName: \"kubernetes.io/projected/f7cff6bf-eff7-432c-85db-384939dd1758-kube-api-access-c9w25\") pod \"authorino-operator-657f44b778-cwfdh\" (UID: \"f7cff6bf-eff7-432c-85db-384939dd1758\") " pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:43.727130 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.727100 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9w25\" (UniqueName: \"kubernetes.io/projected/f7cff6bf-eff7-432c-85db-384939dd1758-kube-api-access-c9w25\") pod \"authorino-operator-657f44b778-cwfdh\" (UID: \"f7cff6bf-eff7-432c-85db-384939dd1758\") " pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:43.746450 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.746420 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:43.884034 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.884005 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cwfdh"] May 29 13:51:43.885274 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:51:43.885244 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cff6bf_eff7_432c_85db_384939dd1758.slice/crio-da71b16b8e0f6956215b8eb5f28a0d930ab2bba1de89e56f7334e4d1e4065740 WatchSource:0}: Error finding container da71b16b8e0f6956215b8eb5f28a0d930ab2bba1de89e56f7334e4d1e4065740: Status 404 returned error can't find the container with id da71b16b8e0f6956215b8eb5f28a0d930ab2bba1de89e56f7334e4d1e4065740 May 29 13:51:43.944571 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:43.944546 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" event={"ID":"f7cff6bf-eff7-432c-85db-384939dd1758","Type":"ContainerStarted","Data":"da71b16b8e0f6956215b8eb5f28a0d930ab2bba1de89e56f7334e4d1e4065740"} May 29 13:51:46.959439 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:46.959402 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" event={"ID":"f7cff6bf-eff7-432c-85db-384939dd1758","Type":"ContainerStarted","Data":"4f939e6aef6775fd9d14ce62992fe13556da509a5c70e6b47295971b2b88c36a"} May 29 13:51:46.959830 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:46.959524 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:51:46.984945 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:46.984899 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" podStartSLOduration=1.8613948790000001 podStartE2EDuration="3.984881818s" podCreationTimestamp="2026-05-29 13:51:43 +0000 UTC" firstStartedPulling="2026-05-29 13:51:43.887387192 +0000 UTC m=+568.421293197" lastFinishedPulling="2026-05-29 13:51:46.010874131 +0000 UTC m=+570.544780136" observedRunningTime="2026-05-29 13:51:46.98368373 +0000 UTC m=+571.517589758" watchObservedRunningTime="2026-05-29 13:51:46.984881818 +0000 UTC m=+571.518787844" May 29 13:51:49.694141 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:49.694110 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:49.694554 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:49.694152 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:49.699045 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:49.699022 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:49.974357 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:49.974280 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84fd87ccd9-4l8qr" May 29 13:51:50.037568 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:50.037532 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:51:57.965632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:51:57.965602 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-cwfdh" May 29 13:52:15.059870 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.059802 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d45c64cc8-4rws4" podUID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" containerName="console" containerID="cri-o://879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08" gracePeriod=15 May 29 13:52:15.304982 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.304960 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d45c64cc8-4rws4_2ff5447b-26db-4b8b-96b6-6cfe94a92696/console/0.log" May 29 13:52:15.305095 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.305018 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:52:15.376035 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376009 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg444\" (UniqueName: \"kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376201 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376075 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376201 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376124 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376201 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376165 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376393 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376218 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376393 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376257 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376393 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376291 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle\") pod \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\" (UID: \"2ff5447b-26db-4b8b-96b6-6cfe94a92696\") " May 29 13:52:15.376979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376574 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:52:15.376979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376665 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config" (OuterVolumeSpecName: "console-config") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:52:15.376979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376685 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:52:15.376979 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.376937 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:52:15.378262 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.378234 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444" (OuterVolumeSpecName: "kube-api-access-cg444") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "kube-api-access-cg444". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:52:15.378409 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.378324 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:52:15.378409 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.378344 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ff5447b-26db-4b8b-96b6-6cfe94a92696" (UID: "2ff5447b-26db-4b8b-96b6-6cfe94a92696"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 13:52:15.477675 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477648 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-trusted-ca-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477678 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg444\" (UniqueName: \"kubernetes.io/projected/2ff5447b-26db-4b8b-96b6-6cfe94a92696-kube-api-access-cg444\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477695 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-oauth-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477708 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-oauth-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477718 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-config\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477728 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff5447b-26db-4b8b-96b6-6cfe94a92696-service-ca\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.477802 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.477736 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5447b-26db-4b8b-96b6-6cfe94a92696-console-serving-cert\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:15.971512 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.971484 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d45c64cc8-4rws4_2ff5447b-26db-4b8b-96b6-6cfe94a92696/console/0.log" May 29 13:52:15.971661 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.971644 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d45c64cc8-4rws4_2ff5447b-26db-4b8b-96b6-6cfe94a92696/console/0.log" May 29 13:52:15.977178 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.977157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:52:15.977297 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:15.977161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:52:16.078221 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.078193 2568 generic.go:358] "Generic (PLEG): container finished" podID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" containerID="879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08" exitCode=2 May 29 13:52:16.078594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.078247 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45c64cc8-4rws4" May 29 13:52:16.078594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.078281 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45c64cc8-4rws4" event={"ID":"2ff5447b-26db-4b8b-96b6-6cfe94a92696","Type":"ContainerDied","Data":"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08"} May 29 13:52:16.078594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.078319 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45c64cc8-4rws4" event={"ID":"2ff5447b-26db-4b8b-96b6-6cfe94a92696","Type":"ContainerDied","Data":"3ab5c0ee65a777ff1e4a744009a259ed5aa64518787522f8d3c1ec33e07dd050"} May 29 13:52:16.078594 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.078339 2568 scope.go:117] "RemoveContainer" containerID="879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08" May 29 13:52:16.089737 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.089718 2568 scope.go:117] "RemoveContainer" containerID="879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08" May 29 13:52:16.089978 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:52:16.089958 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08\": container with ID starting with 879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08 not found: ID does not exist" containerID="879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08" May 29 13:52:16.090042 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.089990 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08"} err="failed to get container status \"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08\": rpc error: code = NotFound desc = could not find container \"879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08\": container with ID starting with 879f8b28c5abac1c65b67ba59dcebe4f7ba4748eba0fb46babe2f0badc86bc08 not found: ID does not exist" May 29 13:52:16.116270 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.116245 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:52:16.122929 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:16.122907 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d45c64cc8-4rws4"] May 29 13:52:18.058200 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:18.058162 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" path="/var/lib/kubelet/pods/2ff5447b-26db-4b8b-96b6-6cfe94a92696/volumes" May 29 13:52:26.764345 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.764258 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:26.764726 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.764634 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" containerName="console" May 29 13:52:26.764726 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.764647 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" containerName="console" May 29 13:52:26.764726 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.764708 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ff5447b-26db-4b8b-96b6-6cfe94a92696" containerName="console" May 29 13:52:26.770830 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.770810 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.773997 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.773972 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 29 13:52:26.774106 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.774087 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxrd4\"" May 29 13:52:26.781522 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.781496 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:26.861313 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.861286 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:26.878981 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.878935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.879133 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.879087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntlzs\" (UniqueName: \"kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.979773 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.979730 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntlzs\" (UniqueName: \"kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.979949 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.979811 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.980521 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.980502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:26.991043 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:26.991011 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntlzs\" (UniqueName: \"kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs\") pod \"limitador-limitador-7d549b5b-jmj9z\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:27.081780 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:27.081752 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:27.219165 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:27.219128 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:27.220315 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:52:27.220287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423fbe15_6287_4c66_8267_f6f193b23714.slice/crio-640eeec36085fa5e3d1ad27ad567cfcdeca6e16b2a664a28b668a9d6db8ed808 WatchSource:0}: Error finding container 640eeec36085fa5e3d1ad27ad567cfcdeca6e16b2a664a28b668a9d6db8ed808: Status 404 returned error can't find the container with id 640eeec36085fa5e3d1ad27ad567cfcdeca6e16b2a664a28b668a9d6db8ed808 May 29 13:52:28.129497 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:28.129465 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" event={"ID":"423fbe15-6287-4c66-8267-f6f193b23714","Type":"ContainerStarted","Data":"640eeec36085fa5e3d1ad27ad567cfcdeca6e16b2a664a28b668a9d6db8ed808"} May 29 13:52:30.139439 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:30.139408 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" event={"ID":"423fbe15-6287-4c66-8267-f6f193b23714","Type":"ContainerStarted","Data":"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6"} May 29 13:52:30.139736 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:30.139601 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:30.158355 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:30.158205 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" podStartSLOduration=1.337121884 podStartE2EDuration="4.158192571s" podCreationTimestamp="2026-05-29 13:52:26 +0000 UTC" firstStartedPulling="2026-05-29 13:52:27.222161034 +0000 UTC m=+611.756067039" lastFinishedPulling="2026-05-29 13:52:30.043231721 +0000 UTC m=+614.577137726" observedRunningTime="2026-05-29 13:52:30.158189325 +0000 UTC m=+614.692095354" watchObservedRunningTime="2026-05-29 13:52:30.158192571 +0000 UTC m=+614.692098598" May 29 13:52:41.144454 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:41.144422 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:41.216401 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:41.216353 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:41.216578 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:41.216559 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" podUID="423fbe15-6287-4c66-8267-f6f193b23714" containerName="limitador" containerID="cri-o://93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6" gracePeriod=30 May 29 13:52:42.162829 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.162811 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:42.186392 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.186345 2568 generic.go:358] "Generic (PLEG): container finished" podID="423fbe15-6287-4c66-8267-f6f193b23714" containerID="93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6" exitCode=0 May 29 13:52:42.186515 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.186398 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" event={"ID":"423fbe15-6287-4c66-8267-f6f193b23714","Type":"ContainerDied","Data":"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6"} May 29 13:52:42.186515 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.186434 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" May 29 13:52:42.186515 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.186455 2568 scope.go:117] "RemoveContainer" containerID="93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6" May 29 13:52:42.186672 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.186441 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jmj9z" event={"ID":"423fbe15-6287-4c66-8267-f6f193b23714","Type":"ContainerDied","Data":"640eeec36085fa5e3d1ad27ad567cfcdeca6e16b2a664a28b668a9d6db8ed808"} May 29 13:52:42.196444 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.196416 2568 scope.go:117] "RemoveContainer" containerID="93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6" May 29 13:52:42.196699 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:52:42.196678 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6\": container with ID starting with 93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6 not found: ID does not exist" containerID="93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6" May 29 13:52:42.196762 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.196709 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6"} err="failed to get container status \"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6\": rpc error: code = NotFound desc = could not find container \"93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6\": container with ID starting with 93c12fa3a79435484a3a95028d20f50a7d38a097129f108bc8d9ef938d6fe7e6 not found: ID does not exist" May 29 13:52:42.203993 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.203969 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntlzs\" (UniqueName: \"kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs\") pod \"423fbe15-6287-4c66-8267-f6f193b23714\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " May 29 13:52:42.204086 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.204075 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file\") pod \"423fbe15-6287-4c66-8267-f6f193b23714\" (UID: \"423fbe15-6287-4c66-8267-f6f193b23714\") " May 29 13:52:42.204431 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.204410 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file" (OuterVolumeSpecName: "config-file") pod "423fbe15-6287-4c66-8267-f6f193b23714" (UID: "423fbe15-6287-4c66-8267-f6f193b23714"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 13:52:42.205888 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.205870 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs" (OuterVolumeSpecName: "kube-api-access-ntlzs") pod "423fbe15-6287-4c66-8267-f6f193b23714" (UID: "423fbe15-6287-4c66-8267-f6f193b23714"). InnerVolumeSpecName "kube-api-access-ntlzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:52:42.305460 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.305394 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/423fbe15-6287-4c66-8267-f6f193b23714-config-file\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:42.305460 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.305418 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntlzs\" (UniqueName: \"kubernetes.io/projected/423fbe15-6287-4c66-8267-f6f193b23714-kube-api-access-ntlzs\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:42.510122 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.510094 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:42.513957 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.513935 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jmj9z"] May 29 13:52:42.888530 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.888490 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsrx9"] May 29 13:52:42.888844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.888830 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423fbe15-6287-4c66-8267-f6f193b23714" containerName="limitador" May 29 13:52:42.888844 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.888844 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="423fbe15-6287-4c66-8267-f6f193b23714" containerName="limitador" May 29 13:52:42.888953 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.888903 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="423fbe15-6287-4c66-8267-f6f193b23714" containerName="limitador" May 29 13:52:42.893158 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.893133 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:42.896678 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.896658 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 29 13:52:42.905071 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.905040 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsrx9"] May 29 13:52:42.910485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.910463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv2c\" (UniqueName: \"kubernetes.io/projected/164de058-d2c6-4f3b-bfdf-1653d7d577b3-kube-api-access-2dv2c\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:42.910604 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:42.910519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/164de058-d2c6-4f3b-bfdf-1653d7d577b3-data\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.011748 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.011646 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv2c\" (UniqueName: \"kubernetes.io/projected/164de058-d2c6-4f3b-bfdf-1653d7d577b3-kube-api-access-2dv2c\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.011748 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.011688 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/164de058-d2c6-4f3b-bfdf-1653d7d577b3-data\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.029577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.012050 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/164de058-d2c6-4f3b-bfdf-1653d7d577b3-data\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.029577 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.021735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv2c\" (UniqueName: \"kubernetes.io/projected/164de058-d2c6-4f3b-bfdf-1653d7d577b3-kube-api-access-2dv2c\") pod \"postgres-68c4fbbd6f-wsrx9\" (UID: \"164de058-d2c6-4f3b-bfdf-1653d7d577b3\") " pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.207090 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.207011 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:43.342665 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:43.341321 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wsrx9"] May 29 13:52:43.344675 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:52:43.344648 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164de058_d2c6_4f3b_bfdf_1653d7d577b3.slice/crio-3b463aed29e735e6c4c9eadca662eeb356689ba6c4983d97046437cbdf1d263a WatchSource:0}: Error finding container 3b463aed29e735e6c4c9eadca662eeb356689ba6c4983d97046437cbdf1d263a: Status 404 returned error can't find the container with id 3b463aed29e735e6c4c9eadca662eeb356689ba6c4983d97046437cbdf1d263a May 29 13:52:44.057855 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:44.057825 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423fbe15-6287-4c66-8267-f6f193b23714" path="/var/lib/kubelet/pods/423fbe15-6287-4c66-8267-f6f193b23714/volumes" May 29 13:52:44.197569 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:44.197531 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" event={"ID":"164de058-d2c6-4f3b-bfdf-1653d7d577b3","Type":"ContainerStarted","Data":"3b463aed29e735e6c4c9eadca662eeb356689ba6c4983d97046437cbdf1d263a"} May 29 13:52:46.206282 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:46.206247 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" event={"ID":"164de058-d2c6-4f3b-bfdf-1653d7d577b3","Type":"ContainerStarted","Data":"5efc63f9720bcd9f770b0943a6dd8fa14bf8540ef17ddf5036f865cf92f908bd"} May 29 13:52:46.206706 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:46.206331 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:46.225449 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:46.225403 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" podStartSLOduration=1.81463062 podStartE2EDuration="4.225389931s" podCreationTimestamp="2026-05-29 13:52:42 +0000 UTC" firstStartedPulling="2026-05-29 13:52:43.346473826 +0000 UTC m=+627.880379831" lastFinishedPulling="2026-05-29 13:52:45.757233137 +0000 UTC m=+630.291139142" observedRunningTime="2026-05-29 13:52:46.223486557 +0000 UTC m=+630.757392669" watchObservedRunningTime="2026-05-29 13:52:46.225389931 +0000 UTC m=+630.759295955" May 29 13:52:52.238930 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:52.238899 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-wsrx9" May 29 13:52:54.431747 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.431710 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn"] May 29 13:52:54.438489 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.438466 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.441892 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.441870 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5rmt\"" May 29 13:52:54.441999 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.441865 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 13:52:54.443133 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.443118 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 13:52:54.453447 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.453426 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn"] May 29 13:52:54.504218 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.504189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.504465 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.504446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8sv\" (UniqueName: \"kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.504523 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.504496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.605072 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.605051 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8sv\" (UniqueName: \"kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.605174 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.605091 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.605174 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.605113 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.605434 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.605417 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.605485 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.605471 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.615654 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.615635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8sv\" (UniqueName: \"kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.748313 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.748258 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:54.891458 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:52:54.891424 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961db18a_67d6_495f_b16b_db8159d763e8.slice/crio-a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61 WatchSource:0}: Error finding container a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61: Status 404 returned error can't find the container with id a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61 May 29 13:52:54.891807 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.891780 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn"] May 29 13:52:54.892874 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:54.892859 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 13:52:55.243886 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:55.243855 2568 generic.go:358] "Generic (PLEG): container finished" podID="961db18a-67d6-495f-b16b-db8159d763e8" containerID="638df69d01599e3fd1d844b63173a5115dd36a845f2fb74c37f5ed43d8c173f1" exitCode=0 May 29 13:52:55.244067 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:55.243942 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" event={"ID":"961db18a-67d6-495f-b16b-db8159d763e8","Type":"ContainerDied","Data":"638df69d01599e3fd1d844b63173a5115dd36a845f2fb74c37f5ed43d8c173f1"} May 29 13:52:55.244067 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:55.243982 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" event={"ID":"961db18a-67d6-495f-b16b-db8159d763e8","Type":"ContainerStarted","Data":"a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61"} May 29 13:52:56.248977 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:56.248945 2568 generic.go:358] "Generic (PLEG): container finished" podID="961db18a-67d6-495f-b16b-db8159d763e8" containerID="5de5c4d4d465004932e6c889685f5bf691f3cb4bd94669144228a39710f850b8" exitCode=0 May 29 13:52:56.249456 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:56.249027 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" event={"ID":"961db18a-67d6-495f-b16b-db8159d763e8","Type":"ContainerDied","Data":"5de5c4d4d465004932e6c889685f5bf691f3cb4bd94669144228a39710f850b8"} May 29 13:52:56.414771 ip-10-0-129-53 kubenswrapper[2568]: E0529 13:52:56.414743 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961db18a_67d6_495f_b16b_db8159d763e8.slice/crio-eda68d6a8845abee717efb08efa662a748ed8e434f84dc0a1617d4d9bc1795d1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961db18a_67d6_495f_b16b_db8159d763e8.slice/crio-conmon-eda68d6a8845abee717efb08efa662a748ed8e434f84dc0a1617d4d9bc1795d1.scope\": RecentStats: unable to find data in memory cache]" May 29 13:52:57.254038 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:57.254007 2568 generic.go:358] "Generic (PLEG): container finished" podID="961db18a-67d6-495f-b16b-db8159d763e8" containerID="eda68d6a8845abee717efb08efa662a748ed8e434f84dc0a1617d4d9bc1795d1" exitCode=0 May 29 13:52:57.254402 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:57.254099 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" event={"ID":"961db18a-67d6-495f-b16b-db8159d763e8","Type":"ContainerDied","Data":"eda68d6a8845abee717efb08efa662a748ed8e434f84dc0a1617d4d9bc1795d1"} May 29 13:52:58.382854 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.382833 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:58.436110 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.436080 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util\") pod \"961db18a-67d6-495f-b16b-db8159d763e8\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " May 29 13:52:58.436244 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.436171 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt8sv\" (UniqueName: \"kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv\") pod \"961db18a-67d6-495f-b16b-db8159d763e8\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " May 29 13:52:58.436244 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.436201 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle\") pod \"961db18a-67d6-495f-b16b-db8159d763e8\" (UID: \"961db18a-67d6-495f-b16b-db8159d763e8\") " May 29 13:52:58.436785 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.436757 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle" (OuterVolumeSpecName: "bundle") pod "961db18a-67d6-495f-b16b-db8159d763e8" (UID: "961db18a-67d6-495f-b16b-db8159d763e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:52:58.438215 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.438188 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv" (OuterVolumeSpecName: "kube-api-access-xt8sv") pod "961db18a-67d6-495f-b16b-db8159d763e8" (UID: "961db18a-67d6-495f-b16b-db8159d763e8"). InnerVolumeSpecName "kube-api-access-xt8sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 13:52:58.441740 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.441715 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util" (OuterVolumeSpecName: "util") pod "961db18a-67d6-495f-b16b-db8159d763e8" (UID: "961db18a-67d6-495f-b16b-db8159d763e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 13:52:58.537708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.537651 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-util\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:58.537708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.537675 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt8sv\" (UniqueName: \"kubernetes.io/projected/961db18a-67d6-495f-b16b-db8159d763e8-kube-api-access-xt8sv\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:58.537708 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:58.537685 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/961db18a-67d6-495f-b16b-db8159d763e8-bundle\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 13:52:59.262588 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:59.262557 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" May 29 13:52:59.262588 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:59.262572 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70j64kn" event={"ID":"961db18a-67d6-495f-b16b-db8159d763e8","Type":"ContainerDied","Data":"a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61"} May 29 13:52:59.262787 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:52:59.262599 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a753714d85aed81771372671a486d2c72289d2d2e77f779f721f073d14157c61" May 29 13:53:02.264262 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264230 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5n2pl"] May 29 13:53:02.264632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264584 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="extract" May 29 13:53:02.264632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264595 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="extract" May 29 13:53:02.264632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264617 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="util" May 29 13:53:02.264632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264623 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="util" May 29 13:53:02.264632 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264633 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="pull" May 29 13:53:02.264790 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264638 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="pull" May 29 13:53:02.264790 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.264704 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="961db18a-67d6-495f-b16b-db8159d763e8" containerName="extract" May 29 13:53:02.268806 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.268790 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" May 29 13:53:02.272155 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.272127 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 13:53:02.273472 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.273450 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 13:53:02.273604 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.273450 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-xn72z\"" May 29 13:53:02.279227 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.279203 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5n2pl"] May 29 13:53:02.369706 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.369677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5c94\" (UniqueName: \"kubernetes.io/projected/59ce35d4-adbf-474c-b797-88e47a7d893f-kube-api-access-j5c94\") pod \"keycloak-operator-7864d68cbd-5n2pl\" (UID: \"59ce35d4-adbf-474c-b797-88e47a7d893f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" May 29 13:53:02.470329 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.470299 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5c94\" (UniqueName: \"kubernetes.io/projected/59ce35d4-adbf-474c-b797-88e47a7d893f-kube-api-access-j5c94\") pod \"keycloak-operator-7864d68cbd-5n2pl\" (UID: \"59ce35d4-adbf-474c-b797-88e47a7d893f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" May 29 13:53:02.479962 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.479935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5c94\" (UniqueName: \"kubernetes.io/projected/59ce35d4-adbf-474c-b797-88e47a7d893f-kube-api-access-j5c94\") pod \"keycloak-operator-7864d68cbd-5n2pl\" (UID: \"59ce35d4-adbf-474c-b797-88e47a7d893f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" May 29 13:53:02.580890 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.580863 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" May 29 13:53:02.734622 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:02.734592 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5n2pl"] May 29 13:53:02.736604 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:53:02.736576 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ce35d4_adbf_474c_b797_88e47a7d893f.slice/crio-68aaf987e771a5a056f82af834ddda24de461adaa5ac52dbccf268e764050a9c WatchSource:0}: Error finding container 68aaf987e771a5a056f82af834ddda24de461adaa5ac52dbccf268e764050a9c: Status 404 returned error can't find the container with id 68aaf987e771a5a056f82af834ddda24de461adaa5ac52dbccf268e764050a9c May 29 13:53:03.283958 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:03.283920 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" event={"ID":"59ce35d4-adbf-474c-b797-88e47a7d893f","Type":"ContainerStarted","Data":"68aaf987e771a5a056f82af834ddda24de461adaa5ac52dbccf268e764050a9c"} May 29 13:53:09.314176 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:09.314141 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" event={"ID":"59ce35d4-adbf-474c-b797-88e47a7d893f","Type":"ContainerStarted","Data":"829c72c1c25d42601b6515392fdd479578e71bf9ed54406d0a14d3f350e93a5a"} May 29 13:53:09.334535 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:53:09.334485 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-5n2pl" podStartSLOduration=1.557800137 podStartE2EDuration="7.334469958s" podCreationTimestamp="2026-05-29 13:53:02 +0000 UTC" firstStartedPulling="2026-05-29 13:53:02.738497249 +0000 UTC m=+647.272403254" lastFinishedPulling="2026-05-29 13:53:08.51516707 +0000 UTC m=+653.049073075" observedRunningTime="2026-05-29 13:53:09.331626122 +0000 UTC m=+653.865532149" watchObservedRunningTime="2026-05-29 13:53:09.334469958 +0000 UTC m=+653.868375985" May 29 13:54:25.432299 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.432262 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2rwd7"] May 29 13:54:25.434657 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.434640 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:25.437723 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.437703 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 29 13:54:25.437825 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.437732 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wjv4c\"" May 29 13:54:25.445875 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.445853 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2rwd7"] May 29 13:54:25.463500 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.463480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6lw9\" (UniqueName: \"kubernetes.io/projected/d32b9cc4-8166-46d8-b2cb-cba17744e45d-kube-api-access-h6lw9\") pod \"payload-processing-58b6c8fdc7-2rwd7\" (UID: \"d32b9cc4-8166-46d8-b2cb-cba17744e45d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:25.564052 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.564017 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6lw9\" (UniqueName: \"kubernetes.io/projected/d32b9cc4-8166-46d8-b2cb-cba17744e45d-kube-api-access-h6lw9\") pod \"payload-processing-58b6c8fdc7-2rwd7\" (UID: \"d32b9cc4-8166-46d8-b2cb-cba17744e45d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:25.575685 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.575652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6lw9\" (UniqueName: \"kubernetes.io/projected/d32b9cc4-8166-46d8-b2cb-cba17744e45d-kube-api-access-h6lw9\") pod \"payload-processing-58b6c8fdc7-2rwd7\" (UID: \"d32b9cc4-8166-46d8-b2cb-cba17744e45d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:25.746155 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.746069 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:25.877089 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:25.877063 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2rwd7"] May 29 13:54:25.878600 ip-10-0-129-53 kubenswrapper[2568]: W0529 13:54:25.878571 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32b9cc4_8166_46d8_b2cb_cba17744e45d.slice/crio-871a8687920ba3c18d06232990f2fd1c3a2ba5fb76d6439eab8d5be6307c0022 WatchSource:0}: Error finding container 871a8687920ba3c18d06232990f2fd1c3a2ba5fb76d6439eab8d5be6307c0022: Status 404 returned error can't find the container with id 871a8687920ba3c18d06232990f2fd1c3a2ba5fb76d6439eab8d5be6307c0022 May 29 13:54:26.620656 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:26.620617 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" event={"ID":"d32b9cc4-8166-46d8-b2cb-cba17744e45d","Type":"ContainerStarted","Data":"871a8687920ba3c18d06232990f2fd1c3a2ba5fb76d6439eab8d5be6307c0022"} May 29 13:54:28.631084 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:28.631045 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" event={"ID":"d32b9cc4-8166-46d8-b2cb-cba17744e45d","Type":"ContainerStarted","Data":"3c0603a0474e227bc9f092cd1789c9954e3239a29107f4fc41b3f4124fb0329d"} May 29 13:54:28.631545 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:28.631181 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:54:28.655436 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:28.655392 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" podStartSLOduration=1.393109388 podStartE2EDuration="3.655380822s" podCreationTimestamp="2026-05-29 13:54:25 +0000 UTC" firstStartedPulling="2026-05-29 13:54:25.880294665 +0000 UTC m=+730.414200670" lastFinishedPulling="2026-05-29 13:54:28.142566098 +0000 UTC m=+732.676472104" observedRunningTime="2026-05-29 13:54:28.652165625 +0000 UTC m=+733.186071655" watchObservedRunningTime="2026-05-29 13:54:28.655380822 +0000 UTC m=+733.189286849" May 29 13:54:39.637274 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:54:39.637247 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2rwd7" May 29 13:57:16.010069 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:57:16.010045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 13:57:16.012964 ip-10-0-129-53 kubenswrapper[2568]: I0529 13:57:16.012937 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 14:00:00.151854 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.151816 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29667720-n2sh2"] May 29 14:00:00.161129 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.161102 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:00.164755 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.164737 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n24vl\"" May 29 14:00:00.173594 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.173572 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29667720-n2sh2"] May 29 14:00:00.339426 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.339391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzk4z\" (UniqueName: \"kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z\") pod \"maas-api-key-cleanup-29667720-n2sh2\" (UID: \"1eff41bd-4319-437f-8f5f-d890f1254f5b\") " pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:00.439956 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.439883 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzk4z\" (UniqueName: \"kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z\") pod \"maas-api-key-cleanup-29667720-n2sh2\" (UID: \"1eff41bd-4319-437f-8f5f-d890f1254f5b\") " pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:00.458015 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.457992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzk4z\" (UniqueName: \"kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z\") pod \"maas-api-key-cleanup-29667720-n2sh2\" (UID: \"1eff41bd-4319-437f-8f5f-d890f1254f5b\") " pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:00.471663 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.471642 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:00.601060 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.601036 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29667720-n2sh2"] May 29 14:00:00.602354 ip-10-0-129-53 kubenswrapper[2568]: W0529 14:00:00.602322 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eff41bd_4319_437f_8f5f_d890f1254f5b.slice/crio-a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c WatchSource:0}: Error finding container a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c: Status 404 returned error can't find the container with id a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c May 29 14:00:00.604288 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.604269 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 14:00:00.953001 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:00.952965 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" event={"ID":"1eff41bd-4319-437f-8f5f-d890f1254f5b","Type":"ContainerStarted","Data":"a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c"} May 29 14:00:04.970771 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:04.970734 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" event={"ID":"1eff41bd-4319-437f-8f5f-d890f1254f5b","Type":"ContainerStarted","Data":"b28b7e9bf281e30390e7d5c3d1e154738f04e9a484f689880658d38396233aa3"} May 29 14:00:04.989991 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:04.989947 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" podStartSLOduration=0.918783813 podStartE2EDuration="4.989932955s" podCreationTimestamp="2026-05-29 14:00:00 +0000 UTC" firstStartedPulling="2026-05-29 14:00:00.604427884 +0000 UTC m=+1065.138333889" lastFinishedPulling="2026-05-29 14:00:04.675577009 +0000 UTC m=+1069.209483031" observedRunningTime="2026-05-29 14:00:04.989067325 +0000 UTC m=+1069.522973355" watchObservedRunningTime="2026-05-29 14:00:04.989932955 +0000 UTC m=+1069.523839015" May 29 14:00:05.979191 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:05.979148 2568 generic.go:358] "Generic (PLEG): container finished" podID="1eff41bd-4319-437f-8f5f-d890f1254f5b" containerID="b28b7e9bf281e30390e7d5c3d1e154738f04e9a484f689880658d38396233aa3" exitCode=0 May 29 14:00:05.979592 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:05.979228 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" event={"ID":"1eff41bd-4319-437f-8f5f-d890f1254f5b","Type":"ContainerDied","Data":"b28b7e9bf281e30390e7d5c3d1e154738f04e9a484f689880658d38396233aa3"} May 29 14:00:07.112090 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.112067 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:00:07.297482 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.297408 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzk4z\" (UniqueName: \"kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z\") pod \"1eff41bd-4319-437f-8f5f-d890f1254f5b\" (UID: \"1eff41bd-4319-437f-8f5f-d890f1254f5b\") " May 29 14:00:07.299386 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.299340 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z" (OuterVolumeSpecName: "kube-api-access-wzk4z") pod "1eff41bd-4319-437f-8f5f-d890f1254f5b" (UID: "1eff41bd-4319-437f-8f5f-d890f1254f5b"). InnerVolumeSpecName "kube-api-access-wzk4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:00:07.398225 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.398195 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzk4z\" (UniqueName: \"kubernetes.io/projected/1eff41bd-4319-437f-8f5f-d890f1254f5b-kube-api-access-wzk4z\") on node \"ip-10-0-129-53.ec2.internal\" DevicePath \"\"" May 29 14:00:07.987803 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.987767 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" event={"ID":"1eff41bd-4319-437f-8f5f-d890f1254f5b","Type":"ContainerDied","Data":"a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c"} May 29 14:00:07.987803 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.987801 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1d13844b9c07d1361da723e1cd6985462629f4fb826e45f67199abd0dd2931c" May 29 14:00:07.988027 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:00:07.987810 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29667720-n2sh2" May 29 14:02:16.059013 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:16.058986 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 14:02:16.061800 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:16.061778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 14:02:18.015942 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:18.015919 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b886db694-6t5sl_31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd/nginx/0.log" May 29 14:02:18.239855 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:18.239827 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-qgsvn_53fa3ef6-d568-407f-9755-25ca00c33372/manager/0.log" May 29 14:02:18.360487 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:18.360457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-dnqbz_b7c44a0d-1430-46ce-9745-524e9e878067/manager/0.log" May 29 14:02:18.588179 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:18.588150 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29667720-n2sh2_1eff41bd-4319-437f-8f5f-d890f1254f5b/cleanup/0.log" May 29 14:02:19.055519 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:19.055494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-c2q7q_a068183b-a89e-4b19-b21d-d263aa78828d/copy-manifests/0.log" May 29 14:02:19.069821 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:19.069802 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-c2q7q_a068183b-a89e-4b19-b21d-d263aa78828d/manager/0.log" May 29 14:02:19.424679 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:19.424648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wsrx9_164de058-d2c6-4f3b-bfdf-1653d7d577b3/postgres/0.log" May 29 14:02:20.205925 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.205896 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/util/0.log" May 29 14:02:20.212456 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.212433 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/pull/0.log" May 29 14:02:20.219740 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.219717 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/extract/0.log" May 29 14:02:20.335491 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.335467 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/util/0.log" May 29 14:02:20.342396 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.342371 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/pull/0.log" May 29 14:02:20.349169 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.349133 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/extract/0.log" May 29 14:02:20.457621 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.457562 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/util/0.log" May 29 14:02:20.463814 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.463795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/pull/0.log" May 29 14:02:20.470156 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.470141 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/extract/0.log" May 29 14:02:20.580984 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.580961 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/pull/0.log" May 29 14:02:20.587115 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.587076 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/extract/0.log" May 29 14:02:20.592456 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.592439 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/util/0.log" May 29 14:02:20.827651 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:20.827628 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-cwfdh_f7cff6bf-eff7-432c-85db-384939dd1758/manager/0.log" May 29 14:02:21.975922 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:21.975877 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-7489m_66e15afe-fd9e-4337-a15e-0c896fb80b9a/discovery/0.log" May 29 14:02:22.198831 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:22.198804 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f784d5b-hgmmm_50f19631-bced-4e0a-9187-e2e410abdca9/kube-auth-proxy/0.log" May 29 14:02:22.422410 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:22.422383 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2rwd7_d32b9cc4-8166-46d8-b2cb-cba17744e45d/payload-processing/0.log" May 29 14:02:22.532246 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:22.532220 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-544d49f6d6-hxbqp_bf94d73a-85d6-4a8e-890c-d35dd9a04e66/router/0.log" May 29 14:02:30.766580 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:30.766549 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n5rdx_b07be88d-e070-47b9-a01b-edd852b778ae/global-pull-secret-syncer/0.log" May 29 14:02:30.942834 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:30.942807 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r96vp_f6a78835-f073-4672-b831-8b73f37dc8ab/konnectivity-agent/0.log" May 29 14:02:30.961042 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:30.961021 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-53.ec2.internal_e3df1bb21d6366b73602f6da128df9ea/haproxy/0.log" May 29 14:02:34.491608 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.491559 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/extract/0.log" May 29 14:02:34.518519 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.518498 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/util/0.log" May 29 14:02:34.538969 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.538946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c6xz4_31787bee-77a8-4011-8661-237af2521d17/pull/0.log" May 29 14:02:34.563871 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.563833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/extract/0.log" May 29 14:02:34.585943 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.585919 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/util/0.log" May 29 14:02:34.607473 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.607430 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nl9nj_e14786a5-bb57-4d7c-80c3-5b9e635e92d1/pull/0.log" May 29 14:02:34.639616 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.639593 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/extract/0.log" May 29 14:02:34.660245 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.660230 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/util/0.log" May 29 14:02:34.679688 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.679671 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fq874_317a8976-6179-4b5d-9afe-a05c46ec29ec/pull/0.log" May 29 14:02:34.706094 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.706075 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/extract/0.log" May 29 14:02:34.728471 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.728449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/util/0.log" May 29 14:02:34.747949 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.747889 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvdc9_178aaf60-1415-49ec-8458-f33d7949de8e/pull/0.log" May 29 14:02:34.843626 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:34.843604 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-cwfdh_f7cff6bf-eff7-432c-85db-384939dd1758/manager/0.log" May 29 14:02:36.451229 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.451199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4frm6_22f3f8d3-0e15-4a37-b9d2-2381e9c2d266/kube-state-metrics/0.log" May 29 14:02:36.471222 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.471196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4frm6_22f3f8d3-0e15-4a37-b9d2-2381e9c2d266/kube-rbac-proxy-main/0.log" May 29 14:02:36.492009 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.491993 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4frm6_22f3f8d3-0e15-4a37-b9d2-2381e9c2d266/kube-rbac-proxy-self/0.log" May 29 14:02:36.551058 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.551035 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-7kxt7_20e6c0f4-23e4-4363-99a0-33119406120b/monitoring-plugin/0.log" May 29 14:02:36.582793 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.582771 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwz9_11038da5-667b-40b0-9ae4-5273668343cf/node-exporter/0.log" May 29 14:02:36.603034 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.603014 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwz9_11038da5-667b-40b0-9ae4-5273668343cf/kube-rbac-proxy/0.log" May 29 14:02:36.622796 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:36.622781 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwz9_11038da5-667b-40b0-9ae4-5273668343cf/init-textfile/0.log" May 29 14:02:37.168013 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:37.167988 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjn9f_5a1fb9e8-97d6-43d7-82bd-e490063208f3/prometheus-operator/0.log" May 29 14:02:37.200139 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:37.200118 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjn9f_5a1fb9e8-97d6-43d7-82bd-e490063208f3/kube-rbac-proxy/0.log" May 29 14:02:39.273265 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:39.273222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/2.log" May 29 14:02:39.278033 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:39.278011 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fv5ml_7d753d83-9c48-4011-9dcf-e1440be747a5/console-operator/3.log" May 29 14:02:39.781977 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:39.781946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84fd87ccd9-4l8qr_855fd44d-dff5-479c-a53e-070fde14dcb8/console/0.log" May 29 14:02:40.154940 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.154906 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp"] May 29 14:02:40.155397 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.155354 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eff41bd-4319-437f-8f5f-d890f1254f5b" containerName="cleanup" May 29 14:02:40.155397 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.155390 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eff41bd-4319-437f-8f5f-d890f1254f5b" containerName="cleanup" May 29 14:02:40.155557 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.155476 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="1eff41bd-4319-437f-8f5f-d890f1254f5b" containerName="cleanup" May 29 14:02:40.157759 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.157741 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.160767 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.160749 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcwqr\"/\"kube-root-ca.crt\"" May 29 14:02:40.162058 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.162042 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mcwqr\"/\"default-dockercfg-846cz\"" May 29 14:02:40.162058 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.162050 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcwqr\"/\"openshift-service-ca.crt\"" May 29 14:02:40.167499 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.167477 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp"] May 29 14:02:40.250188 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.250153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-podres\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.250308 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.250196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-lib-modules\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.250308 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.250213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-sys\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.250308 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.250232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-proc\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.250308 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.250260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcss\" (UniqueName: \"kubernetes.io/projected/06b6d898-e11d-4704-8a06-12746442b00e-kube-api-access-tpcss\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351582 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351557 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-podres\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351596 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-lib-modules\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351615 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-sys\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351635 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-proc\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351664 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcss\" (UniqueName: \"kubernetes.io/projected/06b6d898-e11d-4704-8a06-12746442b00e-kube-api-access-tpcss\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-sys\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351727 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-podres\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351748 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-proc\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.351951 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.351756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b6d898-e11d-4704-8a06-12746442b00e-lib-modules\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.361903 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.361877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcss\" (UniqueName: \"kubernetes.io/projected/06b6d898-e11d-4704-8a06-12746442b00e-kube-api-access-tpcss\") pod \"perf-node-gather-daemonset-jcvzp\" (UID: \"06b6d898-e11d-4704-8a06-12746442b00e\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.469121 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.469063 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:40.597295 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:40.597255 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp"] May 29 14:02:40.598478 ip-10-0-129-53 kubenswrapper[2568]: W0529 14:02:40.598449 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06b6d898_e11d_4704_8a06_12746442b00e.slice/crio-c4bb62aa666f433547d660fbac7beb24db9a9396b27dac07124fdec959877af9 WatchSource:0}: Error finding container c4bb62aa666f433547d660fbac7beb24db9a9396b27dac07124fdec959877af9: Status 404 returned error can't find the container with id c4bb62aa666f433547d660fbac7beb24db9a9396b27dac07124fdec959877af9 May 29 14:02:41.600307 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.600270 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" event={"ID":"06b6d898-e11d-4704-8a06-12746442b00e","Type":"ContainerStarted","Data":"91c2cbf7dd5698b75cd3cbd59821ce710e36716c4af7649b1fbecb5b8146fac2"} May 29 14:02:41.600307 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.600306 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" event={"ID":"06b6d898-e11d-4704-8a06-12746442b00e","Type":"ContainerStarted","Data":"c4bb62aa666f433547d660fbac7beb24db9a9396b27dac07124fdec959877af9"} May 29 14:02:41.600713 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.600399 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:41.621034 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.620989 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" podStartSLOduration=1.620974658 podStartE2EDuration="1.620974658s" podCreationTimestamp="2026-05-29 14:02:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:02:41.617819347 +0000 UTC m=+1226.151725374" watchObservedRunningTime="2026-05-29 14:02:41.620974658 +0000 UTC m=+1226.154880695" May 29 14:02:41.632380 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.632337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttwj6_6b273daf-4e71-4fa8-a925-13388d952fea/dns/0.log" May 29 14:02:41.651197 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.651177 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttwj6_6b273daf-4e71-4fa8-a925-13388d952fea/kube-rbac-proxy/0.log" May 29 14:02:41.678009 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:41.677987 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jmf9q_e8d1e520-cbc2-4d71-9117-9c1efa012450/dns-node-resolver/0.log" May 29 14:02:42.193069 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:42.193041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5dd7bf9b4-xgsd4_0ac8030f-83d7-4d19-ab33-0c52dbada050/registry/0.log" May 29 14:02:42.254746 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:42.254721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9j5k_a0886c7f-a0f0-4e97-a7da-8a1a394ef0ab/node-ca/0.log" May 29 14:02:43.179330 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:43.179302 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-7489m_66e15afe-fd9e-4337-a15e-0c896fb80b9a/discovery/0.log" May 29 14:02:43.227087 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:43.227061 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f784d5b-hgmmm_50f19631-bced-4e0a-9187-e2e410abdca9/kube-auth-proxy/0.log" May 29 14:02:43.282980 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:43.282954 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2rwd7_d32b9cc4-8166-46d8-b2cb-cba17744e45d/payload-processing/0.log" May 29 14:02:43.307355 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:43.307332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-544d49f6d6-hxbqp_bf94d73a-85d6-4a8e-890c-d35dd9a04e66/router/0.log" May 29 14:02:43.877507 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:43.877476 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ps7sb_b2deb9de-7828-420b-8170-20e978ab1375/serve-healthcheck-canary/0.log" May 29 14:02:44.357560 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:44.357526 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-bpvbz_0ab0aaec-b6fb-40b2-92c0-740a29e15770/insights-operator/1.log" May 29 14:02:44.357957 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:44.357705 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-bpvbz_0ab0aaec-b6fb-40b2-92c0-740a29e15770/insights-operator/0.log" May 29 14:02:44.379343 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:44.379318 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jfxpt_c2405d54-9058-4736-8acb-396d547a789f/kube-rbac-proxy/0.log" May 29 14:02:44.401591 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:44.401572 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jfxpt_c2405d54-9058-4736-8acb-396d547a789f/exporter/0.log" May 29 14:02:44.422804 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:44.422779 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jfxpt_c2405d54-9058-4736-8acb-396d547a789f/extractor/0.log" May 29 14:02:46.553642 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.553606 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b886db694-6t5sl_31db1cf5-a9d6-4891-8b8c-2e6609ac8fdd/nginx/0.log" May 29 14:02:46.600101 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.600076 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-qgsvn_53fa3ef6-d568-407f-9755-25ca00c33372/manager/0.log" May 29 14:02:46.632468 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.632448 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-dnqbz_b7c44a0d-1430-46ce-9745-524e9e878067/manager/0.log" May 29 14:02:46.677647 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.677623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29667720-n2sh2_1eff41bd-4319-437f-8f5f-d890f1254f5b/cleanup/0.log" May 29 14:02:46.833169 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.833145 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-c2q7q_a068183b-a89e-4b19-b21d-d263aa78828d/manager/0.log" May 29 14:02:46.853797 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.853778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-c2q7q_a068183b-a89e-4b19-b21d-d263aa78828d/copy-manifests/0.log" May 29 14:02:46.972371 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:46.972315 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wsrx9_164de058-d2c6-4f3b-bfdf-1653d7d577b3/postgres/0.log" May 29 14:02:47.614309 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:47.614283 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-jcvzp" May 29 14:02:48.493909 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:48.493880 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-mqhkv_8af63e06-7125-4a7d-8392-1a128e019665/openshift-lws-operator/0.log" May 29 14:02:55.082573 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.082543 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7lblt_f403b18d-1117-4910-9d4b-bc1cfd2aa1a9/kube-multus/0.log" May 29 14:02:55.404483 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.404408 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/kube-multus-additional-cni-plugins/0.log" May 29 14:02:55.427311 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.427288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/egress-router-binary-copy/0.log" May 29 14:02:55.445503 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.445477 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/cni-plugins/0.log" May 29 14:02:55.466668 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.466652 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/bond-cni-plugin/0.log" May 29 14:02:55.487780 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.487760 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/routeoverride-cni/0.log" May 29 14:02:55.506483 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.506455 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/whereabouts-cni-bincopy/0.log" May 29 14:02:55.527984 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.527961 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsprg_b9a878eb-416d-4400-9342-fae2ce8ba6fd/whereabouts-cni/0.log" May 29 14:02:55.622750 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.622729 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8g898_b01e0990-f3cf-496b-8266-d89ed137c0d5/network-metrics-daemon/0.log" May 29 14:02:55.639282 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:55.639264 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8g898_b01e0990-f3cf-496b-8266-d89ed137c0d5/kube-rbac-proxy/0.log" May 29 14:02:56.823076 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:56.823052 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzlrx_3aaa700c-e92c-4f83-b4d0-11d6b1c7c476/ovn-controller/0.log" May 29 14:02:56.844719 ip-10-0-129-53 kubenswrapper[2568]: I0529 14:02:56.844696 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzlrx_3aaa700c-e92c-4f83-b4d0-11d6b1c7c476/ovn-acl-logging/0.log"