Jun 11 16:16:57.424832 ip-10-0-129-97 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 16:16:57.424846 ip-10-0-129-97 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 16:16:57.424855 ip-10-0-129-97 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 16:16:57.425068 ip-10-0-129-97 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 16:17:07.573746 ip-10-0-129-97 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 16:17:07.573768 ip-10-0-129-97 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 853d8d7972004f90a1701a78a69a5c6b -- Jun 11 16:19:55.708340 ip-10-0-129-97 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:19:56.155421 ip-10-0-129-97 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:56.155421 ip-10-0-129-97 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:19:56.155421 ip-10-0-129-97 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:56.155421 ip-10-0-129-97 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:19:56.156924 ip-10-0-129-97 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:56.157199 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.156998 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:19:56.163023 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163007 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.163023 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163023 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.163023 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163026 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163029 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163034 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163037 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163040 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163043 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163046 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163048 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163051 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163054 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163056 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163059 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163061 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163078 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163081 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163085 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163089 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163092 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163095 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.163147 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163099 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163103 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163106 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163112 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163116 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163119 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163122 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163125 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163128 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163130 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163133 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163137 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163139 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163142 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163145 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163149 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163152 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163155 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163158 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163161 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.163602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163164 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163167 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163170 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163172 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163175 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163178 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163181 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163183 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163186 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163189 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163191 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163194 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163197 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163200 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163202 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163204 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163207 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163210 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163212 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.164154 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163214 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163217 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163220 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163223 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163225 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163228 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163230 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163233 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163238 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163242 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163245 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163247 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163250 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163253 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163256 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163259 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163261 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163264 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163266 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163269 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.164641 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163271 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163274 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163277 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163280 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163284 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163286 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163289 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163291 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163294 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163296 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163299 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163301 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163304 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163306 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163309 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163311 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163314 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163316 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.163319 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164014 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.165150 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164020 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164023 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164026 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164029 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164031 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164035 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164038 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164041 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164044 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164046 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164049 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164052 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164054 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164057 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164061 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164078 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164081 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164083 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164086 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164089 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.165633 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164091 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164094 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164096 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164099 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164101 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164104 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164106 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164109 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164111 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164114 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164116 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164120 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164123 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164126 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164128 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164131 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164134 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164136 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164139 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164141 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.166148 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164144 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164146 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164149 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164151 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164155 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164160 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164164 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164168 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164171 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164174 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164177 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164180 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164182 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164186 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164190 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164193 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164195 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164198 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164201 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.166642 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164204 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164207 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164210 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164212 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164216 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164220 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164223 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164225 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164229 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164233 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164236 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164238 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164241 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164244 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164246 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164249 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164251 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164254 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164256 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164259 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.167122 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164262 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164265 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164267 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164270 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164272 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164275 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164277 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164280 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164282 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164285 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164287 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164290 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164293 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164295 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164298 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164300 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164303 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164306 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164308 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164690 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.167639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164695 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164697 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164700 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164703 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164706 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164708 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164711 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164714 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164717 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164719 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164722 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164724 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164727 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164730 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164732 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164735 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164737 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164740 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164743 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164747 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.168149 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164750 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164753 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164758 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164761 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164763 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164766 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164769 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164772 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164774 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164777 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164779 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164782 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164785 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164787 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164790 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164793 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164795 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164798 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.168632 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164801 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164803 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164806 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164809 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164811 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164814 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164816 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164819 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164821 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164824 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164826 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164828 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164831 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164834 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164836 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164838 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164841 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164843 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164846 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164848 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.169140 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164851 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164854 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164857 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164859 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164862 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164865 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164867 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164870 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164872 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164875 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164877 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164880 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164884 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164887 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164890 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164893 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164896 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164899 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164902 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.169631 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164905 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164908 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164910 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164913 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164916 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164918 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164921 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164925 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164927 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164930 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164936 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164939 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164942 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164945 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164948 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164951 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164953 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164956 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164959 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.170105 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.164961 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165039 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165049 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165058 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165078 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165085 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165090 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165097 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165102 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165105 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165108 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165112 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165115 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165118 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165122 2562 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165125 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165128 2562 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165131 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165134 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165139 2562 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165141 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165145 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165148 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165153 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:19:56.170602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165157 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165160 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165163 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165167 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165170 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165173 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165176 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165179 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165182 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165187 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165190 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165193 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165196 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165199 2562 flags.go:64] FLAG: --enable-server="true" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165201 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165205 2562 flags.go:64] FLAG: --event-burst="100" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165208 2562 flags.go:64] FLAG: --event-qps="50" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165211 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165214 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165217 2562 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165221 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165224 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165227 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165231 2562 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165234 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:19:56.171204 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165237 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165239 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165242 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165245 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165248 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165251 2562 flags.go:64] FLAG: --feature-gates="" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165256 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165259 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165262 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165265 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165268 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165271 2562 flags.go:64] FLAG: --help="false" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165274 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165277 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165280 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165283 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165286 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165289 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165292 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165295 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165297 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165300 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165303 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165306 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:19:56.171812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165308 2562 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165312 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165314 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165317 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165320 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165323 2562 flags.go:64] FLAG: --lock-file="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165326 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165335 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165339 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165344 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165346 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165349 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165352 2562 flags.go:64] FLAG: --logging-format="text" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165355 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165360 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165363 2562 flags.go:64] FLAG: --manifest-url="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165365 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165374 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165376 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165382 2562 flags.go:64] FLAG: --max-pods="110" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165385 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165388 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165391 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165394 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165397 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:19:56.172495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165400 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165403 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165410 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165413 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165416 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165419 2562 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165422 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165428 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165431 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165434 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165437 2562 flags.go:64] FLAG: --port="10250" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165439 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165442 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cb235804db4518dd" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165445 2562 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165448 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165451 2562 flags.go:64] FLAG: --register-node="true" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165454 2562 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165458 2562 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165461 2562 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165463 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165466 2562 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165470 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165474 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165477 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165480 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:19:56.173125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165482 2562 flags.go:64] FLAG: --runonce="false" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165486 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165489 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165492 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165495 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165498 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165501 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165504 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165507 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165510 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165513 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165515 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165518 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165521 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165524 2562 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165527 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165532 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165534 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165537 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165542 2562 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165545 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165547 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165550 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165554 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165557 2562 flags.go:64] FLAG: --v="2" Jun 11 16:19:56.173736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165560 2562 flags.go:64] FLAG: --version="false" Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165564 2562 flags.go:64] FLAG: --vmodule="" Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165568 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.165571 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165700 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165704 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165707 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165710 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165714 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165717 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165719 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165722 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165724 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165727 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165730 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165732 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165735 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165739 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165743 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165746 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.174345 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165750 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165753 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165756 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165759 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165762 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165764 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165768 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165771 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165774 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165777 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165780 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165783 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165786 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165788 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165791 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165794 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165797 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165800 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165802 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.174835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165805 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165809 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165812 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165814 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165817 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165820 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165822 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165825 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165827 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165830 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165832 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165835 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165837 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165840 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165842 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165845 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165847 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165850 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165852 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165855 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.175316 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165857 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165860 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165862 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165865 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165868 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165873 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165876 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165879 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165881 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165885 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165887 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165890 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165898 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165902 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165905 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165908 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165910 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165913 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165915 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165918 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.175801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165921 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165923 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165926 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165928 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165931 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165933 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165935 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165938 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165941 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165943 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165946 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165948 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165951 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165953 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165956 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165959 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165961 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165964 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165973 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165976 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.176299 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165979 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165983 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165985 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.165988 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.166712 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.173600 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.173617 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.173638 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.173647 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173733 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173738 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173742 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173745 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173748 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.176835 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173751 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173754 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173757 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173760 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173763 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173765 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173768 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173771 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173774 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173778 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173781 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173785 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173788 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173790 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173793 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173796 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173800 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173804 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173806 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.177226 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173809 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173812 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173814 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173817 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173820 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173823 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173826 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173828 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173831 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173834 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173836 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173839 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173842 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173844 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173847 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173850 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173852 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173855 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173858 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173860 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.177728 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173863 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173866 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173868 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173871 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173875 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173878 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173882 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173884 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173887 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173890 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173893 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173896 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173899 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173902 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173904 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173907 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173910 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173913 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173915 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.178406 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173918 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173920 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173923 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173926 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173928 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173931 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173933 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173936 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173938 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173941 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173943 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173947 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173950 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173953 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173955 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173958 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173960 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173963 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173966 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173968 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.178876 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173971 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173973 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173976 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173979 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173983 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173986 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173988 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173991 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173993 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173996 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.173999 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174001 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174004 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174006 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174009 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.179385 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174011 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.174016 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174175 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174181 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174184 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174187 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174190 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174193 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174195 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174198 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174202 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174205 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174208 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174211 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174215 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:56.179744 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174217 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174220 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174222 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174225 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174228 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174231 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174234 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174237 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174239 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174242 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174245 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174247 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174250 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174253 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174255 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174258 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174260 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174262 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174265 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174267 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:56.180127 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174270 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174272 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174275 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174278 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174282 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174284 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174287 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174289 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174292 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174295 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174297 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174300 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174302 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174305 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174307 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174310 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174312 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174315 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174317 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:56.180621 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174320 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174323 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174325 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174328 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174331 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174333 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174336 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174338 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174342 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174344 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174347 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174349 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174352 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174355 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174358 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174360 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174363 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174365 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174368 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174370 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:56.181100 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174373 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174375 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174378 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174382 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174385 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174388 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174390 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174393 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174396 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174398 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174401 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174403 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174406 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174408 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174411 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174414 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174417 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174419 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174422 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174424 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:56.181577 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174427 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174429 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174432 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174434 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174437 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174439 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:56.174442 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.174446 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.174557 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.176600 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.178171 2562 server.go:1019] "Starting client certificate rotation" Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.178276 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.178313 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:56.182159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.181276 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:56.183981 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.183959 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:56.194428 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.194406 2562 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:19:56.197732 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.197708 2562 log.go:25] "Validated CRI v1 image API" Jun 11 16:19:56.199372 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.199356 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:19:56.205937 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.205916 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85e95764-d09e-4019-b35a-bcba7be0da3e:/dev/nvme0n1p3 cf119199-9d44-47d7-9c10-ec485412b248:/dev/nvme0n1p4] Jun 11 16:19:56.205984 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.205938 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:19:56.209987 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.209969 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:56.212196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.212051 2562 manager.go:216] Machine: {Timestamp:2026-06-11 16:19:56.210696002 +0000 UTC m=+0.376662162 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104833 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a99811cd3cc24183796f3ff0e10c6 SystemUUID:ec2a9981-1cd3-cc24-1837-96f3ff0e10c6 BootID:853d8d79-7200-4f90-a170-1a78a69a5c6b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:a7:02:d8:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:a7:02:d8:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:c7:ec:21:40:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:19:56.212196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.212189 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:19:56.212300 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.212272 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:19:56.215433 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.215405 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:19:56.215576 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.215436 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:19:56.216310 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.216301 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:19:56.216342 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.216312 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:19:56.216342 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.216324 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:56.217256 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.217245 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:56.218346 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.218336 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:19:56.221943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.221932 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:56.222102 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222092 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:19:56.222141 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222122 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:19:56.222141 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222132 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:19:56.222217 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222148 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:19:56.222217 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222157 2562 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:19:56.222217 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222170 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:19:56.222563 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222552 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:56.222604 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.222573 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:56.225760 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.225734 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:19:56.228220 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.228206 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:19:56.228279 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.228236 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:19:56.229661 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229649 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229665 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229671 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229677 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229685 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229691 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229698 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:19:56.229709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229704 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:19:56.229885 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229714 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:19:56.229885 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229720 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:19:56.229885 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229733 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:19:56.229885 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.229739 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:19:56.230599 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.230586 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:19:56.230599 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.230595 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:19:56.233729 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.233715 2562 server.go:1268] "Started kubelet" Jun 11 16:19:56.233902 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.233799 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:19:56.234002 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.233985 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:19:56.234056 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.234035 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:19:56.234337 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.234149 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:19:56.234694 ip-10-0-129-97 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:19:56.238703 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.238678 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:19:56.239990 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.239912 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:19:56.240111 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.240020 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:19:56.240844 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.240826 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:19:56.243033 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.243013 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:19:56.245145 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.244141 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-97.ec2.internal.18b8133ae148865d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-97.ec2.internal,UID:ip-10-0-129-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-97.ec2.internal,},FirstTimestamp:2026-06-11 16:19:56.233688669 +0000 UTC m=+0.399654828,LastTimestamp:2026-06-11 16:19:56.233688669 +0000 UTC m=+0.399654828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-97.ec2.internal,}" Jun 11 16:19:56.246452 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.246436 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2vjs" Jun 11 16:19:56.247875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.247858 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:19:56.247963 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.247880 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:56.248017 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.247969 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.248682 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248619 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:19:56.248682 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248637 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:19:56.248875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248848 2562 factory.go:55] Registering systemd factory Jun 11 16:19:56.248875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248868 2562 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:19:56.248875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248874 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:19:56.249032 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248889 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:19:56.249032 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.248898 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:19:56.249149 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249133 2562 factory.go:153] Registering CRI-O factory Jun 11 16:19:56.249149 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249152 2562 factory.go:223] Registration of the crio container factory successfully Jun 11 16:19:56.249270 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249205 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:19:56.249270 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249227 2562 factory.go:103] Registering Raw factory Jun 11 16:19:56.249270 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249242 2562 manager.go:1196] Started watching for new ooms in manager Jun 11 16:19:56.249918 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.249903 2562 manager.go:349] Starting recovery of all containers Jun 11 16:19:56.249993 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.249974 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:19:56.250143 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.250118 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:19:56.255915 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.255894 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2vjs" Jun 11 16:19:56.260712 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.260696 2562 manager.go:354] Recovery completed Jun 11 16:19:56.264890 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.264782 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.266817 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.266799 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.266904 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.266831 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.266904 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.266845 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.267426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.267407 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:19:56.267426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.267425 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:19:56.267535 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.267440 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.267535 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.267442 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:56.268289 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268274 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.268365 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268319 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.268365 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268335 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.268669 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268656 2562 policy_none.go:49] "None policy: Start" Jun 11 16:19:56.268669 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268671 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:19:56.268741 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.268681 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:19:56.269852 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.269842 2562 policy_none.go:47] "Start" Jun 11 16:19:56.316690 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.316674 2562 manager.go:337] "Starting Device Plugin manager" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.316709 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.316722 2562 server.go:87] "Starting device plugin registration server" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.316997 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.317009 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.317184 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.317271 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.317279 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.317789 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.317843 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.322865 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.323931 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.323963 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.323984 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:19:56.325108 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.324013 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:19:56.326649 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.326632 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:56.417699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.417615 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.418613 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.418592 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.418734 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.418629 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.418734 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.418643 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.418734 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.418672 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.424922 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.424904 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal"] Jun 11 16:19:56.424996 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.424962 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.426511 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.426495 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.426582 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.426517 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.426582 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.426550 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-97.ec2.internal\": node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.426657 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.426521 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.426657 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.426600 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.428302 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.428291 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.428410 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.428397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.428457 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.428432 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.429048 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429030 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.429156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429057 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.429156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429031 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.429156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429087 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.429156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429108 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.429156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.429126 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.430397 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.430378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.430555 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.430408 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:56.431101 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.431083 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:56.431182 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.431114 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:56.431182 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.431128 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:56.444231 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.444213 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.449486 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.449470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.449571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.449493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb29ebae2d068e8f9fd0436c62039ef2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-97.ec2.internal\" (UID: \"eb29ebae2d068e8f9fd0436c62039ef2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.449571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.449511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.458877 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.458858 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-97.ec2.internal\" not found" node="ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.463503 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.463488 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-97.ec2.internal\" not found" node="ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.544446 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.544414 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.549682 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.549682 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.549850 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb29ebae2d068e8f9fd0436c62039ef2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-97.ec2.internal\" (UID: \"eb29ebae2d068e8f9fd0436c62039ef2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.549850 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.549850 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb29ebae2d068e8f9fd0436c62039ef2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-97.ec2.internal\" (UID: \"eb29ebae2d068e8f9fd0436c62039ef2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.549850 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.549748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6110a9d5088c149c8dbb594596ceab3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal\" (UID: \"6110a9d5088c149c8dbb594596ceab3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.645287 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.645255 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.746037 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.745967 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.763382 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.763346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.769553 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:56.769538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:56.846266 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.846227 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:56.946832 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:56.946800 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:57.047383 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.047301 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:57.066356 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.066326 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:57.147685 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.147658 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-97.ec2.internal\" not found" Jun 11 16:19:57.177147 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.177122 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:19:57.177699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.177295 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:57.177699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.177306 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:57.188247 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.188226 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:57.222495 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.222477 2562 apiserver.go:52] "Watching apiserver" Jun 11 16:19:57.231825 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.231807 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:19:57.232173 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.232151 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8rgj7","openshift-image-registry/node-ca-kzzmh","openshift-multus/multus-additional-cni-plugins-v4tr6","openshift-multus/multus-llk2g","openshift-multus/network-metrics-daemon-545xm","kube-system/global-pull-secret-syncer-klqv4","kube-system/konnectivity-agent-nbqq8","openshift-dns/node-resolver-2r7dk","openshift-network-diagnostics/network-check-target-bmvpl","openshift-network-operator/iptables-alerter-lp2s7","openshift-ovn-kubernetes/ovnkube-node-z7sjk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz"] Jun 11 16:19:57.234016 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.233995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.235782 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.235757 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb29ebae2d068e8f9fd0436c62039ef2.slice/crio-e1848e88e0ca8cb9d7d22fa29f2981ab66d132cb43e40c5aa28369e0632d653f WatchSource:0}: Error finding container e1848e88e0ca8cb9d7d22fa29f2981ab66d132cb43e40c5aa28369e0632d653f: Status 404 returned error can't find the container with id e1848e88e0ca8cb9d7d22fa29f2981ab66d132cb43e40c5aa28369e0632d653f Jun 11 16:19:57.236222 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.236191 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.236313 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.236232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6110a9d5088c149c8dbb594596ceab3d.slice/crio-0aa73a16bd49632578e3109d67a3d1676c10a0bdfe7d0024b56d6f8492108ee7 WatchSource:0}: Error finding container 0aa73a16bd49632578e3109d67a3d1676c10a0bdfe7d0024b56d6f8492108ee7: Status 404 returned error can't find the container with id 0aa73a16bd49632578e3109d67a3d1676c10a0bdfe7d0024b56d6f8492108ee7 Jun 11 16:19:57.236403 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.236382 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.236468 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.236440 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.236519 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.236463 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c68zf\"" Jun 11 16:19:57.238294 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.238274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.239084 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.239043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.239450 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.239422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:19:57.240297 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.239601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.240386 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.240364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2t9t6\"" Jun 11 16:19:57.240941 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.240920 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k8w2m\"" Jun 11 16:19:57.241283 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.241267 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.241543 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.241527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:19:57.242598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.242133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:19:57.242598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.242257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.242598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.242457 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:19:57.242598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.242547 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:19:57.243521 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.243210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.244671 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.244648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.244757 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.244719 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:19:57.245214 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.245196 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:19:57.245424 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.245408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wrkdn\"" Jun 11 16:19:57.246186 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.246164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.246271 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.246250 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:19:57.247529 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.247511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.248045 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.248029 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:57.248187 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.248171 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" Jun 11 16:19:57.249136 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.249119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.249519 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.249502 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:19:57.249594 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.249541 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:19:57.249683 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.249662 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8dzhv\"" Jun 11 16:19:57.250389 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.250373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:57.250466 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.250446 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:19:57.251150 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.251137 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.251231 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.251221 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.251619 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.251602 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ctpxw\"" Jun 11 16:19:57.251825 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.251808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.253021 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af864790-82a7-4fa9-a810-d7fdf64121f9-serviceca\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.253123 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-kubernetes\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.253123 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-tuned\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.253238 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-system-cni-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.253238 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-socket-dir-parent\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253238 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-multus\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253238 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4befebd6-db8b-4372-9075-a3295859fe9a-agent-certs\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4befebd6-db8b-4372-9075-a3295859fe9a-konnectivity-ca\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/458a36dd-6930-443e-9dda-94ba59f28d93-hosts-file\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-conf\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-sys\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-tmp\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.253401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-cnibin\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-os-release\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-netns\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cni-binary-copy\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-kubelet\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-hostroot\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-conf-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-etc-kubernetes\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltj6n\" (UniqueName: \"kubernetes.io/projected/6b9aca90-c5f9-4148-8828-c00413fdb478-kube-api-access-ltj6n\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.253782 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st6tt\" (UniqueName: \"kubernetes.io/projected/af864790-82a7-4fa9-a810-d7fdf64121f9-kube-api-access-st6tt\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysconfig\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n5bx\" (UniqueName: \"kubernetes.io/projected/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-kube-api-access-5n5bx\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.253986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bl7p\" (UniqueName: \"kubernetes.io/projected/458a36dd-6930-443e-9dda-94ba59f28d93-kube-api-access-5bl7p\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af864790-82a7-4fa9-a810-d7fdf64121f9-host\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254046 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-systemd\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hmqxw\"" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-run\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-os-release\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254174 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254226 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-system-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-k8s-cni-cncf-io\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8s9\" (UniqueName: \"kubernetes.io/projected/6c85d627-8695-4a1c-afe0-df7d5f55bddf-kube-api-access-qz8s9\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-lib-modules\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxf5f\" (UniqueName: \"kubernetes.io/projected/aff08b01-d622-4494-b0d7-013c5784a161-kube-api-access-rxf5f\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cnibin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-var-lib-kubelet\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-host\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-kubelet-config\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-dbus\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-modprobe-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-bin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-daemon-config\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.254979 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-multus-certs\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.255583 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/458a36dd-6930-443e-9dda-94ba59f28d93-tmp-dir\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.255583 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.254906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.255683 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.255665 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:19:57.255722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.255696 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.256023 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.255986 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:19:57.256023 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.256002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xp7lw\"" Jun 11 16:19:57.256213 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.256195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:19:57.256305 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.256252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:19:57.256305 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.256201 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.257361 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.257346 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:19:57.257460 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.257420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:19:57.257460 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.257441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4rkhq\"" Jun 11 16:19:57.257905 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.257886 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:19:57.258658 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.258604 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:14:56 +0000 UTC" deadline="2028-02-20 08:03:33.223451046 +0000 UTC" Jun 11 16:19:57.258658 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.258652 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14847h43m35.964803574s" Jun 11 16:19:57.259469 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.259453 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal"] Jun 11 16:19:57.259694 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.259675 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:57.259762 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.259748 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" Jun 11 16:19:57.261787 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.261769 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:57.276606 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.276589 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal"] Jun 11 16:19:57.277763 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.277749 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:57.324465 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.324407 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2g2v" Jun 11 16:19:57.327428 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.327386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" event={"ID":"eb29ebae2d068e8f9fd0436c62039ef2","Type":"ContainerStarted","Data":"e1848e88e0ca8cb9d7d22fa29f2981ab66d132cb43e40c5aa28369e0632d653f"} Jun 11 16:19:57.328358 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.328342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" event={"ID":"6110a9d5088c149c8dbb594596ceab3d","Type":"ContainerStarted","Data":"0aa73a16bd49632578e3109d67a3d1676c10a0bdfe7d0024b56d6f8492108ee7"} Jun 11 16:19:57.345810 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.345793 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2g2v" Jun 11 16:19:57.350058 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.350037 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:19:57.355500 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-dbus\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.355566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-daemon-config\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.355566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-multus-certs\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.355566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/458a36dd-6930-443e-9dda-94ba59f28d93-tmp-dir\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.355566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-env-overrides\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.355714 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/081c2d95-9307-4ea5-bac0-601220da8858-ovn-node-metrics-cert\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.355714 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-multus-certs\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.355714 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-kubelet-config\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.355877 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-kubernetes\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.355877 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-tuned\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.355877 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-dbus\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.355877 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8aea942-23de-4019-a7e7-0dab4f206e5b-kubelet-config\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.355877 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-kubernetes\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-multus\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/458a36dd-6930-443e-9dda-94ba59f28d93-tmp-dir\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-multus\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.355956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/458a36dd-6930-443e-9dda-94ba59f28d93-hosts-file\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-slash\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/458a36dd-6930-443e-9dda-94ba59f28d93-hosts-file\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.356100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-daemon-config\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-sys-fs\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-tmp\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-hostroot\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0093eae-6251-4dd4-b15c-ed254f5cd222-iptables-alerter-script\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-bin\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-hostroot\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-netd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356221 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-ovn\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.356315 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.356379 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:19:57.856349017 +0000 UTC m=+2.022315186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysconfig\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5bx\" (UniqueName: \"kubernetes.io/projected/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-kube-api-access-5n5bx\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.356430 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-var-lib-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysconfig\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-systemd\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-os-release\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-systemd\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-os-release\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8s9\" (UniqueName: \"kubernetes.io/projected/6c85d627-8695-4a1c-afe0-df7d5f55bddf-kube-api-access-qz8s9\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-lib-modules\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxf5f\" (UniqueName: \"kubernetes.io/projected/aff08b01-d622-4494-b0d7-013c5784a161-kube-api-access-rxf5f\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-lib-modules\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cnibin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hd5b\" (UniqueName: \"kubernetes.io/projected/081c2d95-9307-4ea5-bac0-601220da8858-kube-api-access-9hd5b\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29nz\" (UniqueName: \"kubernetes.io/projected/3bb899cc-587e-4799-9cd2-973c1d198ecf-kube-api-access-h29nz\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.356988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cnibin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-etc-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-log-socket\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-config\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-registration-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-modprobe-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-bin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357171 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af864790-82a7-4fa9-a810-d7fdf64121f9-serviceca\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-modprobe-d\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-cni-bin\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-system-cni-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-socket-dir-parent\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.357855 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-system-cni-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-socket-dir-parent\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4befebd6-db8b-4372-9075-a3295859fe9a-agent-certs\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4befebd6-db8b-4372-9075-a3295859fe9a-konnectivity-ca\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-conf\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-sys\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af864790-82a7-4fa9-a810-d7fdf64121f9-serviceca\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-cnibin\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357638 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-sys\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-os-release\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-cnibin\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-netns\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-os-release\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-netns\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aff08b01-d622-4494-b0d7-013c5784a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-sysctl-conf\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.358586 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-kubelet\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cni-binary-copy\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-var-lib-kubelet\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-conf-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-etc-kubernetes\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltj6n\" (UniqueName: \"kubernetes.io/projected/6b9aca90-c5f9-4148-8828-c00413fdb478-kube-api-access-ltj6n\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-conf-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st6tt\" (UniqueName: \"kubernetes.io/projected/af864790-82a7-4fa9-a810-d7fdf64121f9-kube-api-access-st6tt\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-etc-kubernetes\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwxcz\" (UniqueName: \"kubernetes.io/projected/b0093eae-6251-4dd4-b15c-ed254f5cd222-kube-api-access-wwxcz\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4befebd6-db8b-4372-9075-a3295859fe9a-konnectivity-ca\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.357990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-systemd-units\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bl7p\" (UniqueName: \"kubernetes.io/projected/458a36dd-6930-443e-9dda-94ba59f28d93-kube-api-access-5bl7p\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358271 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85d627-8695-4a1c-afe0-df7d5f55bddf-cni-binary-copy\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.358312 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:57.359209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af864790-82a7-4fa9-a810-d7fdf64121f9-host\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-node-log\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af864790-82a7-4fa9-a810-d7fdf64121f9-host\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.358499 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:57.858481685 +0000 UTC m=+2.024447850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-run\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-system-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358582 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-run\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aff08b01-d622-4494-b0d7-013c5784a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-k8s-cni-cncf-io\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358644 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-system-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-multus-cni-dir\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-script-lib\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c85d627-8695-4a1c-afe0-df7d5f55bddf-host-run-k8s-cni-cncf-io\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-socket-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.359804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-device-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0093eae-6251-4dd4-b15c-ed254f5cd222-host-slash\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-kubelet\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-netns\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-systemd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-var-lib-kubelet\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-host\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.358927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-var-lib-kubelet\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.359012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-host\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.359586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-tmp\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.359792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-etc-tuned\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.360277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.360021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4befebd6-db8b-4372-9075-a3295859fe9a-agent-certs\") pod \"konnectivity-agent-nbqq8\" (UID: \"4befebd6-db8b-4372-9075-a3295859fe9a\") " pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.368336 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.368316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxf5f\" (UniqueName: \"kubernetes.io/projected/aff08b01-d622-4494-b0d7-013c5784a161-kube-api-access-rxf5f\") pod \"multus-additional-cni-plugins-v4tr6\" (UID: \"aff08b01-d622-4494-b0d7-013c5784a161\") " pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.369098 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.369082 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:57.369189 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.369101 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:57.369189 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.369113 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:57.369189 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.369169 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:57.869152802 +0000 UTC m=+2.035118959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:57.370809 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.370791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n5bx\" (UniqueName: \"kubernetes.io/projected/7a3bb737-1f85-4e6e-9aee-eba4574f8dcf-kube-api-access-5n5bx\") pod \"tuned-8rgj7\" (UID: \"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf\") " pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.370895 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.370842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bl7p\" (UniqueName: \"kubernetes.io/projected/458a36dd-6930-443e-9dda-94ba59f28d93-kube-api-access-5bl7p\") pod \"node-resolver-2r7dk\" (UID: \"458a36dd-6930-443e-9dda-94ba59f28d93\") " pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.372264 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.372240 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8s9\" (UniqueName: \"kubernetes.io/projected/6c85d627-8695-4a1c-afe0-df7d5f55bddf-kube-api-access-qz8s9\") pod \"multus-llk2g\" (UID: \"6c85d627-8695-4a1c-afe0-df7d5f55bddf\") " pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.372602 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.372584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st6tt\" (UniqueName: \"kubernetes.io/projected/af864790-82a7-4fa9-a810-d7fdf64121f9-kube-api-access-st6tt\") pod \"node-ca-kzzmh\" (UID: \"af864790-82a7-4fa9-a810-d7fdf64121f9\") " pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.373268 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.373242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltj6n\" (UniqueName: \"kubernetes.io/projected/6b9aca90-c5f9-4148-8828-c00413fdb478-kube-api-access-ltj6n\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.459406 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-slash\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-sys-fs\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.459516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-slash\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0093eae-6251-4dd4-b15c-ed254f5cd222-iptables-alerter-script\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.459516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-sys-fs\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-bin\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-netd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-ovn\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-var-lib-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-netd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-cni-bin\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-ovn\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-var-lib-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hd5b\" (UniqueName: \"kubernetes.io/projected/081c2d95-9307-4ea5-bac0-601220da8858-kube-api-access-9hd5b\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.459707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h29nz\" (UniqueName: \"kubernetes.io/projected/3bb899cc-587e-4799-9cd2-973c1d198ecf-kube-api-access-h29nz\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-etc-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-log-socket\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-config\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-etc-openvswitch\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-registration-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-log-socket\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-registration-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwxcz\" (UniqueName: \"kubernetes.io/projected/b0093eae-6251-4dd4-b15c-ed254f5cd222-kube-api-access-wwxcz\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0093eae-6251-4dd4-b15c-ed254f5cd222-iptables-alerter-script\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-systemd-units\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-systemd-units\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.459979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-node-log\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-node-log\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-script-lib\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-socket-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-device-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0093eae-6251-4dd4-b15c-ed254f5cd222-host-slash\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-kubelet\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-socket-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-netns\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-run-netns\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0093eae-6251-4dd4-b15c-ed254f5cd222-host-slash\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-systemd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb899cc-587e-4799-9cd2-973c1d198ecf-device-dir\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-run-systemd\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.460866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-env-overrides\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.461577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-config\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.461577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/081c2d95-9307-4ea5-bac0-601220da8858-host-kubelet\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.461577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460931 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-ovnkube-script-lib\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.461577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.460828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/081c2d95-9307-4ea5-bac0-601220da8858-ovn-node-metrics-cert\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.461577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.461188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/081c2d95-9307-4ea5-bac0-601220da8858-env-overrides\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.464591 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.464574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/081c2d95-9307-4ea5-bac0-601220da8858-ovn-node-metrics-cert\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.467601 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.467580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29nz\" (UniqueName: \"kubernetes.io/projected/3bb899cc-587e-4799-9cd2-973c1d198ecf-kube-api-access-h29nz\") pod \"aws-ebs-csi-driver-node-bzlvz\" (UID: \"3bb899cc-587e-4799-9cd2-973c1d198ecf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.468000 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.467981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwxcz\" (UniqueName: \"kubernetes.io/projected/b0093eae-6251-4dd4-b15c-ed254f5cd222-kube-api-access-wwxcz\") pod \"iptables-alerter-lp2s7\" (UID: \"b0093eae-6251-4dd4-b15c-ed254f5cd222\") " pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.468088 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.467985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hd5b\" (UniqueName: \"kubernetes.io/projected/081c2d95-9307-4ea5-bac0-601220da8858-kube-api-access-9hd5b\") pod \"ovnkube-node-z7sjk\" (UID: \"081c2d95-9307-4ea5-bac0-601220da8858\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.548998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.548285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" Jun 11 16:19:57.555319 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.555296 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzzmh" Jun 11 16:19:57.557376 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.557360 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3bb737_1f85_4e6e_9aee_eba4574f8dcf.slice/crio-e33c92e2787742e8e603866a33dd602eae86c35b6438faaff63be2ad95246d4b WatchSource:0}: Error finding container e33c92e2787742e8e603866a33dd602eae86c35b6438faaff63be2ad95246d4b: Status 404 returned error can't find the container with id e33c92e2787742e8e603866a33dd602eae86c35b6438faaff63be2ad95246d4b Jun 11 16:19:57.562599 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.562578 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf864790_82a7_4fa9_a810_d7fdf64121f9.slice/crio-d2a27435b1c5170c4c2c66909e5b896c508f991210266397393b620af414af39 WatchSource:0}: Error finding container d2a27435b1c5170c4c2c66909e5b896c508f991210266397393b620af414af39: Status 404 returned error can't find the container with id d2a27435b1c5170c4c2c66909e5b896c508f991210266397393b620af414af39 Jun 11 16:19:57.563263 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.563246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" Jun 11 16:19:57.567568 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.567553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-llk2g" Jun 11 16:19:57.572256 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.571003 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff08b01_d622_4494_b0d7_013c5784a161.slice/crio-9ce6b16f41d9bacb2e6b4cf937d5c045263097e26439ac0dfa5a85add6268208 WatchSource:0}: Error finding container 9ce6b16f41d9bacb2e6b4cf937d5c045263097e26439ac0dfa5a85add6268208: Status 404 returned error can't find the container with id 9ce6b16f41d9bacb2e6b4cf937d5c045263097e26439ac0dfa5a85add6268208 Jun 11 16:19:57.572566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.572548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:19:57.576490 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.576473 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c85d627_8695_4a1c_afe0_df7d5f55bddf.slice/crio-3bb9a71808b8dcaae902cb6ad1a917c0e9ec35e6c2bd2a9572baece35b482a7e WatchSource:0}: Error finding container 3bb9a71808b8dcaae902cb6ad1a917c0e9ec35e6c2bd2a9572baece35b482a7e: Status 404 returned error can't find the container with id 3bb9a71808b8dcaae902cb6ad1a917c0e9ec35e6c2bd2a9572baece35b482a7e Jun 11 16:19:57.578437 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.578418 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2r7dk" Jun 11 16:19:57.580199 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.580182 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4befebd6_db8b_4372_9075_a3295859fe9a.slice/crio-c4d34dd2e48f4aa467b1cb238827158b206faa56c09b2469a16dc33973cc6696 WatchSource:0}: Error finding container c4d34dd2e48f4aa467b1cb238827158b206faa56c09b2469a16dc33973cc6696: Status 404 returned error can't find the container with id c4d34dd2e48f4aa467b1cb238827158b206faa56c09b2469a16dc33973cc6696 Jun 11 16:19:57.584408 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.584390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lp2s7" Jun 11 16:19:57.586867 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.586846 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458a36dd_6930_443e_9dda_94ba59f28d93.slice/crio-f955d8a086e52ec746e18d05b2a50d50031af948981a659f9797ddcfc3a533cc WatchSource:0}: Error finding container f955d8a086e52ec746e18d05b2a50d50031af948981a659f9797ddcfc3a533cc: Status 404 returned error can't find the container with id f955d8a086e52ec746e18d05b2a50d50031af948981a659f9797ddcfc3a533cc Jun 11 16:19:57.589564 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.589548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:19:57.591929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.591910 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:57.593963 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.593941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" Jun 11 16:19:57.594309 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.594272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0093eae_6251_4dd4_b15c_ed254f5cd222.slice/crio-6222a5182dab2ee8c15a3052a8db5b9f5e4ecdf108ab003f76240900455bc3c7 WatchSource:0}: Error finding container 6222a5182dab2ee8c15a3052a8db5b9f5e4ecdf108ab003f76240900455bc3c7: Status 404 returned error can't find the container with id 6222a5182dab2ee8c15a3052a8db5b9f5e4ecdf108ab003f76240900455bc3c7 Jun 11 16:19:57.599790 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.599761 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081c2d95_9307_4ea5_bac0_601220da8858.slice/crio-13967862b92dedb6e30fd89fad32d20f0c6c61a348ffc2080a9d7d0d5c5790bd WatchSource:0}: Error finding container 13967862b92dedb6e30fd89fad32d20f0c6c61a348ffc2080a9d7d0d5c5790bd: Status 404 returned error can't find the container with id 13967862b92dedb6e30fd89fad32d20f0c6c61a348ffc2080a9d7d0d5c5790bd Jun 11 16:19:57.604689 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:19:57.604666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb899cc_587e_4799_9cd2_973c1d198ecf.slice/crio-4d5dde547edbcb1f8ed9d33cf63b956885b111f0ae770d7cbecf70bac20a89fb WatchSource:0}: Error finding container 4d5dde547edbcb1f8ed9d33cf63b956885b111f0ae770d7cbecf70bac20a89fb: Status 404 returned error can't find the container with id 4d5dde547edbcb1f8ed9d33cf63b956885b111f0ae770d7cbecf70bac20a89fb Jun 11 16:19:57.865709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.865622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:57.865709 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.865694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:57.865919 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.865854 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:57.865919 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.865911 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:19:58.865892971 +0000 UTC m=+3.031859123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:57.866319 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.866298 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:57.866411 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.866355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:58.866339689 +0000 UTC m=+3.032305841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:57.967095 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:57.966879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:57.967095 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.967089 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:57.967291 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.967109 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:57.967291 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.967121 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:57.967291 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:57.967184 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:58.967167312 +0000 UTC m=+3.133133472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:58.342489 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.342451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lp2s7" event={"ID":"b0093eae-6251-4dd4-b15c-ed254f5cd222","Type":"ContainerStarted","Data":"6222a5182dab2ee8c15a3052a8db5b9f5e4ecdf108ab003f76240900455bc3c7"} Jun 11 16:19:58.347325 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.347293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2r7dk" event={"ID":"458a36dd-6930-443e-9dda-94ba59f28d93","Type":"ContainerStarted","Data":"f955d8a086e52ec746e18d05b2a50d50031af948981a659f9797ddcfc3a533cc"} Jun 11 16:19:58.348867 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.348797 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:57 +0000 UTC" deadline="2028-02-09 13:22:49.307982984 +0000 UTC" Jun 11 16:19:58.348867 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.348826 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14589h2m50.9591615s" Jun 11 16:19:58.355746 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.355589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-llk2g" event={"ID":"6c85d627-8695-4a1c-afe0-df7d5f55bddf","Type":"ContainerStarted","Data":"3bb9a71808b8dcaae902cb6ad1a917c0e9ec35e6c2bd2a9572baece35b482a7e"} Jun 11 16:19:58.363220 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.362982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" event={"ID":"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf","Type":"ContainerStarted","Data":"e33c92e2787742e8e603866a33dd602eae86c35b6438faaff63be2ad95246d4b"} Jun 11 16:19:58.369394 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.369368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"13967862b92dedb6e30fd89fad32d20f0c6c61a348ffc2080a9d7d0d5c5790bd"} Jun 11 16:19:58.377629 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.377552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbqq8" event={"ID":"4befebd6-db8b-4372-9075-a3295859fe9a","Type":"ContainerStarted","Data":"c4d34dd2e48f4aa467b1cb238827158b206faa56c09b2469a16dc33973cc6696"} Jun 11 16:19:58.379845 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.379823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerStarted","Data":"9ce6b16f41d9bacb2e6b4cf937d5c045263097e26439ac0dfa5a85add6268208"} Jun 11 16:19:58.384620 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.384595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzzmh" event={"ID":"af864790-82a7-4fa9-a810-d7fdf64121f9","Type":"ContainerStarted","Data":"d2a27435b1c5170c4c2c66909e5b896c508f991210266397393b620af414af39"} Jun 11 16:19:58.386759 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.386735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" event={"ID":"3bb899cc-587e-4799-9cd2-973c1d198ecf","Type":"ContainerStarted","Data":"4d5dde547edbcb1f8ed9d33cf63b956885b111f0ae770d7cbecf70bac20a89fb"} Jun 11 16:19:58.654506 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.654473 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:58.875307 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.874927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:58.875307 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.874986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:58.875307 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.875128 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:58.875307 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.875188 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.875169379 +0000 UTC m=+5.041135538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:58.875629 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.875563 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:58.875629 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.875608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.875594153 +0000 UTC m=+5.041560303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:58.975584 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:58.975494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:58.975732 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.975690 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:58.975732 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.975713 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:58.975732 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.975725 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:58.975892 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:58.975783 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.975765654 +0000 UTC m=+5.141731803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:59.324562 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.324476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:19:59.324725 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:59.324626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:19:59.325027 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.325007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:19:59.325143 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:59.325123 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:19:59.325213 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.325189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:19:59.325306 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:19:59.325253 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:19:59.350000 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.349962 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:57 +0000 UTC" deadline="2028-01-27 03:01:06.46144045 +0000 UTC" Jun 11 16:19:59.350000 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.349997 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14266h41m7.111447777s" Jun 11 16:19:59.605191 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:19:59.605114 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:20:00.891846 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:00.891795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:00.892302 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:00.891860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:00.892302 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.891950 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:00.892302 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.891973 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.892302 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.892009 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:04.891994472 +0000 UTC m=+9.057960621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:00.892302 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.892024 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:20:04.892017059 +0000 UTC m=+9.057983204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.992804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:00.992768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:00.992987 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.992967 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:00.993061 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.992992 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:00.993061 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.993002 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:00.993061 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:00.993058 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:04.993039631 +0000 UTC m=+9.159005790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:01.324493 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:01.324414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:01.324655 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:01.324527 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:01.324655 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:01.324578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:01.324655 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:01.324615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:01.324803 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:01.324718 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:01.324803 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:01.324791 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:03.324446 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:03.324396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:03.324903 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:03.324450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:03.324903 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:03.324555 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:03.324903 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:03.324631 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:03.324903 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:03.324682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:03.324903 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:03.324771 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:04.928699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:04.928657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:04.929183 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:04.928746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:04.929183 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:04.928802 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:04.929183 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:04.928873 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:20:12.928851793 +0000 UTC m=+17.094817948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:04.929183 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:04.928879 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:04.929183 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:04.928939 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:12.928920643 +0000 UTC m=+17.094886791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:05.029402 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:05.029366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:05.029584 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.029525 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:05.029584 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.029542 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:05.029584 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.029557 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:05.029744 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.029611 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:13.029596119 +0000 UTC m=+17.195562265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:05.324764 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:05.324680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:05.324764 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:05.324724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:05.324969 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:05.324680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:05.324969 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.324810 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:05.324969 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.324871 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:05.324969 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:05.324938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:07.325191 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:07.325156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:07.325191 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:07.325200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:07.325658 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:07.325196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:07.325658 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:07.325319 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:07.325658 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:07.325383 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:07.325658 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:07.325476 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:09.324348 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:09.324271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:09.324807 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:09.324271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:09.324807 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:09.324432 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:09.324807 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:09.324483 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:09.324807 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:09.324271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:09.324807 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:09.324567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:11.324616 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:11.324550 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:11.325050 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:11.324619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:11.325050 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:11.324580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:11.325050 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:11.324695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:11.325050 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:11.324792 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:11.325050 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:11.324882 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:12.431184 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:12.431161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" event={"ID":"eb29ebae2d068e8f9fd0436c62039ef2","Type":"ContainerStarted","Data":"4ecfe0307f0027f47bf429203da91bea24589221d7075bff73e0047a275ebbbb"} Jun 11 16:20:12.447961 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:12.447912 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-97.ec2.internal" podStartSLOduration=15.447898727 podStartE2EDuration="15.447898727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:12.447216033 +0000 UTC m=+16.613182202" watchObservedRunningTime="2026-06-11 16:20:12.447898727 +0000 UTC m=+16.613864895" Jun 11 16:20:12.990323 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:12.990292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:12.990549 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:12.990351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:12.990549 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:12.990447 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:12.990549 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:12.990524 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:28.990494134 +0000 UTC m=+33.156460282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:12.990549 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:12.990449 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:12.990720 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:12.990605 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:20:28.990587958 +0000 UTC m=+33.156554119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:13.090921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.090889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:13.091102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.091041 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:13.091102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.091077 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:13.091102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.091092 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:13.091221 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.091142 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:29.09112838 +0000 UTC m=+33.257094530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:13.324583 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.324503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:13.324583 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.324535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:13.324779 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.324690 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:13.327659 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.325246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:13.327659 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.325295 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:13.327659 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:13.325567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:13.442692 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.442508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-llk2g" event={"ID":"6c85d627-8695-4a1c-afe0-df7d5f55bddf","Type":"ContainerStarted","Data":"406d3f571bcbf33ff55af9f0ad96be0aefb523a4b039abcd84f0f4f6f90576bf"} Jun 11 16:20:13.445924 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.445884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" event={"ID":"7a3bb737-1f85-4e6e-9aee-eba4574f8dcf","Type":"ContainerStarted","Data":"274dd0141d54cc6640b2b4e8384c24070cb7c37c02ded1e110d8fe683e34cc6e"} Jun 11 16:20:13.466910 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.466427 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-llk2g" podStartSLOduration=2.637162329 podStartE2EDuration="17.466405411s" totalImagesPullingTime="14.829243082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:13.465147465 +0000 UTC m=+17.631113635" watchObservedRunningTime="2026-06-11 16:20:13.466405411 +0000 UTC m=+17.632371577" Jun 11 16:20:13.491812 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:13.491760 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8rgj7" podStartSLOduration=2.952392571 podStartE2EDuration="17.491742769s" totalImagesPullingTime="14.539350198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:13.491305737 +0000 UTC m=+17.657271909" watchObservedRunningTime="2026-06-11 16:20:13.491742769 +0000 UTC m=+17.657708937" Jun 11 16:20:14.449511 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.449476 2562 generic.go:356] "Generic (PLEG): container finished" podID="6110a9d5088c149c8dbb594596ceab3d" containerID="a7f49d8426f816a059b4d6a1ff407db73213f038d677f392bd161923ba8ac30f" exitCode=0 Jun 11 16:20:14.450090 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.449547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" event={"ID":"6110a9d5088c149c8dbb594596ceab3d","Type":"ContainerDied","Data":"a7f49d8426f816a059b4d6a1ff407db73213f038d677f392bd161923ba8ac30f"} Jun 11 16:20:14.451187 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.451135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbqq8" event={"ID":"4befebd6-db8b-4372-9075-a3295859fe9a","Type":"ContainerStarted","Data":"6659013f41c898d6d5bd0b5dad0581c0ac31c57654dde349fbdb45be83717ab6"} Jun 11 16:20:14.452804 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.452779 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="ee98ec09c80cb6cd52c0c8cfa8146a2d6a549435ef2353ede1889783a7155914" exitCode=0 Jun 11 16:20:14.452923 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.452834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"ee98ec09c80cb6cd52c0c8cfa8146a2d6a549435ef2353ede1889783a7155914"} Jun 11 16:20:14.454459 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.454436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzzmh" event={"ID":"af864790-82a7-4fa9-a810-d7fdf64121f9","Type":"ContainerStarted","Data":"be87fd5acd7e50fde8bb39f36fc3bc053bba149aa59935431ccb9468d6f978e1"} Jun 11 16:20:14.456188 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.456165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" event={"ID":"3bb899cc-587e-4799-9cd2-973c1d198ecf","Type":"ContainerStarted","Data":"23240fa6224a69fa16f84f5dab5f2980deb42c8e5a1c11c3ae69684dca0b8282"} Jun 11 16:20:14.457698 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.457675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lp2s7" event={"ID":"b0093eae-6251-4dd4-b15c-ed254f5cd222","Type":"ContainerStarted","Data":"51592d72da66f28760f11692ec0fef015192cdfcca8d89a35896a682faeef364"} Jun 11 16:20:14.459087 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.459050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2r7dk" event={"ID":"458a36dd-6930-443e-9dda-94ba59f28d93","Type":"ContainerStarted","Data":"ba93153fe4ef911974b946d6fee1f3b6d1668842323037ec830285497acfd9fc"} Jun 11 16:20:14.507876 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.507826 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kzzmh" podStartSLOduration=3.975241914 podStartE2EDuration="18.507805648s" totalImagesPullingTime="14.532563734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:14.488757168 +0000 UTC m=+18.654723337" watchObservedRunningTime="2026-06-11 16:20:14.507805648 +0000 UTC m=+18.673771817" Jun 11 16:20:14.508371 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.508342 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2r7dk" podStartSLOduration=3.999681113 podStartE2EDuration="18.508331437s" totalImagesPullingTime="14.508650324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:14.508316083 +0000 UTC m=+18.674282252" watchObservedRunningTime="2026-06-11 16:20:14.508331437 +0000 UTC m=+18.674297604" Jun 11 16:20:14.558234 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.558192 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lp2s7" podStartSLOduration=4.051889643 podStartE2EDuration="18.558177326s" totalImagesPullingTime="14.506287683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:14.530299232 +0000 UTC m=+18.696265401" watchObservedRunningTime="2026-06-11 16:20:14.558177326 +0000 UTC m=+18.724143493" Jun 11 16:20:14.573026 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.572968 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbqq8" podStartSLOduration=4.058503775 podStartE2EDuration="18.572948884s" totalImagesPullingTime="14.514445109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:14.572335102 +0000 UTC m=+18.738301271" watchObservedRunningTime="2026-06-11 16:20:14.572948884 +0000 UTC m=+18.738915048" Jun 11 16:20:14.621769 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:14.621741 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:20:15.325146 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.325115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:15.325146 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.325134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:15.325366 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.325136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:15.325366 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:15.325235 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:15.325462 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:15.325378 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:15.325509 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:15.325461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:15.327162 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.327075 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:20:14.621761659Z","UUID":"41c02e83-d085-4509-a64c-4025a68e91d5","Handler":null,"Name":"","Endpoint":""} Jun 11 16:20:15.329123 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.329099 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:20:15.329243 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.329152 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:20:15.464184 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.464144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" event={"ID":"3bb899cc-587e-4799-9cd2-973c1d198ecf","Type":"ContainerStarted","Data":"18ba9cdcb9cf48d5be2a071a1daf9451a958bfdd0faa9df6f38f89576d14c1d5"} Jun 11 16:20:15.466385 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.466342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" event={"ID":"6110a9d5088c149c8dbb594596ceab3d","Type":"ContainerStarted","Data":"88de1138283ca7d14dc89ebe56d8e10a4fd80680ce5fa16d754048e62bef01f7"} Jun 11 16:20:15.950710 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.950673 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:20:15.951716 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.951690 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:20:15.974194 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:15.974142 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-97.ec2.internal" podStartSLOduration=18.974122396 podStartE2EDuration="18.974122396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:15.497808422 +0000 UTC m=+19.663774590" watchObservedRunningTime="2026-06-11 16:20:15.974122396 +0000 UTC m=+20.140088567" Jun 11 16:20:16.471329 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:16.469700 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:20:16.471329 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:16.470438 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbqq8" Jun 11 16:20:17.324814 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:17.324781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:17.325051 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:17.324780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:17.325051 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:17.324902 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:17.325051 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:17.324916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:17.325051 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:17.325009 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:17.325229 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:17.325091 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:19.324780 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:19.324750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:19.325411 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:19.324750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:19.325411 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:19.324749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:19.325411 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:19.324897 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:19.325411 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:19.324965 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:19.325411 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:19.325047 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:21.324647 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:21.324617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:21.325174 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:21.324615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:21.325174 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:21.324763 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:21.325174 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:21.324617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:21.325174 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:21.324806 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:21.325174 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:21.324876 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:22.482856 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.482738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" event={"ID":"3bb899cc-587e-4799-9cd2-973c1d198ecf","Type":"ContainerStarted","Data":"316bdbc5548ea6060e5a98f700e9c597e05f1e1687788f2afa7ce09a849557eb"} Jun 11 16:20:22.486111 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.486091 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:20:22.486501 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.486479 2562 generic.go:356] "Generic (PLEG): container finished" podID="081c2d95-9307-4ea5-bac0-601220da8858" containerID="853a337ba7207e4630f536d0862a94583f03cd97e62e8fcbf27b54b2cc37b603" exitCode=1 Jun 11 16:20:22.486592 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.486550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerDied","Data":"853a337ba7207e4630f536d0862a94583f03cd97e62e8fcbf27b54b2cc37b603"} Jun 11 16:20:22.486720 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.486687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"351802ff0a82b7a8fb3a8c1ef811b80f53d8bb04f65de36cba117ad5a70180ac"} Jun 11 16:20:22.488618 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.488590 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="4cf90ccbdcad6aefb3a201bbe929d88532a87319038c41a991a629bdf04e54f7" exitCode=0 Jun 11 16:20:22.488729 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.488632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"4cf90ccbdcad6aefb3a201bbe929d88532a87319038c41a991a629bdf04e54f7"} Jun 11 16:20:22.507894 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:22.507856 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzlvz" podStartSLOduration=3.563885656 podStartE2EDuration="26.50784291s" totalImagesPullingTime="22.943957254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:22.507385605 +0000 UTC m=+26.673351772" watchObservedRunningTime="2026-06-11 16:20:22.50784291 +0000 UTC m=+26.673809101" Jun 11 16:20:23.325234 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.325187 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:23.325492 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.325201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:23.325492 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:23.325321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:23.325492 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.325343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:23.325492 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:23.325418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:23.325719 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:23.325588 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:23.494142 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.494078 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:20:23.494735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.494447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"27c16e6966eafd8ec584d8f7076ec0211c7835eb3bad71f5b60bb7a9e448d529"} Jun 11 16:20:23.494735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.494547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"91c9a880aab50df04d9c8abafec207e8140f8be00318c3bf80474bcd6fa84a38"} Jun 11 16:20:23.494735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.494580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"b4044190a106df03b77f6cd48d1de6528d0841ac9ce007b557d0a539b5ce2cca"} Jun 11 16:20:23.494735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:23.494607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"df9598630a2d493447f7d76741198ab798435a83073c8296a6de980c27f64025"} Jun 11 16:20:24.498957 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:24.498923 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="f693d0ac2c8de331252d4daa20645ea060ac5104ceb769d89c0b0558736ada54" exitCode=0 Jun 11 16:20:24.499526 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:24.498965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"f693d0ac2c8de331252d4daa20645ea060ac5104ceb769d89c0b0558736ada54"} Jun 11 16:20:25.324849 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:25.324813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:25.325009 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:25.324910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:25.325009 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:25.324920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:25.325009 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:25.324938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:25.325134 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:25.325013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:25.325134 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:25.325100 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:25.503526 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:25.503500 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:20:25.503905 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:25.503804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"9809f96da786af0bab871e994a6800e41c50dceb086244d14e95b9bec9c57744"} Jun 11 16:20:26.507790 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:26.507752 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="b774ff84f8bf2beca2cc13d300c149e99d6540f88468f04c3e0cbafe9b3cf6f1" exitCode=0 Jun 11 16:20:26.508178 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:26.507804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"b774ff84f8bf2beca2cc13d300c149e99d6540f88468f04c3e0cbafe9b3cf6f1"} Jun 11 16:20:27.324507 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.324211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:27.324507 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.324252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:27.324720 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:27.324549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:27.324720 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.324279 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:27.324720 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:27.324582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:27.324867 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:27.324718 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:27.513917 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.513890 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:20:27.514462 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.514358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"339a7e6d4e3f18f5917cbf9c7f2f255942c558105e8e8e3d235e20d5878f95c3"} Jun 11 16:20:27.514724 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.514696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:20:27.514950 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.514924 2562 scope.go:117] "RemoveContainer" containerID="853a337ba7207e4630f536d0862a94583f03cd97e62e8fcbf27b54b2cc37b603" Jun 11 16:20:27.533192 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:27.533169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:20:28.521636 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.521611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:20:28.522101 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.521994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" event={"ID":"081c2d95-9307-4ea5-bac0-601220da8858","Type":"ContainerStarted","Data":"3fa331a524ae2c809ce9a6266efda249690118c5a722e4d4d9ccdd4d03df9682"} Jun 11 16:20:28.522259 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.522237 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:20:28.522402 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.522315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:20:28.539234 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.539199 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:20:28.557891 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:28.557837 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" podStartSLOduration=7.9801550070000005 podStartE2EDuration="32.557815528s" totalImagesPullingTime="24.577660521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:28.556447182 +0000 UTC m=+32.722413354" watchObservedRunningTime="2026-06-11 16:20:28.557815528 +0000 UTC m=+32.723781699" Jun 11 16:20:29.015116 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.015078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:29.015375 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.015195 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:29.015375 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.015201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:29.015375 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.015260 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret podName:e8aea942-23de-4019-a7e7-0dab4f206e5b nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.015245684 +0000 UTC m=+65.181211831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret") pod "global-pull-secret-syncer-klqv4" (UID: "e8aea942-23de-4019-a7e7-0dab4f206e5b") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:29.015375 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.015294 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:29.015375 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.015349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.015333793 +0000 UTC m=+65.181299950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:29.116004 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.115969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:29.116234 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.116178 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:29.116234 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.116203 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:29.116234 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.116216 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lbv48 for pod openshift-network-diagnostics/network-check-target-bmvpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:29.116367 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.116284 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48 podName:96871d1b-13b6-4295-9bc1-f63ab33452e7 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.116265141 +0000 UTC m=+65.282231304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbv48" (UniqueName: "kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48") pod "network-check-target-bmvpl" (UID: "96871d1b-13b6-4295-9bc1-f63ab33452e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:29.324710 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.324622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:29.324710 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.324669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:29.324932 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.324637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:29.324932 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.324751 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:29.324932 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.324862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:29.325109 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.324952 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:29.447297 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.447237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klqv4"] Jun 11 16:20:29.448190 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.448161 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-545xm"] Jun 11 16:20:29.451765 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.449547 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmvpl"] Jun 11 16:20:29.524789 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.524762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:29.524789 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.524777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:29.524789 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:29.524762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:29.525367 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.524912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:29.525423 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.525369 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:29.525507 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:29.525483 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:31.324688 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:31.324619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:31.325102 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:31.324619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:31.325102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:31.324735 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:31.325102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:31.324821 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:31.325102 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:31.324619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:31.325102 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:31.324930 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:31.532354 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:31.532320 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="da681d9ace2e6e1ce5b8a459d40261b118d0eb158b60dcfd7f5fdaf92003c254" exitCode=0 Jun 11 16:20:31.532542 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:31.532376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"da681d9ace2e6e1ce5b8a459d40261b118d0eb158b60dcfd7f5fdaf92003c254"} Jun 11 16:20:32.537169 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:32.537126 2562 generic.go:356] "Generic (PLEG): container finished" podID="aff08b01-d622-4494-b0d7-013c5784a161" containerID="efc1acc2c738a5d7b82c8e1537b6f1c1819bcff500860c3fdd63993808abb312" exitCode=0 Jun 11 16:20:32.537707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:32.537180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerDied","Data":"efc1acc2c738a5d7b82c8e1537b6f1c1819bcff500860c3fdd63993808abb312"} Jun 11 16:20:33.324537 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:33.324492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:33.324733 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:33.324594 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmvpl" podUID="96871d1b-13b6-4295-9bc1-f63ab33452e7" Jun 11 16:20:33.324733 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:33.324610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:33.324733 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:33.324492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:33.324733 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:33.324721 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klqv4" podUID="e8aea942-23de-4019-a7e7-0dab4f206e5b" Jun 11 16:20:33.324997 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:33.324782 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-545xm" podUID="6b9aca90-c5f9-4148-8828-c00413fdb478" Jun 11 16:20:33.542290 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:33.542258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" event={"ID":"aff08b01-d622-4494-b0d7-013c5784a161","Type":"ContainerStarted","Data":"09e964ab9ac2ca356c1b8bb125bbe7bb26239d5e8c1eb4c98b2ed24b48af4e53"} Jun 11 16:20:33.566224 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:33.566173 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4tr6" podStartSLOduration=8.695156257 podStartE2EDuration="37.56615519s" totalImagesPullingTime="28.870998933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:33.566009956 +0000 UTC m=+37.731976125" watchObservedRunningTime="2026-06-11 16:20:33.56615519 +0000 UTC m=+37.732121359" Jun 11 16:20:34.166153 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.166128 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-97.ec2.internal" event="NodeReady" Jun 11 16:20:34.166278 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.166249 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:20:34.226433 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.226400 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sdx5w"] Jun 11 16:20:34.229121 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.229104 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nz5lx"] Jun 11 16:20:34.229232 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.229214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.231054 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.231034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.232050 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.232033 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:20:34.232171 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.232148 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:20:34.232219 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.232207 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ddd7\"" Jun 11 16:20:34.233394 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.233374 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:20:34.233489 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.233445 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:20:34.233489 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.233459 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5g5xx\"" Jun 11 16:20:34.233489 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.233478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:20:34.240525 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.240503 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdx5w"] Jun 11 16:20:34.257959 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.257934 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nz5lx"] Jun 11 16:20:34.350938 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.350861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26dkh\" (UniqueName: \"kubernetes.io/projected/cff79bb3-476e-46e0-9a92-845bcee811a0-kube-api-access-26dkh\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.350938 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.350913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.350938 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.350929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cm7\" (UniqueName: \"kubernetes.io/projected/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-kube-api-access-27cm7\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.351208 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.350948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff79bb3-476e-46e0-9a92-845bcee811a0-cert\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.351208 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.351012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-config-volume\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.351208 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.351086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-tmp-dir\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452276 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-tmp-dir\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26dkh\" (UniqueName: \"kubernetes.io/projected/cff79bb3-476e-46e0-9a92-845bcee811a0-kube-api-access-26dkh\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.452445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cm7\" (UniqueName: \"kubernetes.io/projected/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-kube-api-access-27cm7\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff79bb3-476e-46e0-9a92-845bcee811a0-cert\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.452445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-config-volume\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452656 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:34.452634 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:34.452730 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:34.452716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:34.952693082 +0000 UTC m=+39.118659245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:20:34.452730 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452636 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-tmp-dir\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.452939 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.452918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-config-volume\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.456599 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.456575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff79bb3-476e-46e0-9a92-845bcee811a0-cert\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.461189 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.461165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cm7\" (UniqueName: \"kubernetes.io/projected/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-kube-api-access-27cm7\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.461529 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.461512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26dkh\" (UniqueName: \"kubernetes.io/projected/cff79bb3-476e-46e0-9a92-845bcee811a0-kube-api-access-26dkh\") pod \"ingress-canary-nz5lx\" (UID: \"cff79bb3-476e-46e0-9a92-845bcee811a0\") " pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.545012 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.544983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nz5lx" Jun 11 16:20:34.676312 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.676059 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nz5lx"] Jun 11 16:20:34.680368 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:20:34.680344 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff79bb3_476e_46e0_9a92_845bcee811a0.slice/crio-5e89eba9b8299522b672a663af143f1f15a880e071867a05504326021e8a7927 WatchSource:0}: Error finding container 5e89eba9b8299522b672a663af143f1f15a880e071867a05504326021e8a7927: Status 404 returned error can't find the container with id 5e89eba9b8299522b672a663af143f1f15a880e071867a05504326021e8a7927 Jun 11 16:20:34.956645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:34.956548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:34.956824 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:34.956691 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:34.956824 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:34.956772 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:35.956751803 +0000 UTC m=+40.122717964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:20:35.324792 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.324712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:20:35.324967 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.324721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:20:35.324967 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.324721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:20:35.328079 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.328050 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ftdt\"" Jun 11 16:20:35.328215 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.328102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:20:35.329282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.329022 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:20:35.329282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.329119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:20:35.329282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.329187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-49ftn\"" Jun 11 16:20:35.329282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.329256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:20:35.549216 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.549183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nz5lx" event={"ID":"cff79bb3-476e-46e0-9a92-845bcee811a0","Type":"ContainerStarted","Data":"5e89eba9b8299522b672a663af143f1f15a880e071867a05504326021e8a7927"} Jun 11 16:20:35.964122 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:35.964080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:35.964308 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:35.964246 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:35.964375 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:35.964325 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:37.964303768 +0000 UTC m=+42.130269918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:20:37.555618 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:37.555583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nz5lx" event={"ID":"cff79bb3-476e-46e0-9a92-845bcee811a0","Type":"ContainerStarted","Data":"06b66ccacfd8039ff44c6f304565b14b2f486fdd808c5c5c12674c50f01e65b7"} Jun 11 16:20:37.572947 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:37.572894 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nz5lx" podStartSLOduration=1.794918124 podStartE2EDuration="3.57287995s" totalImagesPullingTime="1.777961826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:37.572453377 +0000 UTC m=+41.738419545" watchObservedRunningTime="2026-06-11 16:20:37.57287995 +0000 UTC m=+41.738846117" Jun 11 16:20:37.977377 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:37.977334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:37.977552 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:37.977484 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:37.977552 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:37.977549 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:41.977534266 +0000 UTC m=+46.143500412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:20:42.005276 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:42.005234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:42.005662 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:42.005389 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:42.005662 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:42.005450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:50.005434119 +0000 UTC m=+54.171400265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:20:50.063382 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:20:50.063194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:20:50.063925 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:50.063337 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:50.063925 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:20:50.063506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:06.063492383 +0000 UTC m=+70.229458534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:21:00.537165 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:00.537140 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7sjk" Jun 11 16:21:01.038690 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.038642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:21:01.038886 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.038711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:21:01.040990 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.040961 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:21:01.041132 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.041031 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:21:01.049031 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.049000 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:21:01.049175 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.049123 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs podName:6b9aca90-c5f9-4148-8828-c00413fdb478 nodeName:}" failed. No retries permitted until 2026-06-11 16:22:05.049103905 +0000 UTC m=+129.215070066 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs") pod "network-metrics-daemon-545xm" (UID: "6b9aca90-c5f9-4148-8828-c00413fdb478") : secret "metrics-daemon-secret" not found Jun 11 16:21:01.052998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.052973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8aea942-23de-4019-a7e7-0dab4f206e5b-original-pull-secret\") pod \"global-pull-secret-syncer-klqv4\" (UID: \"e8aea942-23de-4019-a7e7-0dab4f206e5b\") " pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:21:01.113336 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.113307 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-2tmnk"] Jun 11 16:21:01.117108 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.117093 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg"] Jun 11 16:21:01.117237 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.117222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.119145 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.119578 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119546 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 16:21:01.119578 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:21:01.119705 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 16:21:01.119705 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119570 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zp6lk\"" Jun 11 16:21:01.119793 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.119546 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:21:01.121259 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.121244 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:21:01.121320 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.121304 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 16:21:01.122193 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.122175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qd8zp\"" Jun 11 16:21:01.122274 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.122232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 16:21:01.124493 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.124476 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:21:01.128909 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.128889 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 16:21:01.130638 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.130601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg"] Jun 11 16:21:01.131326 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.131303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2tmnk"] Jun 11 16:21:01.139649 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-tmp\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139748 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1016106-7e6e-4653-b059-2905d0f869c5-serving-cert\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139748 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-trusted-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139748 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njp8f\" (UniqueName: \"kubernetes.io/projected/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-kube-api-access-njp8f\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.139748 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.139921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-service-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9q26\" (UniqueName: \"kubernetes.io/projected/d1016106-7e6e-4653-b059-2905d0f869c5-kube-api-access-n9q26\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-snapshots\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.139921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.139921 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.139902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:21:01.142303 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.142288 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:21:01.144380 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.144366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klqv4" Jun 11 16:21:01.154385 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.154369 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:21:01.162974 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.162952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbv48\" (UniqueName: \"kubernetes.io/projected/96871d1b-13b6-4295-9bc1-f63ab33452e7-kube-api-access-lbv48\") pod \"network-check-target-bmvpl\" (UID: \"96871d1b-13b6-4295-9bc1-f63ab33452e7\") " pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:21:01.214551 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.214526 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj"] Jun 11 16:21:01.216680 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.216665 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.221028 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.221002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 16:21:01.222332 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.222310 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 16:21:01.223458 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.222888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:21:01.223458 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.223045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 16:21:01.223458 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.223132 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-prksz\"" Jun 11 16:21:01.231635 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.231612 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj"] Jun 11 16:21:01.240851 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.240831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-service-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.240960 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.240861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9q26\" (UniqueName: \"kubernetes.io/projected/d1016106-7e6e-4653-b059-2905d0f869c5-kube-api-access-n9q26\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.240960 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.240887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfpw\" (UniqueName: \"kubernetes.io/projected/8071868a-90be-48e4-be98-c7234df42cee-kube-api-access-dpfpw\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.240960 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.240906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-snapshots\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241131 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.241131 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8071868a-90be-48e4-be98-c7234df42cee-config\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.241131 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-tmp\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241281 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.241183 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:01.241281 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.241250 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.741231482 +0000 UTC m=+65.907197648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:01.241281 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1016106-7e6e-4653-b059-2905d0f869c5-serving-cert\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241443 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8071868a-90be-48e4-be98-c7234df42cee-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.241443 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-trusted-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241443 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njp8f\" (UniqueName: \"kubernetes.io/projected/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-kube-api-access-njp8f\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.241443 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.241632 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-tmp\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241632 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1016106-7e6e-4653-b059-2905d0f869c5-snapshots\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.241632 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.241553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-service-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.242256 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.242235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.242695 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.242679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1016106-7e6e-4653-b059-2905d0f869c5-trusted-ca-bundle\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.243550 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.243531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1016106-7e6e-4653-b059-2905d0f869c5-serving-cert\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.251468 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.251447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9q26\" (UniqueName: \"kubernetes.io/projected/d1016106-7e6e-4653-b059-2905d0f869c5-kube-api-access-n9q26\") pod \"insights-operator-896549976-2tmnk\" (UID: \"d1016106-7e6e-4653-b059-2905d0f869c5\") " pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.251660 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.251643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njp8f\" (UniqueName: \"kubernetes.io/projected/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-kube-api-access-njp8f\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.270576 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.270552 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klqv4"] Jun 11 16:21:01.273614 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:01.273593 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8aea942_23de_4019_a7e7_0dab4f206e5b.slice/crio-7898a8f8927892fc800c2635997f87b28ecf790b89a8a0220b7e3b012233b1ea WatchSource:0}: Error finding container 7898a8f8927892fc800c2635997f87b28ecf790b89a8a0220b7e3b012233b1ea: Status 404 returned error can't find the container with id 7898a8f8927892fc800c2635997f87b28ecf790b89a8a0220b7e3b012233b1ea Jun 11 16:21:01.322507 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.322451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:21:01.325546 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.325532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.328843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.328827 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:21:01.329257 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.329232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:21:01.329516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.329497 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrx8j\"" Jun 11 16:21:01.330008 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.329992 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:21:01.338944 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.338926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:21:01.342182 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8071868a-90be-48e4-be98-c7234df42cee-config\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.342275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342357 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8071868a-90be-48e4-be98-c7234df42cee-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.342357 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4l6r\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342466 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342466 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342576 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342576 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfpw\" (UniqueName: \"kubernetes.io/projected/8071868a-90be-48e4-be98-c7234df42cee-kube-api-access-dpfpw\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.342892 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.342892 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342696 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8071868a-90be-48e4-be98-c7234df42cee-config\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.342892 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.342709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.343861 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.343840 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:21:01.344685 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.344665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8071868a-90be-48e4-be98-c7234df42cee-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.356293 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.356274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfpw\" (UniqueName: \"kubernetes.io/projected/8071868a-90be-48e4-be98-c7234df42cee-kube-api-access-dpfpw\") pod \"service-ca-operator-6bc5ff68f5-hhsqj\" (UID: \"8071868a-90be-48e4-be98-c7234df42cee\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.427814 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.427788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2tmnk" Jun 11 16:21:01.443514 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4l6r\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443752 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443752 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443752 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443752 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.443720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.443949 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.443841 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:01.443949 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.443864 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:01.443949 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.443928 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:01.943906278 +0000 UTC m=+66.109872440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:01.444129 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.444038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.444335 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.444314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.444799 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.444775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.446141 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.446120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.446522 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.446497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.453880 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.453860 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ftdt\"" Jun 11 16:21:01.453880 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.453871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.454000 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.453939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4l6r\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.461784 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.461769 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:21:01.527962 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.527007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" Jun 11 16:21:01.570955 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.570919 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2tmnk"] Jun 11 16:21:01.574639 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:01.574565 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1016106_7e6e_4653_b059_2905d0f869c5.slice/crio-ae7451a0a5d54aacd321ff04de5b9de854d4080722baac01669cf97cb24fb185 WatchSource:0}: Error finding container ae7451a0a5d54aacd321ff04de5b9de854d4080722baac01669cf97cb24fb185: Status 404 returned error can't find the container with id ae7451a0a5d54aacd321ff04de5b9de854d4080722baac01669cf97cb24fb185 Jun 11 16:21:01.610525 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.610491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2tmnk" event={"ID":"d1016106-7e6e-4653-b059-2905d0f869c5","Type":"ContainerStarted","Data":"ae7451a0a5d54aacd321ff04de5b9de854d4080722baac01669cf97cb24fb185"} Jun 11 16:21:01.611585 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.611556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klqv4" event={"ID":"e8aea942-23de-4019-a7e7-0dab4f206e5b","Type":"ContainerStarted","Data":"7898a8f8927892fc800c2635997f87b28ecf790b89a8a0220b7e3b012233b1ea"} Jun 11 16:21:01.617694 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.617670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmvpl"] Jun 11 16:21:01.620252 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:01.620231 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96871d1b_13b6_4295_9bc1_f63ab33452e7.slice/crio-ddc18c54071d386e566423be27f2593cf6b466fb34e22255452b130af4a6bd55 WatchSource:0}: Error finding container ddc18c54071d386e566423be27f2593cf6b466fb34e22255452b130af4a6bd55: Status 404 returned error can't find the container with id ddc18c54071d386e566423be27f2593cf6b466fb34e22255452b130af4a6bd55 Jun 11 16:21:01.666235 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.666207 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj"] Jun 11 16:21:01.669134 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:01.669111 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8071868a_90be_48e4_be98_c7234df42cee.slice/crio-c8db6dfd5bab40e23ecf2971e8c7d989a7221ef11dac84f55ab7cb6cf9597b33 WatchSource:0}: Error finding container c8db6dfd5bab40e23ecf2971e8c7d989a7221ef11dac84f55ab7cb6cf9597b33: Status 404 returned error can't find the container with id c8db6dfd5bab40e23ecf2971e8c7d989a7221ef11dac84f55ab7cb6cf9597b33 Jun 11 16:21:01.747593 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.747542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:01.747776 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.747753 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:01.747840 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.747825 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:02.747810898 +0000 UTC m=+66.913777060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:01.949351 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:01.949315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:01.949523 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.949465 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:01.949523 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.949481 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:01.949650 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:01.949545 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:02.949524159 +0000 UTC m=+67.115490323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:02.616356 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:02.616311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmvpl" event={"ID":"96871d1b-13b6-4295-9bc1-f63ab33452e7","Type":"ContainerStarted","Data":"ddc18c54071d386e566423be27f2593cf6b466fb34e22255452b130af4a6bd55"} Jun 11 16:21:02.618422 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:02.618354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" event={"ID":"8071868a-90be-48e4-be98-c7234df42cee","Type":"ContainerStarted","Data":"c8db6dfd5bab40e23ecf2971e8c7d989a7221ef11dac84f55ab7cb6cf9597b33"} Jun 11 16:21:02.756630 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:02.756008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:02.756630 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:02.756205 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:02.756630 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:02.756270 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:04.756252358 +0000 UTC m=+68.922218519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:02.959099 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:02.958650 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:02.959099 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:02.958684 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:02.959099 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:02.958744 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:04.958725594 +0000 UTC m=+69.124691758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:02.959099 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:02.958739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:04.775554 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:04.775518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:04.775931 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:04.775673 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:04.775931 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:04.775754 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:08.775734289 +0000 UTC m=+72.941700436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:04.976816 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:04.976777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:04.977003 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:04.976961 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:04.977003 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:04.976984 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:04.977147 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:04.977053 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:08.97703359 +0000 UTC m=+73.142999762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:06.085574 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.085529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:06.086184 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:06.085723 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:21:06.086184 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:06.085807 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls podName:4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:38.08578601 +0000 UTC m=+102.251752180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls") pod "dns-default-sdx5w" (UID: "4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917") : secret "dns-default-metrics-tls" not found Jun 11 16:21:06.636819 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.636787 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb"] Jun 11 16:21:06.638919 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.638894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" Jun 11 16:21:06.641190 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.641167 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g4jqk\"" Jun 11 16:21:06.642083 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.642026 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 16:21:06.642083 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.642044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 16:21:06.654180 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.654159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb"] Jun 11 16:21:06.691146 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.691128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56phq\" (UniqueName: \"kubernetes.io/projected/08923d69-80ad-4c51-88fa-37a4220a7fa0-kube-api-access-56phq\") pod \"migrator-955ffdf5f-9drhb\" (UID: \"08923d69-80ad-4c51-88fa-37a4220a7fa0\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" Jun 11 16:21:06.791868 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.791830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56phq\" (UniqueName: \"kubernetes.io/projected/08923d69-80ad-4c51-88fa-37a4220a7fa0-kube-api-access-56phq\") pod \"migrator-955ffdf5f-9drhb\" (UID: \"08923d69-80ad-4c51-88fa-37a4220a7fa0\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" Jun 11 16:21:06.800884 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.800848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56phq\" (UniqueName: \"kubernetes.io/projected/08923d69-80ad-4c51-88fa-37a4220a7fa0-kube-api-access-56phq\") pod \"migrator-955ffdf5f-9drhb\" (UID: \"08923d69-80ad-4c51-88fa-37a4220a7fa0\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" Jun 11 16:21:06.950401 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:06.950321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" Jun 11 16:21:07.080094 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.080034 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb"] Jun 11 16:21:07.084371 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:07.084345 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08923d69_80ad_4c51_88fa_37a4220a7fa0.slice/crio-33915fd63b7460b2806ebba293305fd02e99306a53d79f25cc55973763eccec0 WatchSource:0}: Error finding container 33915fd63b7460b2806ebba293305fd02e99306a53d79f25cc55973763eccec0: Status 404 returned error can't find the container with id 33915fd63b7460b2806ebba293305fd02e99306a53d79f25cc55973763eccec0 Jun 11 16:21:07.635091 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.634915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmvpl" event={"ID":"96871d1b-13b6-4295-9bc1-f63ab33452e7","Type":"ContainerStarted","Data":"3b6c375203587b8f22fe779edecb965eacb5e5508ba3bc9a1b15c20a9085366d"} Jun 11 16:21:07.635091 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.635019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:21:07.636281 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.636256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" event={"ID":"08923d69-80ad-4c51-88fa-37a4220a7fa0","Type":"ContainerStarted","Data":"33915fd63b7460b2806ebba293305fd02e99306a53d79f25cc55973763eccec0"} Jun 11 16:21:07.637879 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.637853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klqv4" event={"ID":"e8aea942-23de-4019-a7e7-0dab4f206e5b","Type":"ContainerStarted","Data":"ae1d69f48f5460a9f4930508de11f2ef2f1883d23378d2126f8ac4a428bc45be"} Jun 11 16:21:07.639556 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.639534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2tmnk" event={"ID":"d1016106-7e6e-4653-b059-2905d0f869c5","Type":"ContainerStarted","Data":"ba7e07719b6db85ad6f3bd0f78f5209581ef71c4854e3ba18511d1754b466668"} Jun 11 16:21:07.641214 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.641176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" event={"ID":"8071868a-90be-48e4-be98-c7234df42cee","Type":"ContainerStarted","Data":"4ad50898841770ea6b083c8b3e8b3f699fa1b6099c6b0e513f8da93df71f9fc2"} Jun 11 16:21:07.652180 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.651998 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bmvpl" podStartSLOduration=66.607543448 podStartE2EDuration="1m11.651985308s" totalImagesPullingTime="5.04444186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:07.651848184 +0000 UTC m=+71.817814354" watchObservedRunningTime="2026-06-11 16:21:07.651985308 +0000 UTC m=+71.817951477" Jun 11 16:21:07.668642 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.668595 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-2tmnk" podStartSLOduration=1.607361354 podStartE2EDuration="6.668579535s" totalImagesPullingTime="5.061218181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:07.668222318 +0000 UTC m=+71.834188487" watchObservedRunningTime="2026-06-11 16:21:07.668579535 +0000 UTC m=+71.834545704" Jun 11 16:21:07.686332 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.686274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klqv4" podStartSLOduration=66.279029257 podStartE2EDuration="1m11.686259397s" totalImagesPullingTime="5.40723014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:07.685632642 +0000 UTC m=+71.851598811" watchObservedRunningTime="2026-06-11 16:21:07.686259397 +0000 UTC m=+71.852225586" Jun 11 16:21:07.703294 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:07.703251 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" podStartSLOduration=1.7304965719999998 podStartE2EDuration="6.703235724s" totalImagesPullingTime="4.972739152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:07.702733532 +0000 UTC m=+71.868699708" watchObservedRunningTime="2026-06-11 16:21:07.703235724 +0000 UTC m=+71.869201883" Jun 11 16:21:08.646081 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:08.646018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" event={"ID":"08923d69-80ad-4c51-88fa-37a4220a7fa0","Type":"ContainerStarted","Data":"bb655d68fdc9a3bbda4ed296375db60343ae6422b36d85be2c7eb68dfb920f5b"} Jun 11 16:21:08.646457 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:08.646099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" event={"ID":"08923d69-80ad-4c51-88fa-37a4220a7fa0","Type":"ContainerStarted","Data":"61f07505a0da98c2f033b454f276549d114197f0be49eeafe24ada80405477e3"} Jun 11 16:21:08.664466 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:08.664418 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9drhb" podStartSLOduration=1.658145551 podStartE2EDuration="2.664401961s" totalImagesPullingTime="1.00625641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:08.663245321 +0000 UTC m=+72.829211491" watchObservedRunningTime="2026-06-11 16:21:08.664401961 +0000 UTC m=+72.830368126" Jun 11 16:21:08.810093 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:08.810046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:08.810252 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:08.810184 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:08.810293 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:08.810262 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:16.810246082 +0000 UTC m=+80.976212227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:09.011110 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:09.010997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:09.011297 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:09.011186 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:09.011297 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:09.011211 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:09.011297 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:09.011279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:17.011260579 +0000 UTC m=+81.177226742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:11.052315 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:11.052288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2r7dk_458a36dd-6930-443e-9dda-94ba59f28d93/dns-node-resolver/0.log" Jun 11 16:21:12.253178 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:12.253151 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzzmh_af864790-82a7-4fa9-a810-d7fdf64121f9/node-ca/0.log" Jun 11 16:21:13.053040 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:13.053004 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nz5lx_cff79bb3-476e-46e0-9a92-845bcee811a0/serve-healthcheck-canary/0.log" Jun 11 16:21:13.453540 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:13.453506 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9drhb_08923d69-80ad-4c51-88fa-37a4220a7fa0/migrator/0.log" Jun 11 16:21:13.653280 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:13.653252 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9drhb_08923d69-80ad-4c51-88fa-37a4220a7fa0/graceful-termination/0.log" Jun 11 16:21:16.874556 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:16.874417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:16.874556 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:16.874543 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:16.875052 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:16.874612 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls podName:0c68f40c-9f83-414e-8ae7-cfd4dbf8010e nodeName:}" failed. No retries permitted until 2026-06-11 16:21:32.874590691 +0000 UTC m=+97.040556841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-x44kg" (UID: "0c68f40c-9f83-414e-8ae7-cfd4dbf8010e") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:21:17.076226 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:17.076175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:17.076433 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:17.076320 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:21:17.076433 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:17.076338 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f84cf966-zwhkg: secret "image-registry-tls" not found Jun 11 16:21:17.076433 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:17.076421 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls podName:c9b7edb0-68e2-4c4d-93bb-15133577fa18 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:33.076400625 +0000 UTC m=+97.242366789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls") pod "image-registry-78f84cf966-zwhkg" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18") : secret "image-registry-tls" not found Jun 11 16:21:32.901011 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:32.900972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:32.903337 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:32.903309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c68f40c-9f83-414e-8ae7-cfd4dbf8010e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-x44kg\" (UID: \"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:32.935329 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:32.935299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" Jun 11 16:21:33.058861 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.058681 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg"] Jun 11 16:21:33.061416 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:33.061393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c68f40c_9f83_414e_8ae7_cfd4dbf8010e.slice/crio-a2dd063fd2ce91214e3dfed963512ad350f54322173b662faa02394f0a92b114 WatchSource:0}: Error finding container a2dd063fd2ce91214e3dfed963512ad350f54322173b662faa02394f0a92b114: Status 404 returned error can't find the container with id a2dd063fd2ce91214e3dfed963512ad350f54322173b662faa02394f0a92b114 Jun 11 16:21:33.102827 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.102804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:33.104998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.104975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"image-registry-78f84cf966-zwhkg\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:33.135631 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.135608 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:33.272332 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.272297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:21:33.275347 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:33.275322 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b7edb0_68e2_4c4d_93bb_15133577fa18.slice/crio-cd2afbc40335296d596644a52d932d9b5738192c866406c0e180ede732b40034 WatchSource:0}: Error finding container cd2afbc40335296d596644a52d932d9b5738192c866406c0e180ede732b40034: Status 404 returned error can't find the container with id cd2afbc40335296d596644a52d932d9b5738192c866406c0e180ede732b40034 Jun 11 16:21:33.721512 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.721465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" event={"ID":"c9b7edb0-68e2-4c4d-93bb-15133577fa18","Type":"ContainerStarted","Data":"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824"} Jun 11 16:21:33.721700 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.721527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" event={"ID":"c9b7edb0-68e2-4c4d-93bb-15133577fa18","Type":"ContainerStarted","Data":"cd2afbc40335296d596644a52d932d9b5738192c866406c0e180ede732b40034"} Jun 11 16:21:33.721700 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.721553 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:21:33.722913 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.722886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" event={"ID":"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e","Type":"ContainerStarted","Data":"a2dd063fd2ce91214e3dfed963512ad350f54322173b662faa02394f0a92b114"} Jun 11 16:21:33.744822 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:33.744776 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" podStartSLOduration=32.744760728 podStartE2EDuration="32.744760728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:33.743360248 +0000 UTC m=+97.909326417" watchObservedRunningTime="2026-06-11 16:21:33.744760728 +0000 UTC m=+97.910726903" Jun 11 16:21:34.128376 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.128337 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp"] Jun 11 16:21:34.132005 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.131981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.136034 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:21:34.136285 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136267 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:21:34.136353 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136324 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:21:34.136426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136351 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:21:34.136426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:21:34.136426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136331 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:21:34.136741 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.136712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:21:34.148946 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.148925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp"] Jun 11 16:21:34.164322 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.164294 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:21:34.213138 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.213388 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.213388 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/754215b2-966f-43ee-824d-77b076d4a938-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.213388 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pqgd\" (UniqueName: \"kubernetes.io/projected/754215b2-966f-43ee-824d-77b076d4a938-kube-api-access-7pqgd\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.213589 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.213589 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.213453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.235250 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.235212 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k87jg"] Jun 11 16:21:34.237815 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.237794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.240951 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.240927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l8tlp\"" Jun 11 16:21:34.241676 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.241646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:21:34.241676 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.241660 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:21:34.253345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.253270 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k87jg"] Jun 11 16:21:34.314182 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.314182 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c215851f-b751-4916-acec-e1ae7894caac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c215851f-b751-4916-acec-e1ae7894caac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpzdn\" (UniqueName: \"kubernetes.io/projected/c215851f-b751-4916-acec-e1ae7894caac-kube-api-access-hpzdn\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c215851f-b751-4916-acec-e1ae7894caac-crio-socket\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/754215b2-966f-43ee-824d-77b076d4a938-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.314418 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c215851f-b751-4916-acec-e1ae7894caac-data-volume\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.314788 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.314459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pqgd\" (UniqueName: \"kubernetes.io/projected/754215b2-966f-43ee-824d-77b076d4a938-kube-api-access-7pqgd\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.315587 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.315537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/754215b2-966f-43ee-824d-77b076d4a938-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.317215 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.317177 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.317419 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.317397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-ca\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.317500 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.317470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.317670 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.317650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/754215b2-966f-43ee-824d-77b076d4a938-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.329465 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.329422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pqgd\" (UniqueName: \"kubernetes.io/projected/754215b2-966f-43ee-824d-77b076d4a938-kube-api-access-7pqgd\") pod \"cluster-proxy-proxy-agent-864fb97ddb-mqqbp\" (UID: \"754215b2-966f-43ee-824d-77b076d4a938\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.415530 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c215851f-b751-4916-acec-e1ae7894caac-data-volume\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c215851f-b751-4916-acec-e1ae7894caac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c215851f-b751-4916-acec-e1ae7894caac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpzdn\" (UniqueName: \"kubernetes.io/projected/c215851f-b751-4916-acec-e1ae7894caac-kube-api-access-hpzdn\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c215851f-b751-4916-acec-e1ae7894caac-crio-socket\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415908 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c215851f-b751-4916-acec-e1ae7894caac-crio-socket\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.415908 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.415846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c215851f-b751-4916-acec-e1ae7894caac-data-volume\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.416209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.416182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c215851f-b751-4916-acec-e1ae7894caac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.418321 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.418299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c215851f-b751-4916-acec-e1ae7894caac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.428093 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.428052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpzdn\" (UniqueName: \"kubernetes.io/projected/c215851f-b751-4916-acec-e1ae7894caac-kube-api-access-hpzdn\") pod \"insights-runtime-extractor-k87jg\" (UID: \"c215851f-b751-4916-acec-e1ae7894caac\") " pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.455125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.455101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" Jun 11 16:21:34.549240 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.549175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k87jg" Jun 11 16:21:34.609715 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.609687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp"] Jun 11 16:21:34.613358 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:34.613329 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod754215b2_966f_43ee_824d_77b076d4a938.slice/crio-86d67287fdc01eb9d755d5a3ee4648d5531afd3b3db84f18450a61c67311c908 WatchSource:0}: Error finding container 86d67287fdc01eb9d755d5a3ee4648d5531afd3b3db84f18450a61c67311c908: Status 404 returned error can't find the container with id 86d67287fdc01eb9d755d5a3ee4648d5531afd3b3db84f18450a61c67311c908 Jun 11 16:21:34.706280 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.706208 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k87jg"] Jun 11 16:21:34.709661 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:34.709638 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc215851f_b751_4916_acec_e1ae7894caac.slice/crio-b18ebb98a782e8a6f1e5cbe89e0fd1f0dd0738854d1d0e28a4924ecf74c66460 WatchSource:0}: Error finding container b18ebb98a782e8a6f1e5cbe89e0fd1f0dd0738854d1d0e28a4924ecf74c66460: Status 404 returned error can't find the container with id b18ebb98a782e8a6f1e5cbe89e0fd1f0dd0738854d1d0e28a4924ecf74c66460 Jun 11 16:21:34.727053 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.727010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" event={"ID":"754215b2-966f-43ee-824d-77b076d4a938","Type":"ContainerStarted","Data":"86d67287fdc01eb9d755d5a3ee4648d5531afd3b3db84f18450a61c67311c908"} Jun 11 16:21:34.728508 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.728479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" event={"ID":"0c68f40c-9f83-414e-8ae7-cfd4dbf8010e","Type":"ContainerStarted","Data":"c563fe4eac17e85c10ec509bfbbe6ce3cfeca526e9ce58c1c53c1b0bad539d6c"} Jun 11 16:21:34.729446 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.729426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k87jg" event={"ID":"c215851f-b751-4916-acec-e1ae7894caac","Type":"ContainerStarted","Data":"b18ebb98a782e8a6f1e5cbe89e0fd1f0dd0738854d1d0e28a4924ecf74c66460"} Jun 11 16:21:34.776857 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:34.776817 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-x44kg" podStartSLOduration=32.370131233 podStartE2EDuration="33.776801755s" totalImagesPullingTime="1.406670522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:34.776338447 +0000 UTC m=+98.942304617" watchObservedRunningTime="2026-06-11 16:21:34.776801755 +0000 UTC m=+98.942767922" Jun 11 16:21:35.735036 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:35.734955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k87jg" event={"ID":"c215851f-b751-4916-acec-e1ae7894caac","Type":"ContainerStarted","Data":"a51bdd0355fa32e73794a82ea1feeb29f16f39a984571f5f8753ff221c79a650"} Jun 11 16:21:38.144447 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.144403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:38.146677 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.146659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917-metrics-tls\") pod \"dns-default-sdx5w\" (UID: \"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917\") " pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:38.441991 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.441954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ddd7\"" Jun 11 16:21:38.449490 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.449436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:38.621581 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.621543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdx5w"] Jun 11 16:21:38.626106 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:38.626050 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9b3d15_8f9a_48dd_a35c_a17bbcc8c917.slice/crio-d40c44fae19b65fcb23271a1f2e7e3bf05e27c5af84fca234b449db81a2a986a WatchSource:0}: Error finding container d40c44fae19b65fcb23271a1f2e7e3bf05e27c5af84fca234b449db81a2a986a: Status 404 returned error can't find the container with id d40c44fae19b65fcb23271a1f2e7e3bf05e27c5af84fca234b449db81a2a986a Jun 11 16:21:38.662191 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.661900 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bmvpl" Jun 11 16:21:38.747834 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.747768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k87jg" event={"ID":"c215851f-b751-4916-acec-e1ae7894caac","Type":"ContainerStarted","Data":"b2e5f7a2255161dbd7e3e646596c6eaa577dc25a30dcb001f4645879bbc0ecae"} Jun 11 16:21:38.749998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.749968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" event={"ID":"754215b2-966f-43ee-824d-77b076d4a938","Type":"ContainerStarted","Data":"9058db5312ba80780dd36d0f2a2093f58bbf203fb921a5c144b458100528778d"} Jun 11 16:21:38.750133 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.750016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" event={"ID":"754215b2-966f-43ee-824d-77b076d4a938","Type":"ContainerStarted","Data":"91b1f0bff6f440a472547bb097e67e88397b7dd716a032e35b3cbf447dc58200"} Jun 11 16:21:38.751337 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:38.751305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdx5w" event={"ID":"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917","Type":"ContainerStarted","Data":"d40c44fae19b65fcb23271a1f2e7e3bf05e27c5af84fca234b449db81a2a986a"} Jun 11 16:21:39.756588 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:39.756549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" event={"ID":"754215b2-966f-43ee-824d-77b076d4a938","Type":"ContainerStarted","Data":"9c9ed737c38d9783aec37b9150cc35fe093f1c5ed8266eaddd29e4a8313e88cf"} Jun 11 16:21:39.779098 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:39.779037 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864fb97ddb-mqqbp" podStartSLOduration=1.9792157160000001 podStartE2EDuration="5.77902361s" totalImagesPullingTime="3.799807894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:39.777807575 +0000 UTC m=+103.943773755" watchObservedRunningTime="2026-06-11 16:21:39.77902361 +0000 UTC m=+103.944989819" Jun 11 16:21:40.762180 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:40.762141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k87jg" event={"ID":"c215851f-b751-4916-acec-e1ae7894caac","Type":"ContainerStarted","Data":"635024b4a744e3aba5e05b018803c1fdeaa98eb2468afeb47f4d8e627e0e469a"} Jun 11 16:21:40.787962 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:40.787885 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k87jg" podStartSLOduration=2.978825205 podStartE2EDuration="6.787866116s" totalImagesPullingTime="3.809040911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:40.787556955 +0000 UTC m=+104.953523124" watchObservedRunningTime="2026-06-11 16:21:40.787866116 +0000 UTC m=+104.953832281" Jun 11 16:21:41.767929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:41.767900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdx5w" event={"ID":"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917","Type":"ContainerStarted","Data":"78abacf63c2d7684ca8f6c6bedd908b8919483ba107e18e1097a9e5b09c537e9"} Jun 11 16:21:41.768348 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:41.767948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdx5w" event={"ID":"4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917","Type":"ContainerStarted","Data":"6d4e57d5cf91a083a2e2a32e7e5f72748edfb631f95995a50cf07832e1dab3d3"} Jun 11 16:21:41.768348 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:41.768056 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:41.802488 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:41.802436 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sdx5w" podStartSLOduration=65.429245709 podStartE2EDuration="1m7.802420369s" totalImagesPullingTime="2.37317466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:41.801991977 +0000 UTC m=+105.967958159" watchObservedRunningTime="2026-06-11 16:21:41.802420369 +0000 UTC m=+105.968386536" Jun 11 16:21:46.794368 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.794327 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mclpf"] Jun 11 16:21:46.796538 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.796520 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.802627 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.802610 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:21:46.803090 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.802973 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:21:46.803273 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.803257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:21:46.803843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.803821 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9rms\"" Jun 11 16:21:46.803843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.803837 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:21:46.907769 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-sys\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-root\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-metrics-client-ca\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-textfile\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6xg\" (UniqueName: \"kubernetes.io/projected/db1880ac-1f65-4f85-9e88-7df8bedb563a-kube-api-access-ft6xg\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:46.907943 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:46.907941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-wtmp\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-root\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-root\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-metrics-client-ca\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-textfile\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6xg\" (UniqueName: \"kubernetes.io/projected/db1880ac-1f65-4f85-9e88-7df8bedb563a-kube-api-access-ft6xg\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:47.009312 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:21:47.009384 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:21:47.009379 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls podName:db1880ac-1f65-4f85-9e88-7df8bedb563a nodeName:}" failed. No retries permitted until 2026-06-11 16:21:47.5093585 +0000 UTC m=+111.675324660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls") pod "node-exporter-mclpf" (UID: "db1880ac-1f65-4f85-9e88-7df8bedb563a") : secret "node-exporter-tls" not found Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-wtmp\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-sys\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-sys\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-wtmp\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-textfile\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-metrics-client-ca\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.009961 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.009801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.011499 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.011481 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.023557 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.023535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6xg\" (UniqueName: \"kubernetes.io/projected/db1880ac-1f65-4f85-9e88-7df8bedb563a-kube-api-access-ft6xg\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.515087 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.515028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.517413 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.517384 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db1880ac-1f65-4f85-9e88-7df8bedb563a-node-exporter-tls\") pod \"node-exporter-mclpf\" (UID: \"db1880ac-1f65-4f85-9e88-7df8bedb563a\") " pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.705936 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.705897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mclpf" Jun 11 16:21:47.715834 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:21:47.715804 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1880ac_1f65_4f85_9e88_7df8bedb563a.slice/crio-5fea53ebfefec8a18272db4670a50cdf13afb854e010826034d78672d34256c1 WatchSource:0}: Error finding container 5fea53ebfefec8a18272db4670a50cdf13afb854e010826034d78672d34256c1: Status 404 returned error can't find the container with id 5fea53ebfefec8a18272db4670a50cdf13afb854e010826034d78672d34256c1 Jun 11 16:21:47.793847 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:47.793758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mclpf" event={"ID":"db1880ac-1f65-4f85-9e88-7df8bedb563a","Type":"ContainerStarted","Data":"5fea53ebfefec8a18272db4670a50cdf13afb854e010826034d78672d34256c1"} Jun 11 16:21:48.800294 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:48.800210 2562 generic.go:356] "Generic (PLEG): container finished" podID="db1880ac-1f65-4f85-9e88-7df8bedb563a" containerID="f76dc569de0a805ba49fcc529eca2ba81b7e263a82b6e9af356c642b97dfaea3" exitCode=0 Jun 11 16:21:48.800698 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:48.800286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mclpf" event={"ID":"db1880ac-1f65-4f85-9e88-7df8bedb563a","Type":"ContainerDied","Data":"f76dc569de0a805ba49fcc529eca2ba81b7e263a82b6e9af356c642b97dfaea3"} Jun 11 16:21:49.806119 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:49.806083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mclpf" event={"ID":"db1880ac-1f65-4f85-9e88-7df8bedb563a","Type":"ContainerStarted","Data":"d2ea56e4514d1ec09c5b9b1f28ecfd2b0987f8ccba7821fbcbbd96b6e0e7069c"} Jun 11 16:21:49.806508 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:49.806140 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mclpf" event={"ID":"db1880ac-1f65-4f85-9e88-7df8bedb563a","Type":"ContainerStarted","Data":"6f292b82703fe56f4f8ff03fda1012feb73cd109670073f4ca6ef0d90ae4b448"} Jun 11 16:21:49.831691 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:49.831638 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mclpf" podStartSLOduration=2.993867519 podStartE2EDuration="3.831621489s" totalImagesPullingTime="774.583585ms" totalInitContainerRuntime="63.170385ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:49.830392578 +0000 UTC m=+113.996358748" watchObservedRunningTime="2026-06-11 16:21:49.831621489 +0000 UTC m=+113.997587685" Jun 11 16:21:51.773843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:51.773813 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sdx5w" Jun 11 16:21:55.740151 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:21:55.740119 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:22:00.757745 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:00.757690 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" podUID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" containerName="registry" containerID="cri-o://7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824" gracePeriod=30 Jun 11 16:22:00.993627 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:00.993605 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:22:01.015465 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015408 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015465 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015446 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015469 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4l6r\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015494 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015518 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015569 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015592 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015645 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015627 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted\") pod \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\" (UID: \"c9b7edb0-68e2-4c4d-93bb-15133577fa18\") " Jun 11 16:22:01.015949 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.015915 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:01.016433 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.016408 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:01.018409 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.018382 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r" (OuterVolumeSpecName: "kube-api-access-t4l6r") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "kube-api-access-t4l6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:01.018516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.018477 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:01.018516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.018488 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:01.018516 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.018508 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:01.018736 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.018699 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:01.024742 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.024721 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c9b7edb0-68e2-4c4d-93bb-15133577fa18" (UID: "c9b7edb0-68e2-4c4d-93bb-15133577fa18"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:22:01.116508 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116479 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-certificates\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116508 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116503 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-image-registry-private-configuration\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116508 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116513 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-bound-sa-token\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116728 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116521 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9b7edb0-68e2-4c4d-93bb-15133577fa18-trusted-ca\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116728 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116531 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9b7edb0-68e2-4c4d-93bb-15133577fa18-ca-trust-extracted\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116728 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116540 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-registry-tls\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116728 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116549 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9b7edb0-68e2-4c4d-93bb-15133577fa18-installation-pull-secrets\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.116728 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.116558 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4l6r\" (UniqueName: \"kubernetes.io/projected/c9b7edb0-68e2-4c4d-93bb-15133577fa18-kube-api-access-t4l6r\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:22:01.846621 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.846585 2562 generic.go:356] "Generic (PLEG): container finished" podID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" containerID="7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824" exitCode=0 Jun 11 16:22:01.847015 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.846628 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" Jun 11 16:22:01.847015 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.846645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" event={"ID":"c9b7edb0-68e2-4c4d-93bb-15133577fa18","Type":"ContainerDied","Data":"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824"} Jun 11 16:22:01.847015 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.846684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f84cf966-zwhkg" event={"ID":"c9b7edb0-68e2-4c4d-93bb-15133577fa18","Type":"ContainerDied","Data":"cd2afbc40335296d596644a52d932d9b5738192c866406c0e180ede732b40034"} Jun 11 16:22:01.847015 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.846717 2562 scope.go:117] "RemoveContainer" containerID="7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824" Jun 11 16:22:01.855388 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.855365 2562 scope.go:117] "RemoveContainer" containerID="7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824" Jun 11 16:22:01.855654 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:22:01.855635 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824\": container with ID starting with 7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824 not found: ID does not exist" containerID="7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824" Jun 11 16:22:01.855717 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.855666 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824"} err="failed to get container status \"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824\": rpc error: code = NotFound desc = could not find container \"7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824\": container with ID starting with 7d9a83365963c8157746c824f62205d929a3acb4246dbd40724705c13c0b1824 not found: ID does not exist" Jun 11 16:22:01.867719 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.867654 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:22:01.875968 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:01.875939 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78f84cf966-zwhkg"] Jun 11 16:22:02.332488 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:02.332445 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" path="/var/lib/kubelet/pods/c9b7edb0-68e2-4c4d-93bb-15133577fa18/volumes" Jun 11 16:22:05.145359 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.145315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:22:05.147704 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.147675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9aca90-c5f9-4148-8828-c00413fdb478-metrics-certs\") pod \"network-metrics-daemon-545xm\" (UID: \"6b9aca90-c5f9-4148-8828-c00413fdb478\") " pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:22:05.341359 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.341325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-49ftn\"" Jun 11 16:22:05.347927 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.347902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-545xm" Jun 11 16:22:05.492127 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.492098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-545xm"] Jun 11 16:22:05.495491 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:22:05.495461 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9aca90_c5f9_4148_8828_c00413fdb478.slice/crio-270b7c0d29c6e901b6011bcd75ca7ad1965229ed5a32d671171e0359f4b690e6 WatchSource:0}: Error finding container 270b7c0d29c6e901b6011bcd75ca7ad1965229ed5a32d671171e0359f4b690e6: Status 404 returned error can't find the container with id 270b7c0d29c6e901b6011bcd75ca7ad1965229ed5a32d671171e0359f4b690e6 Jun 11 16:22:05.863181 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:05.863104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-545xm" event={"ID":"6b9aca90-c5f9-4148-8828-c00413fdb478","Type":"ContainerStarted","Data":"270b7c0d29c6e901b6011bcd75ca7ad1965229ed5a32d671171e0359f4b690e6"} Jun 11 16:22:06.868251 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:06.868167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-545xm" event={"ID":"6b9aca90-c5f9-4148-8828-c00413fdb478","Type":"ContainerStarted","Data":"de489a538e90fce599eb02388097635ffb559a74a08413a233687d54ffe474dc"} Jun 11 16:22:06.868251 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:06.868222 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-545xm" event={"ID":"6b9aca90-c5f9-4148-8828-c00413fdb478","Type":"ContainerStarted","Data":"3216a9ea108a75e5e9aaadd80f87ee0b88740b19f98ab07f09fe4b9e94f007ee"} Jun 11 16:22:06.900153 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:06.900105 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-545xm" podStartSLOduration=129.958185701 podStartE2EDuration="2m10.900088434s" totalImagesPullingTime="941.902733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:06.899250172 +0000 UTC m=+131.065216341" watchObservedRunningTime="2026-06-11 16:22:06.900088434 +0000 UTC m=+131.066054605" Jun 11 16:22:22.922429 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:22.922395 2562 generic.go:356] "Generic (PLEG): container finished" podID="d1016106-7e6e-4653-b059-2905d0f869c5" containerID="ba7e07719b6db85ad6f3bd0f78f5209581ef71c4854e3ba18511d1754b466668" exitCode=0 Jun 11 16:22:22.922822 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:22.922455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2tmnk" event={"ID":"d1016106-7e6e-4653-b059-2905d0f869c5","Type":"ContainerDied","Data":"ba7e07719b6db85ad6f3bd0f78f5209581ef71c4854e3ba18511d1754b466668"} Jun 11 16:22:22.922822 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:22.922767 2562 scope.go:117] "RemoveContainer" containerID="ba7e07719b6db85ad6f3bd0f78f5209581ef71c4854e3ba18511d1754b466668" Jun 11 16:22:23.927538 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:23.927508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2tmnk" event={"ID":"d1016106-7e6e-4653-b059-2905d0f869c5","Type":"ContainerStarted","Data":"49ea81c044eed0166d98e65e55c891f13bbfd789e6d0f58fefdae00ac09b41ab"} Jun 11 16:22:27.940580 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:27.940546 2562 generic.go:356] "Generic (PLEG): container finished" podID="8071868a-90be-48e4-be98-c7234df42cee" containerID="4ad50898841770ea6b083c8b3e8b3f699fa1b6099c6b0e513f8da93df71f9fc2" exitCode=0 Jun 11 16:22:27.940580 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:27.940583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" event={"ID":"8071868a-90be-48e4-be98-c7234df42cee","Type":"ContainerDied","Data":"4ad50898841770ea6b083c8b3e8b3f699fa1b6099c6b0e513f8da93df71f9fc2"} Jun 11 16:22:27.941113 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:27.940888 2562 scope.go:117] "RemoveContainer" containerID="4ad50898841770ea6b083c8b3e8b3f699fa1b6099c6b0e513f8da93df71f9fc2" Jun 11 16:22:28.946262 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:22:28.946227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hhsqj" event={"ID":"8071868a-90be-48e4-be98-c7234df42cee","Type":"ContainerStarted","Data":"30ba9bb1fa561bee0d1c7c9a6f9445eb3b91acfa37a3eac8ce46648805d3722d"} Jun 11 16:24:56.256431 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:24:56.256398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:24:56.262596 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:24:56.262571 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:24:56.263083 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:24:56.263054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:25:51.163713 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.163678 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g"] Jun 11 16:25:51.164196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.163927 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" containerName="registry" Jun 11 16:25:51.164196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.163937 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" containerName="registry" Jun 11 16:25:51.164196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.163978 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b7edb0-68e2-4c4d-93bb-15133577fa18" containerName="registry" Jun 11 16:25:51.166575 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.166558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.169239 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.169211 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2vm5c\"" Jun 11 16:25:51.169410 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.169392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:25:51.169868 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.169848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 16:25:51.183802 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.183775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g"] Jun 11 16:25:51.223173 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.223133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftpz\" (UniqueName: \"kubernetes.io/projected/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-kube-api-access-9ftpz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.223331 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.223194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.323997 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.323961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.324180 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.324022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftpz\" (UniqueName: \"kubernetes.io/projected/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-kube-api-access-9ftpz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.324485 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.324465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.333273 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.333248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftpz\" (UniqueName: \"kubernetes.io/projected/c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe-kube-api-access-9ftpz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x4d7g\" (UID: \"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.475585 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.475495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" Jun 11 16:25:51.606157 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.606130 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g"] Jun 11 16:25:51.609102 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:25:51.609058 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79d8a69_86de_46b2_b9f1_cc6e4a3dc9fe.slice/crio-86738729cffe3ed3ed91797d74463c15cdb457f104ca9457d2d262633cca0b12 WatchSource:0}: Error finding container 86738729cffe3ed3ed91797d74463c15cdb457f104ca9457d2d262633cca0b12: Status 404 returned error can't find the container with id 86738729cffe3ed3ed91797d74463c15cdb457f104ca9457d2d262633cca0b12 Jun 11 16:25:51.613572 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:51.613550 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:25:52.602396 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:52.602358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" event={"ID":"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe","Type":"ContainerStarted","Data":"86738729cffe3ed3ed91797d74463c15cdb457f104ca9457d2d262633cca0b12"} Jun 11 16:25:55.615808 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:55.615719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" event={"ID":"c79d8a69-86de-46b2-b9f1-cc6e4a3dc9fe","Type":"ContainerStarted","Data":"beb7c4cca3f01c7eeefe17708390f348f4ad254ceb282159585c0a3928c636fc"} Jun 11 16:25:55.639632 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:55.639577 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x4d7g" podStartSLOduration=1.054114235 podStartE2EDuration="4.639563188s" totalImagesPullingTime="3.585448953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:25:55.638389458 +0000 UTC m=+359.804355625" watchObservedRunningTime="2026-06-11 16:25:55.639563188 +0000 UTC m=+359.805529356" Jun 11 16:25:59.622292 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.622257 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz"] Jun 11 16:25:59.625371 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.625353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.628083 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.628051 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:25:59.628923 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.628908 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:25:59.628974 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.628909 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b95nc\"" Jun 11 16:25:59.632449 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.632426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz"] Jun 11 16:25:59.696649 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.696610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.696810 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.696675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslmb\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-kube-api-access-nslmb\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.797694 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.797662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslmb\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-kube-api-access-nslmb\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.797694 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.797698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.812866 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.812837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.813360 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.813337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslmb\" (UniqueName: \"kubernetes.io/projected/95e57d0e-a975-4cd1-8bb9-e427cf73cb06-kube-api-access-nslmb\") pod \"cert-manager-cainjector-5d99449ffd-dz4bz\" (UID: \"95e57d0e-a975-4cd1-8bb9-e427cf73cb06\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:25:59.934504 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:25:59.934472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" Jun 11 16:26:00.065345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:00.065235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz"] Jun 11 16:26:00.068018 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:00.067993 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95e57d0e_a975_4cd1_8bb9_e427cf73cb06.slice/crio-fb11636bb2e95395c09587763ea6c1402c8aea3741f9dca284f9ce00003eea16 WatchSource:0}: Error finding container fb11636bb2e95395c09587763ea6c1402c8aea3741f9dca284f9ce00003eea16: Status 404 returned error can't find the container with id fb11636bb2e95395c09587763ea6c1402c8aea3741f9dca284f9ce00003eea16 Jun 11 16:26:00.633498 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:00.633462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" event={"ID":"95e57d0e-a975-4cd1-8bb9-e427cf73cb06","Type":"ContainerStarted","Data":"fb11636bb2e95395c09587763ea6c1402c8aea3741f9dca284f9ce00003eea16"} Jun 11 16:26:03.647148 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:03.647109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" event={"ID":"95e57d0e-a975-4cd1-8bb9-e427cf73cb06","Type":"ContainerStarted","Data":"4e41249daf240d79c9932490330a17c39f206d673721d0ecb600b132b5cfe7f9"} Jun 11 16:26:03.662940 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:03.662890 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dz4bz" podStartSLOduration=1.608694759 podStartE2EDuration="4.662872766s" totalImagesPullingTime="3.054178007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:03.662218699 +0000 UTC m=+367.828184868" watchObservedRunningTime="2026-06-11 16:26:03.662872766 +0000 UTC m=+367.828838947" Jun 11 16:26:09.195074 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.195044 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4xlz"] Jun 11 16:26:09.198131 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.198116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.200488 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.200466 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6tn95\"" Jun 11 16:26:09.212262 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.212244 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4xlz"] Jun 11 16:26:09.271398 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.271373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-bound-sa-token\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.271522 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.271414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkh8\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-kube-api-access-rmkh8\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.372162 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.372124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-bound-sa-token\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.372355 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.372180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkh8\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-kube-api-access-rmkh8\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.387047 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.387014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkh8\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-kube-api-access-rmkh8\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.387047 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.387044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f9bf63-9c22-4143-b41b-bd61ba94e1d8-bound-sa-token\") pod \"cert-manager-59c77684cc-h4xlz\" (UID: \"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8\") " pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.506396 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.506298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4xlz" Jun 11 16:26:09.652995 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.652955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4xlz"] Jun 11 16:26:09.659820 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:09.659786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2f9bf63_9c22_4143_b41b_bd61ba94e1d8.slice/crio-f37abce48aed1a8d10b435684ae639f5148f73ffec59bd85dd8acd5ce1e9f797 WatchSource:0}: Error finding container f37abce48aed1a8d10b435684ae639f5148f73ffec59bd85dd8acd5ce1e9f797: Status 404 returned error can't find the container with id f37abce48aed1a8d10b435684ae639f5148f73ffec59bd85dd8acd5ce1e9f797 Jun 11 16:26:09.668669 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:09.668648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4xlz" event={"ID":"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8","Type":"ContainerStarted","Data":"f37abce48aed1a8d10b435684ae639f5148f73ffec59bd85dd8acd5ce1e9f797"} Jun 11 16:26:10.674125 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:10.674090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4xlz" event={"ID":"b2f9bf63-9c22-4143-b41b-bd61ba94e1d8","Type":"ContainerStarted","Data":"a0dab98ecf609ea15c5cb3ac544651ff65ce7174d76e0caab892ad2d320c7b5d"} Jun 11 16:26:10.692765 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:10.692719 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-h4xlz" podStartSLOduration=1.6927029999999998 podStartE2EDuration="1.692703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:10.691123493 +0000 UTC m=+374.857089660" watchObservedRunningTime="2026-06-11 16:26:10.692703 +0000 UTC m=+374.858669168" Jun 11 16:26:31.206257 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.206226 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr"] Jun 11 16:26:31.211581 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.211564 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.213672 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.213633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:26:31.214015 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.213992 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:26:31.214124 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.214017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:26:31.214124 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.214002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:26:31.214124 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.214103 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9wbjt\"" Jun 11 16:26:31.234852 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.234816 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr"] Jun 11 16:26:31.336446 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.336408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.336615 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.336501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shrn\" (UniqueName: \"kubernetes.io/projected/212710ba-9d4e-431f-8a0b-223171c4a135-kube-api-access-9shrn\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.336615 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.336534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.336615 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.336570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.336615 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.336603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.437433 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.437607 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shrn\" (UniqueName: \"kubernetes.io/projected/212710ba-9d4e-431f-8a0b-223171c4a135-kube-api-access-9shrn\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.437607 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.437607 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.437607 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.438008 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.437970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-manifests\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.439954 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.439923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/212710ba-9d4e-431f-8a0b-223171c4a135-tmp\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.440089 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.440048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.440178 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.440160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/212710ba-9d4e-431f-8a0b-223171c4a135-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.445857 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.445821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shrn\" (UniqueName: \"kubernetes.io/projected/212710ba-9d4e-431f-8a0b-223171c4a135-kube-api-access-9shrn\") pod \"opendatahub-operator-controller-manager-bc59bf699-txsnr\" (UID: \"212710ba-9d4e-431f-8a0b-223171c4a135\") " pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.521956 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.521867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:31.659265 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.659235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr"] Jun 11 16:26:31.661801 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:31.661770 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212710ba_9d4e_431f_8a0b_223171c4a135.slice/crio-69322d3587b503ce794a6b7326438a551878d2523ba150a32a88dc6e3295589d WatchSource:0}: Error finding container 69322d3587b503ce794a6b7326438a551878d2523ba150a32a88dc6e3295589d: Status 404 returned error can't find the container with id 69322d3587b503ce794a6b7326438a551878d2523ba150a32a88dc6e3295589d Jun 11 16:26:31.752576 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:31.752539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" event={"ID":"212710ba-9d4e-431f-8a0b-223171c4a135","Type":"ContainerStarted","Data":"69322d3587b503ce794a6b7326438a551878d2523ba150a32a88dc6e3295589d"} Jun 11 16:26:34.768940 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:34.768903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" event={"ID":"212710ba-9d4e-431f-8a0b-223171c4a135","Type":"ContainerStarted","Data":"25d947f3feb63110ebe59595ec3d076844fcfa55a8ffff9dfbf9eefdd5a080b5"} Jun 11 16:26:35.774591 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:35.774553 2562 generic.go:356] "Generic (PLEG): container finished" podID="212710ba-9d4e-431f-8a0b-223171c4a135" containerID="25d947f3feb63110ebe59595ec3d076844fcfa55a8ffff9dfbf9eefdd5a080b5" exitCode=0 Jun 11 16:26:35.775003 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:35.774633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" event={"ID":"212710ba-9d4e-431f-8a0b-223171c4a135","Type":"ContainerDied","Data":"25d947f3feb63110ebe59595ec3d076844fcfa55a8ffff9dfbf9eefdd5a080b5"} Jun 11 16:26:36.780559 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:36.780524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" event={"ID":"212710ba-9d4e-431f-8a0b-223171c4a135","Type":"ContainerStarted","Data":"dae61561b53a67481eeefa6e1ff4f4bdff4b21a48a6883a39c6061a93984a5ec"} Jun 11 16:26:36.780974 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:36.780648 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:36.810749 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:36.810696 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" podStartSLOduration=1.446400772 podStartE2EDuration="5.810678449s" totalImagesPullingTime="3.374422088s" totalInitContainerRuntime="989.855589ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:36.810137954 +0000 UTC m=+400.976104125" watchObservedRunningTime="2026-06-11 16:26:36.810678449 +0000 UTC m=+400.976644617" Jun 11 16:26:47.787142 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:47.787113 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc59bf699-txsnr" Jun 11 16:26:51.261209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.261172 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84dc499667-9qmwh"] Jun 11 16:26:51.264451 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.264429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.272429 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.272410 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:26:51.272541 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.272414 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:26:51.272541 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.272530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 16:26:51.272635 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.272548 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-trh7w\"" Jun 11 16:26:51.276864 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.276847 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:26:51.279471 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.279453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv6md\" (UniqueName: \"kubernetes.io/projected/7e685a5d-c6be-442f-8975-a4d91f27f86a-kube-api-access-nv6md\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.279538 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.279488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e685a5d-c6be-442f-8975-a4d91f27f86a-tmp\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.279538 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.279525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e685a5d-c6be-442f-8975-a4d91f27f86a-tls-certs\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.290269 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.290250 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84dc499667-9qmwh"] Jun 11 16:26:51.380388 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.380349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e685a5d-c6be-442f-8975-a4d91f27f86a-tls-certs\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.380598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.380412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv6md\" (UniqueName: \"kubernetes.io/projected/7e685a5d-c6be-442f-8975-a4d91f27f86a-kube-api-access-nv6md\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.380598 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.380460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e685a5d-c6be-442f-8975-a4d91f27f86a-tmp\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.382941 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.382906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e685a5d-c6be-442f-8975-a4d91f27f86a-tmp\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.383117 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.383099 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e685a5d-c6be-442f-8975-a4d91f27f86a-tls-certs\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.397629 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.397592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv6md\" (UniqueName: \"kubernetes.io/projected/7e685a5d-c6be-442f-8975-a4d91f27f86a-kube-api-access-nv6md\") pod \"kube-auth-proxy-84dc499667-9qmwh\" (UID: \"7e685a5d-c6be-442f-8975-a4d91f27f86a\") " pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.574037 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.573944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" Jun 11 16:26:51.617952 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.617906 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gxsdp"] Jun 11 16:26:51.621249 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.621212 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.625524 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.625315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zhvng\"" Jun 11 16:26:51.625524 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.625388 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 16:26:51.652362 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.652291 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gxsdp"] Jun 11 16:26:51.683464 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.683434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.683624 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.683471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djck6\" (UniqueName: \"kubernetes.io/projected/986daf60-475f-43ef-89b3-c84cdaca56e2-kube-api-access-djck6\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.711893 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.711872 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84dc499667-9qmwh"] Jun 11 16:26:51.714474 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:51.714448 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e685a5d_c6be_442f_8975_a4d91f27f86a.slice/crio-1dad9b075b80b704dfc6ad535f616dad36ea91574224153fd0cbbc0e23852096 WatchSource:0}: Error finding container 1dad9b075b80b704dfc6ad535f616dad36ea91574224153fd0cbbc0e23852096: Status 404 returned error can't find the container with id 1dad9b075b80b704dfc6ad535f616dad36ea91574224153fd0cbbc0e23852096 Jun 11 16:26:51.784208 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.784183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.784362 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.784217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djck6\" (UniqueName: \"kubernetes.io/projected/986daf60-475f-43ef-89b3-c84cdaca56e2-kube-api-access-djck6\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.784362 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:51.784336 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 16:26:51.784437 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:51.784411 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert podName:986daf60-475f-43ef-89b3-c84cdaca56e2 nodeName:}" failed. No retries permitted until 2026-06-11 16:26:52.284390338 +0000 UTC m=+416.450356498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert") pod "odh-model-controller-6dc94f689f-gxsdp" (UID: "986daf60-475f-43ef-89b3-c84cdaca56e2") : secret "odh-model-controller-webhook-cert" not found Jun 11 16:26:51.792805 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.792783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djck6\" (UniqueName: \"kubernetes.io/projected/986daf60-475f-43ef-89b3-c84cdaca56e2-kube-api-access-djck6\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:51.838219 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:51.838139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" event={"ID":"7e685a5d-c6be-442f-8975-a4d91f27f86a","Type":"ContainerStarted","Data":"1dad9b075b80b704dfc6ad535f616dad36ea91574224153fd0cbbc0e23852096"} Jun 11 16:26:52.288471 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.288429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:52.290788 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.290766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/986daf60-475f-43ef-89b3-c84cdaca56e2-cert\") pod \"odh-model-controller-6dc94f689f-gxsdp\" (UID: \"986daf60-475f-43ef-89b3-c84cdaca56e2\") " pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:52.520459 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.520423 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwt22"] Jun 11 16:26:52.523937 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.523912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.526742 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.526718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qbpzn\"" Jun 11 16:26:52.527001 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.526957 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 16:26:52.534805 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.534577 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:52.538697 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.538634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwt22"] Jun 11 16:26:52.591525 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.591482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.591711 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.591561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jplfp\" (UniqueName: \"kubernetes.io/projected/a11eb79c-711e-4b65-b527-067f7a787720-kube-api-access-jplfp\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.692944 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.692906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.693140 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.693005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jplfp\" (UniqueName: \"kubernetes.io/projected/a11eb79c-711e-4b65-b527-067f7a787720-kube-api-access-jplfp\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.693140 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:52.693043 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 16:26:52.693140 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:52.693135 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs podName:a11eb79c-711e-4b65-b527-067f7a787720 nodeName:}" failed. No retries permitted until 2026-06-11 16:26:53.193118637 +0000 UTC m=+417.359084796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs") pod "model-serving-api-5dd488fc48-zwt22" (UID: "a11eb79c-711e-4b65-b527-067f7a787720") : secret "model-serving-api-tls" not found Jun 11 16:26:52.709974 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.709510 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gxsdp"] Jun 11 16:26:52.711667 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.711630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jplfp\" (UniqueName: \"kubernetes.io/projected/a11eb79c-711e-4b65-b527-067f7a787720-kube-api-access-jplfp\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:52.712602 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:52.712577 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986daf60_475f_43ef_89b3_c84cdaca56e2.slice/crio-cc8ccf43b61b184d700c05d60d8f97b7ddfeb083e132a2fce75f9e29213e782a WatchSource:0}: Error finding container cc8ccf43b61b184d700c05d60d8f97b7ddfeb083e132a2fce75f9e29213e782a: Status 404 returned error can't find the container with id cc8ccf43b61b184d700c05d60d8f97b7ddfeb083e132a2fce75f9e29213e782a Jun 11 16:26:52.846470 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:52.846362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" event={"ID":"986daf60-475f-43ef-89b3-c84cdaca56e2","Type":"ContainerStarted","Data":"cc8ccf43b61b184d700c05d60d8f97b7ddfeb083e132a2fce75f9e29213e782a"} Jun 11 16:26:53.198427 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:53.198386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:53.198637 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:53.198559 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 16:26:53.198718 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:26:53.198643 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs podName:a11eb79c-711e-4b65-b527-067f7a787720 nodeName:}" failed. No retries permitted until 2026-06-11 16:26:54.198619954 +0000 UTC m=+418.364586119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs") pod "model-serving-api-5dd488fc48-zwt22" (UID: "a11eb79c-711e-4b65-b527-067f7a787720") : secret "model-serving-api-tls" not found Jun 11 16:26:54.207654 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:54.207414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:54.211663 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:54.211610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a11eb79c-711e-4b65-b527-067f7a787720-tls-certs\") pod \"model-serving-api-5dd488fc48-zwt22\" (UID: \"a11eb79c-711e-4b65-b527-067f7a787720\") " pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:54.338896 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:54.338862 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:56.254189 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.254158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:26:56.353196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.353174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwt22"] Jun 11 16:26:56.356510 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:26:56.356478 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11eb79c_711e_4b65_b527_067f7a787720.slice/crio-256d27fa8a5b8d64d408be8cae93de50fb3a9a01e6dc3390012804c4a3d559c4 WatchSource:0}: Error finding container 256d27fa8a5b8d64d408be8cae93de50fb3a9a01e6dc3390012804c4a3d559c4: Status 404 returned error can't find the container with id 256d27fa8a5b8d64d408be8cae93de50fb3a9a01e6dc3390012804c4a3d559c4 Jun 11 16:26:56.866048 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.866009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" event={"ID":"a11eb79c-711e-4b65-b527-067f7a787720","Type":"ContainerStarted","Data":"256d27fa8a5b8d64d408be8cae93de50fb3a9a01e6dc3390012804c4a3d559c4"} Jun 11 16:26:56.867411 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.867383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" event={"ID":"7e685a5d-c6be-442f-8975-a4d91f27f86a","Type":"ContainerStarted","Data":"7f2bd02dcd04cd53bdb1cc7f774fd9e8a6d2ca717724189fe581025241819dcc"} Jun 11 16:26:56.868769 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.868741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" event={"ID":"986daf60-475f-43ef-89b3-c84cdaca56e2","Type":"ContainerStarted","Data":"7b7781f3f39ce7553e04d7f5c96b697ed3338e3db4ff15d0340ff838df73e3f1"} Jun 11 16:26:56.868889 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.868872 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:26:56.887699 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.887651 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84dc499667-9qmwh" podStartSLOduration=1.353446297 podStartE2EDuration="5.887634985s" totalImagesPullingTime="4.534188688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:56.886790729 +0000 UTC m=+421.052756897" watchObservedRunningTime="2026-06-11 16:26:56.887634985 +0000 UTC m=+421.053601163" Jun 11 16:26:56.906198 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:56.906159 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" podStartSLOduration=2.352223335 podStartE2EDuration="5.906145107s" totalImagesPullingTime="3.553921772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:56.905166633 +0000 UTC m=+421.071132800" watchObservedRunningTime="2026-06-11 16:26:56.906145107 +0000 UTC m=+421.072111275" Jun 11 16:26:58.877553 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:58.877512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" event={"ID":"a11eb79c-711e-4b65-b527-067f7a787720","Type":"ContainerStarted","Data":"acef26f73b08668a189c7598518aa12e7bf638aad136bf417c591c7a6fb884f6"} Jun 11 16:26:58.878032 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:58.877650 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:26:58.897900 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:26:58.897852 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" podStartSLOduration=5.010081954 podStartE2EDuration="6.897838596s" totalImagesPullingTime="1.887756642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:58.897200995 +0000 UTC m=+423.063167164" watchObservedRunningTime="2026-06-11 16:26:58.897838596 +0000 UTC m=+423.063804764" Jun 11 16:27:03.217735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.217699 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ptcsp"] Jun 11 16:27:03.221171 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.221148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.225653 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.225632 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8gpjc\"" Jun 11 16:27:03.225771 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.225636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 16:27:03.242249 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.242217 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ptcsp"] Jun 11 16:27:03.253288 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.253264 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw"] Jun 11 16:27:03.256279 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.256263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.259977 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.259945 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 16:27:03.260105 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.260044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j5zfn\"" Jun 11 16:27:03.276328 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.276303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw"] Jun 11 16:27:03.289054 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.289027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cacaf176-2903-4e45-9778-29d67d9375bc-cert\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.289210 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.289103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz92w\" (UniqueName: \"kubernetes.io/projected/cacaf176-2903-4e45-9778-29d67d9375bc-kube-api-access-nz92w\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.390306 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.390272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cacaf176-2903-4e45-9778-29d67d9375bc-cert\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.390485 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.390313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkb9q\" (UniqueName: \"kubernetes.io/projected/d33bec4a-3db9-431f-8024-a1617e740772-kube-api-access-vkb9q\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.390485 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.390352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.390485 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.390392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz92w\" (UniqueName: \"kubernetes.io/projected/cacaf176-2903-4e45-9778-29d67d9375bc-kube-api-access-nz92w\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.393082 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.393042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cacaf176-2903-4e45-9778-29d67d9375bc-cert\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.405546 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.405515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz92w\" (UniqueName: \"kubernetes.io/projected/cacaf176-2903-4e45-9778-29d67d9375bc-kube-api-access-nz92w\") pod \"kserve-controller-manager-69fc866d76-ptcsp\" (UID: \"cacaf176-2903-4e45-9778-29d67d9375bc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.491288 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.491203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.491437 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:27:03.491316 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 16:27:03.491437 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.491361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkb9q\" (UniqueName: \"kubernetes.io/projected/d33bec4a-3db9-431f-8024-a1617e740772-kube-api-access-vkb9q\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.491437 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:27:03.491372 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert podName:d33bec4a-3db9-431f-8024-a1617e740772 nodeName:}" failed. No retries permitted until 2026-06-11 16:27:03.991355167 +0000 UTC m=+428.157321313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert") pod "llmisvc-controller-manager-864bfd7bc9-l58hw" (UID: "d33bec4a-3db9-431f-8024-a1617e740772") : secret "llmisvc-webhook-server-cert" not found Jun 11 16:27:03.515573 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.515542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkb9q\" (UniqueName: \"kubernetes.io/projected/d33bec4a-3db9-431f-8024-a1617e740772-kube-api-access-vkb9q\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:03.531248 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.531219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:03.760708 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.760636 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ptcsp"] Jun 11 16:27:03.763774 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:27:03.763748 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacaf176_2903_4e45_9778_29d67d9375bc.slice/crio-8c41acf92fa15151769aaa553aeb3bc03b4fd5ed2d4f832c7554a8138723091d WatchSource:0}: Error finding container 8c41acf92fa15151769aaa553aeb3bc03b4fd5ed2d4f832c7554a8138723091d: Status 404 returned error can't find the container with id 8c41acf92fa15151769aaa553aeb3bc03b4fd5ed2d4f832c7554a8138723091d Jun 11 16:27:03.898282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:03.898244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" event={"ID":"cacaf176-2903-4e45-9778-29d67d9375bc","Type":"ContainerStarted","Data":"8c41acf92fa15151769aaa553aeb3bc03b4fd5ed2d4f832c7554a8138723091d"} Jun 11 16:27:04.006976 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:04.006941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:04.009356 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:04.009333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33bec4a-3db9-431f-8024-a1617e740772-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l58hw\" (UID: \"d33bec4a-3db9-431f-8024-a1617e740772\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:04.165475 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:04.165438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:04.297578 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:04.297555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw"] Jun 11 16:27:04.299677 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:27:04.299652 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd33bec4a_3db9_431f_8024_a1617e740772.slice/crio-f052a7670853f9d2ddac3a6eda25bfdf60c3a7d2ecc9f57d545126c0257c4aa0 WatchSource:0}: Error finding container f052a7670853f9d2ddac3a6eda25bfdf60c3a7d2ecc9f57d545126c0257c4aa0: Status 404 returned error can't find the container with id f052a7670853f9d2ddac3a6eda25bfdf60c3a7d2ecc9f57d545126c0257c4aa0 Jun 11 16:27:04.904708 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:04.904675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" event={"ID":"d33bec4a-3db9-431f-8024-a1617e740772","Type":"ContainerStarted","Data":"f052a7670853f9d2ddac3a6eda25bfdf60c3a7d2ecc9f57d545126c0257c4aa0"} Jun 11 16:27:07.339767 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.339729 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9"] Jun 11 16:27:07.342328 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.342306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.385759 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.385727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-blchd\"" Jun 11 16:27:07.385759 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.385749 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 16:27:07.386742 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.386720 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 16:27:07.394320 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.394296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9"] Jun 11 16:27:07.442619 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.442582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b40ab885-55ef-476a-ba07-0ad0f280644b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.442831 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.442647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9dlm\" (UniqueName: \"kubernetes.io/projected/b40ab885-55ef-476a-ba07-0ad0f280644b-kube-api-access-g9dlm\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.544143 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.544102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b40ab885-55ef-476a-ba07-0ad0f280644b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.544291 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.544166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9dlm\" (UniqueName: \"kubernetes.io/projected/b40ab885-55ef-476a-ba07-0ad0f280644b-kube-api-access-g9dlm\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.546720 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.546698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b40ab885-55ef-476a-ba07-0ad0f280644b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.558773 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.558745 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9dlm\" (UniqueName: \"kubernetes.io/projected/b40ab885-55ef-476a-ba07-0ad0f280644b-kube-api-access-g9dlm\") pod \"servicemesh-operator3-57f65f65fb-pzvb9\" (UID: \"b40ab885-55ef-476a-ba07-0ad0f280644b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.653843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.653819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:07.800472 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.800451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9"] Jun 11 16:27:07.803032 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:27:07.803001 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40ab885_55ef_476a_ba07_0ad0f280644b.slice/crio-17a554d41808afe30cc340560aebfcd530eebb7b4c7d82d978a98696f07cb518 WatchSource:0}: Error finding container 17a554d41808afe30cc340560aebfcd530eebb7b4c7d82d978a98696f07cb518: Status 404 returned error can't find the container with id 17a554d41808afe30cc340560aebfcd530eebb7b4c7d82d978a98696f07cb518 Jun 11 16:27:07.874672 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.874646 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-gxsdp" Jun 11 16:27:07.920230 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.920007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" event={"ID":"cacaf176-2903-4e45-9778-29d67d9375bc","Type":"ContainerStarted","Data":"b1202edec2d13b7d9abfe2fe9a201aa96578d0cb7a2aa59234f4eb3ef321d7af"} Jun 11 16:27:07.920230 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.920137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:27:07.922379 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.922353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" event={"ID":"b40ab885-55ef-476a-ba07-0ad0f280644b","Type":"ContainerStarted","Data":"17a554d41808afe30cc340560aebfcd530eebb7b4c7d82d978a98696f07cb518"} Jun 11 16:27:07.924021 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.923994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" event={"ID":"d33bec4a-3db9-431f-8024-a1617e740772","Type":"ContainerStarted","Data":"6d4ffae31be681484d29c5dbc8a2f940a1f3b7e9305afaf13f8154833d135333"} Jun 11 16:27:07.924262 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.924216 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:07.963764 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.963716 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" podStartSLOduration=1.981167642 podStartE2EDuration="4.963698702s" totalImagesPullingTime="2.98253106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:07.962513011 +0000 UTC m=+432.128479179" watchObservedRunningTime="2026-06-11 16:27:07.963698702 +0000 UTC m=+432.129664870" Jun 11 16:27:07.965095 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.965059 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-8c9h9"] Jun 11 16:27:07.967500 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.967480 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:07.969950 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.969931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vm2f6\"" Jun 11 16:27:07.970093 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.969956 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:27:07.980326 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:07.980301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-8c9h9"] Jun 11 16:27:08.008918 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.008870 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" podStartSLOduration=1.697122839 podStartE2EDuration="5.00885386s" totalImagesPullingTime="3.311731021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:07.990870436 +0000 UTC m=+432.156836605" watchObservedRunningTime="2026-06-11 16:27:08.00885386 +0000 UTC m=+432.174820028" Jun 11 16:27:08.048761 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.048723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-redirect-config\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.048996 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.048936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2stk\" (UniqueName: \"kubernetes.io/projected/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-kube-api-access-p2stk\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.149739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.149652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2stk\" (UniqueName: \"kubernetes.io/projected/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-kube-api-access-p2stk\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.149739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.149704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-redirect-config\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.150431 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.150411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-redirect-config\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.165730 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.165704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2stk\" (UniqueName: \"kubernetes.io/projected/b157e859-80e6-4bf1-a516-bdcc33d9f7fd-kube-api-access-p2stk\") pod \"dashboard-redirect-56659f465f-8c9h9\" (UID: \"b157e859-80e6-4bf1-a516-bdcc33d9f7fd\") " pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.279246 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.279213 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" Jun 11 16:27:08.438116 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.437260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56659f465f-8c9h9"] Jun 11 16:27:08.444215 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:27:08.444176 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb157e859_80e6_4bf1_a516_bdcc33d9f7fd.slice/crio-bdaca64f3168a7b1933c77189f9376d6cea131164da6b3d309ad1cf58933a845 WatchSource:0}: Error finding container bdaca64f3168a7b1933c77189f9376d6cea131164da6b3d309ad1cf58933a845: Status 404 returned error can't find the container with id bdaca64f3168a7b1933c77189f9376d6cea131164da6b3d309ad1cf58933a845 Jun 11 16:27:08.932106 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:08.932051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" event={"ID":"b157e859-80e6-4bf1-a516-bdcc33d9f7fd","Type":"ContainerStarted","Data":"bdaca64f3168a7b1933c77189f9376d6cea131164da6b3d309ad1cf58933a845"} Jun 11 16:27:09.886407 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:09.886376 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-zwt22" Jun 11 16:27:10.945527 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:10.945486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" event={"ID":"b40ab885-55ef-476a-ba07-0ad0f280644b","Type":"ContainerStarted","Data":"6c88390fb511f8a056d0a5da50f1ce24c2c8f91aaf59993cfe8ddd9379855fda"} Jun 11 16:27:10.946006 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:10.945575 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:10.974046 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:10.973991 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" podStartSLOduration=1.734985738 podStartE2EDuration="3.973971834s" totalImagesPullingTime="2.238986096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:10.972186556 +0000 UTC m=+435.138152724" watchObservedRunningTime="2026-06-11 16:27:10.973971834 +0000 UTC m=+435.139938004" Jun 11 16:27:14.964847 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:14.964809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" event={"ID":"b157e859-80e6-4bf1-a516-bdcc33d9f7fd","Type":"ContainerStarted","Data":"6b400807c06c7cfa0a19c5c42abcbd726bba2eac8faa3414be394eeb84e30b26"} Jun 11 16:27:14.981815 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:14.981767 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56659f465f-8c9h9" podStartSLOduration=2.498785548 podStartE2EDuration="7.981750668s" totalImagesPullingTime="5.48296512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:14.980697058 +0000 UTC m=+439.146663226" watchObservedRunningTime="2026-06-11 16:27:14.981750668 +0000 UTC m=+439.147716896" Jun 11 16:27:21.953112 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:21.953007 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pzvb9" Jun 11 16:27:24.343345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.343312 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr"] Jun 11 16:27:24.347312 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.347289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.349826 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.349805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 16:27:24.349826 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.349807 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 16:27:24.349989 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.349865 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 16:27:24.350159 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.350144 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:27:24.350341 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.350329 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kchbt\"" Jun 11 16:27:24.360250 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.360229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr"] Jun 11 16:27:24.490384 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fclxg\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-kube-api-access-fclxg\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490571 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d496664-0732-4e25-ba57-c88dda56aa8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.490739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.490626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591323 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591527 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591527 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591527 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591690 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fclxg\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-kube-api-access-fclxg\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591690 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.591784 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d496664-0732-4e25-ba57-c88dda56aa8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.592016 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.591994 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.593892 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.593826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d496664-0732-4e25-ba57-c88dda56aa8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.593991 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.593929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.593991 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.593940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.594649 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.594631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d496664-0732-4e25-ba57-c88dda56aa8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.599175 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.599153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.599275 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.599253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fclxg\" (UniqueName: \"kubernetes.io/projected/9d496664-0732-4e25-ba57-c88dda56aa8a-kube-api-access-fclxg\") pod \"istiod-openshift-gateway-75c67f8887-sqjjr\" (UID: \"9d496664-0732-4e25-ba57-c88dda56aa8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.657038 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.657007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:24.794919 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:24.794877 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr"] Jun 11 16:27:24.797313 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:27:24.797271 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d496664_0732_4e25_ba57_c88dda56aa8a.slice/crio-e1f158644d51bfbc6733f2a68df56bbc4f80a536c47db5e5a5238865701cc335 WatchSource:0}: Error finding container e1f158644d51bfbc6733f2a68df56bbc4f80a536c47db5e5a5238865701cc335: Status 404 returned error can't find the container with id e1f158644d51bfbc6733f2a68df56bbc4f80a536c47db5e5a5238865701cc335 Jun 11 16:27:25.008701 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:25.008666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" event={"ID":"9d496664-0732-4e25-ba57-c88dda56aa8a","Type":"ContainerStarted","Data":"e1f158644d51bfbc6733f2a68df56bbc4f80a536c47db5e5a5238865701cc335"} Jun 11 16:27:27.572871 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:27.572827 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 16:27:27.573138 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:27.572901 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 16:27:28.024256 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:28.024226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" event={"ID":"9d496664-0732-4e25-ba57-c88dda56aa8a","Type":"ContainerStarted","Data":"fa98847aaaabd322cd415debb5c1bc288473daa61b093a10df9ed53965611d34"} Jun 11 16:27:28.024429 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:28.024408 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:28.026156 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:28.026126 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-sqjjr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 16:27:28.026267 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:28.026181 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" podUID="9d496664-0732-4e25-ba57-c88dda56aa8a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:27:28.045890 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:28.045850 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" podStartSLOduration=1.272703951 podStartE2EDuration="4.04583719s" totalImagesPullingTime="2.773133239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:27:28.044628886 +0000 UTC m=+452.210595055" watchObservedRunningTime="2026-06-11 16:27:28.04583719 +0000 UTC m=+452.211803358" Jun 11 16:27:29.030439 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:29.030410 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-sqjjr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 16:27:29.030803 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:29.030477 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" podUID="9d496664-0732-4e25-ba57-c88dda56aa8a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:27:32.030461 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:32.030428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sqjjr" Jun 11 16:27:38.934726 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:38.934692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l58hw" Jun 11 16:27:38.937911 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:27:38.937883 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ptcsp" Jun 11 16:28:30.669801 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.669763 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd"] Jun 11 16:28:30.672803 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.672786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.675628 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.675610 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:28:30.675711 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.675648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:28:30.675890 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.675877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-46q49\"" Jun 11 16:28:30.685853 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.685831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd"] Jun 11 16:28:30.762428 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.762388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.762597 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.762440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvlv\" (UniqueName: \"kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.862915 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.862867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.863117 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.862935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvlv\" (UniqueName: \"kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.863296 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.863275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.872468 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.872445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvlv\" (UniqueName: \"kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:30.984004 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:30.983916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:31.117445 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:31.117420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd"] Jun 11 16:28:31.119711 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:28:31.119684 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968b25ca_2618_4fc0_9faf_6d9a9fdd7c87.slice/crio-ceb2ec247a04ce3e36e60b117872609e42450b5674fa843ae6353b54ccee6d87 WatchSource:0}: Error finding container ceb2ec247a04ce3e36e60b117872609e42450b5674fa843ae6353b54ccee6d87: Status 404 returned error can't find the container with id ceb2ec247a04ce3e36e60b117872609e42450b5674fa843ae6353b54ccee6d87 Jun 11 16:28:31.304525 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:31.304439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" event={"ID":"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87","Type":"ContainerStarted","Data":"ceb2ec247a04ce3e36e60b117872609e42450b5674fa843ae6353b54ccee6d87"} Jun 11 16:28:39.345785 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:39.345757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" event={"ID":"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87","Type":"ContainerStarted","Data":"a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb"} Jun 11 16:28:39.346157 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:39.345844 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:50.351850 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:50.351819 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:50.374566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:50.374515 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" podStartSLOduration=12.930069519 podStartE2EDuration="20.374499545s" totalImagesPullingTime="7.444430026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:39.377496679 +0000 UTC m=+523.543462847" watchObservedRunningTime="2026-06-11 16:28:50.374499545 +0000 UTC m=+534.540465713" Jun 11 16:28:51.998927 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:51.998898 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd"] Jun 11 16:28:51.999357 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:51.999060 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" containerName="manager" containerID="cri-o://a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb" gracePeriod=2 Jun 11 16:28:52.011831 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.011804 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd"] Jun 11 16:28:52.017860 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:28:52.017826 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:52.027895 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.027861 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:28:52.028338 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.028321 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" containerName="manager" Jun 11 16:28:52.028422 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.028339 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" containerName="manager" Jun 11 16:28:52.028422 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.028396 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" containerName="manager" Jun 11 16:28:52.031760 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.031741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.049452 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.049393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:28:52.080165 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:28:52.080135 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" is forbidden: User \"system:node:ip-10-0-129-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-97.ec2.internal' and this object" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:52.141656 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.141628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmw5m\" (UniqueName: \"kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.141786 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.141691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.238931 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.238911 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:52.241104 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:28:52.241056 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gfwd\" is forbidden: User \"system:node:ip-10-0-129-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-97.ec2.internal' and this object" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:52.242361 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.242341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmw5m\" (UniqueName: \"kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.242432 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.242392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.242666 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.242652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.253372 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.253314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmw5m\" (UniqueName: \"kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2fjg6\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.342873 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.342850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume\") pod \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " Jun 11 16:28:52.342963 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.342880 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvlv\" (UniqueName: \"kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv\") pod \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\" (UID: \"968b25ca-2618-4fc0-9faf-6d9a9fdd7c87\") " Jun 11 16:28:52.343323 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.343304 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" (UID: "968b25ca-2618-4fc0-9faf-6d9a9fdd7c87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:28:52.344828 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.344808 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv" (OuterVolumeSpecName: "kube-api-access-tfvlv") pod "968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" (UID: "968b25ca-2618-4fc0-9faf-6d9a9fdd7c87"). InnerVolumeSpecName "kube-api-access-tfvlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:28:52.402476 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.402453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:52.406374 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.406349 2562 generic.go:356] "Generic (PLEG): container finished" podID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" containerID="a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb" exitCode=0 Jun 11 16:28:52.406472 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.406394 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gfwd" Jun 11 16:28:52.406472 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.406445 2562 scope.go:117] "RemoveContainer" containerID="a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb" Jun 11 16:28:52.416550 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.416159 2562 scope.go:117] "RemoveContainer" containerID="a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb" Jun 11 16:28:52.416714 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:28:52.416686 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb\": container with ID starting with a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb not found: ID does not exist" containerID="a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb" Jun 11 16:28:52.416806 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.416719 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb"} err="failed to get container status \"a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb\": rpc error: code = NotFound desc = could not find container \"a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb\": container with ID starting with a0f45a078e8a857adc89381d6a2f85eaea385d7e839a65611f92d9bd15ec82bb not found: ID does not exist" Jun 11 16:28:52.444209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.444176 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvlv\" (UniqueName: \"kubernetes.io/projected/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-kube-api-access-tfvlv\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:28:52.444209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.444204 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87-extensions-socket-volume\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:28:52.531707 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:52.531678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:28:52.534131 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:28:52.534106 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db8760a_fe6a_4a71_802d_71ac48d3fbdd.slice/crio-ccb1498bff6fa80db80ca747981d383bfa3a79efcf390cb3798da6a863827d2d WatchSource:0}: Error finding container ccb1498bff6fa80db80ca747981d383bfa3a79efcf390cb3798da6a863827d2d: Status 404 returned error can't find the container with id ccb1498bff6fa80db80ca747981d383bfa3a79efcf390cb3798da6a863827d2d Jun 11 16:28:53.411897 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:53.411861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" event={"ID":"9db8760a-fe6a-4a71-802d-71ac48d3fbdd","Type":"ContainerStarted","Data":"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3"} Jun 11 16:28:53.412379 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:53.411941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" event={"ID":"9db8760a-fe6a-4a71-802d-71ac48d3fbdd","Type":"ContainerStarted","Data":"ccb1498bff6fa80db80ca747981d383bfa3a79efcf390cb3798da6a863827d2d"} Jun 11 16:28:53.412379 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:53.411968 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:28:53.434589 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:53.434540 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" podStartSLOduration=1.434526064 podStartE2EDuration="1.434526064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:53.432732491 +0000 UTC m=+537.598698661" watchObservedRunningTime="2026-06-11 16:28:53.434526064 +0000 UTC m=+537.600492231" Jun 11 16:28:54.330777 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:28:54.330744 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968b25ca-2618-4fc0-9faf-6d9a9fdd7c87" path="/var/lib/kubelet/pods/968b25ca-2618-4fc0-9faf-6d9a9fdd7c87/volumes" Jun 11 16:29:04.420090 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:04.420042 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:29:08.483399 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.483359 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:29:08.483859 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.483589 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" podUID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" containerName="manager" containerID="cri-o://bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3" gracePeriod=10 Jun 11 16:29:08.716737 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.716705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:29:08.719432 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.719409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.731937 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.731911 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:29:08.733356 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.733330 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:29:08.885052 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.885018 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmw5m\" (UniqueName: \"kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m\") pod \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " Jun 11 16:29:08.885256 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.885184 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume\") pod \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\" (UID: \"9db8760a-fe6a-4a71-802d-71ac48d3fbdd\") " Jun 11 16:29:08.885376 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.885359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.885443 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.885392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghlf\" (UniqueName: \"kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.885578 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.885549 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9db8760a-fe6a-4a71-802d-71ac48d3fbdd" (UID: "9db8760a-fe6a-4a71-802d-71ac48d3fbdd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:29:08.887189 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.887167 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m" (OuterVolumeSpecName: "kube-api-access-nmw5m") pod "9db8760a-fe6a-4a71-802d-71ac48d3fbdd" (UID: "9db8760a-fe6a-4a71-802d-71ac48d3fbdd"). InnerVolumeSpecName "kube-api-access-nmw5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:29:08.985929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.985837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.985929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.985874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghlf\" (UniqueName: \"kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.985929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.985929 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-extensions-socket-volume\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:29:08.986193 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.985940 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmw5m\" (UniqueName: \"kubernetes.io/projected/9db8760a-fe6a-4a71-802d-71ac48d3fbdd-kube-api-access-nmw5m\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:29:08.986230 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.986214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:08.995144 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:08.995121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghlf\" (UniqueName: \"kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf\") pod \"kuadrant-operator-controller-manager-86878c769f-6f7k6\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:09.039986 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.039948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:09.173554 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.173424 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:29:09.176477 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:29:09.176452 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2091cc28_e376_47f3_acd9_c31c41455fd3.slice/crio-509f77471fa2b8e2dc6ea52f9ed3fa16ec4657b144d5c5bad62b3ad288b0e9c6 WatchSource:0}: Error finding container 509f77471fa2b8e2dc6ea52f9ed3fa16ec4657b144d5c5bad62b3ad288b0e9c6: Status 404 returned error can't find the container with id 509f77471fa2b8e2dc6ea52f9ed3fa16ec4657b144d5c5bad62b3ad288b0e9c6 Jun 11 16:29:09.483452 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.483421 2562 generic.go:356] "Generic (PLEG): container finished" podID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" containerID="bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3" exitCode=0 Jun 11 16:29:09.483856 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.483473 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" Jun 11 16:29:09.483856 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.483496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" event={"ID":"9db8760a-fe6a-4a71-802d-71ac48d3fbdd","Type":"ContainerDied","Data":"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3"} Jun 11 16:29:09.483856 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.483548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6" event={"ID":"9db8760a-fe6a-4a71-802d-71ac48d3fbdd","Type":"ContainerDied","Data":"ccb1498bff6fa80db80ca747981d383bfa3a79efcf390cb3798da6a863827d2d"} Jun 11 16:29:09.483856 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.483574 2562 scope.go:117] "RemoveContainer" containerID="bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3" Jun 11 16:29:09.485269 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.485244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" event={"ID":"2091cc28-e376-47f3-acd9-c31c41455fd3","Type":"ContainerStarted","Data":"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934"} Jun 11 16:29:09.485394 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.485292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" event={"ID":"2091cc28-e376-47f3-acd9-c31c41455fd3","Type":"ContainerStarted","Data":"509f77471fa2b8e2dc6ea52f9ed3fa16ec4657b144d5c5bad62b3ad288b0e9c6"} Jun 11 16:29:09.485394 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.485322 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:09.492717 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.492699 2562 scope.go:117] "RemoveContainer" containerID="bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3" Jun 11 16:29:09.492971 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:29:09.492955 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3\": container with ID starting with bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3 not found: ID does not exist" containerID="bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3" Jun 11 16:29:09.493017 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.492979 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3"} err="failed to get container status \"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3\": rpc error: code = NotFound desc = could not find container \"bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3\": container with ID starting with bb926fa23e527efadf8169031a5a3b25e9f376cf9a9383e6b2147330d55f6cd3 not found: ID does not exist" Jun 11 16:29:09.520545 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.520491 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" podStartSLOduration=1.520478016 podStartE2EDuration="1.520478016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:09.519177785 +0000 UTC m=+553.685143954" watchObservedRunningTime="2026-06-11 16:29:09.520478016 +0000 UTC m=+553.686444183" Jun 11 16:29:09.533875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.533852 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:29:09.546671 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:09.546648 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2fjg6"] Jun 11 16:29:10.330998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:10.330966 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" path="/var/lib/kubelet/pods/9db8760a-fe6a-4a71-802d-71ac48d3fbdd/volumes" Jun 11 16:29:20.493487 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:20.493455 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:29:38.304342 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.304282 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:29:38.304795 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.304657 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" containerName="manager" Jun 11 16:29:38.304795 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.304672 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" containerName="manager" Jun 11 16:29:38.304795 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.304743 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db8760a-fe6a-4a71-802d-71ac48d3fbdd" containerName="manager" Jun 11 16:29:38.307479 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.307464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.310155 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.310131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8f82d\"" Jun 11 16:29:38.310273 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.310209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:29:38.318753 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.318725 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:29:38.361075 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.361042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:29:38.429486 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.429454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79d86cf0-23a2-47f6-a129-f1ee41ef850d-config-file\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.429486 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.429485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wptt\" (UniqueName: \"kubernetes.io/projected/79d86cf0-23a2-47f6-a129-f1ee41ef850d-kube-api-access-2wptt\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.529906 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.529868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79d86cf0-23a2-47f6-a129-f1ee41ef850d-config-file\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.529906 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.529903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wptt\" (UniqueName: \"kubernetes.io/projected/79d86cf0-23a2-47f6-a129-f1ee41ef850d-kube-api-access-2wptt\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.530510 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.530491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79d86cf0-23a2-47f6-a129-f1ee41ef850d-config-file\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.541539 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.541506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wptt\" (UniqueName: \"kubernetes.io/projected/79d86cf0-23a2-47f6-a129-f1ee41ef850d-kube-api-access-2wptt\") pod \"limitador-limitador-54d6d988d5-65hvk\" (UID: \"79d86cf0-23a2-47f6-a129-f1ee41ef850d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.619332 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.619253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:38.759120 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:38.759091 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:29:38.761689 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:29:38.761661 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d86cf0_23a2_47f6_a129_f1ee41ef850d.slice/crio-a94e33d712f449f9c26cf1ceb3a246ab207231eb0d2a13ac8a502ba8322769d1 WatchSource:0}: Error finding container a94e33d712f449f9c26cf1ceb3a246ab207231eb0d2a13ac8a502ba8322769d1: Status 404 returned error can't find the container with id a94e33d712f449f9c26cf1ceb3a246ab207231eb0d2a13ac8a502ba8322769d1 Jun 11 16:29:39.623077 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:39.623028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" event={"ID":"79d86cf0-23a2-47f6-a129-f1ee41ef850d","Type":"ContainerStarted","Data":"a94e33d712f449f9c26cf1ceb3a246ab207231eb0d2a13ac8a502ba8322769d1"} Jun 11 16:29:42.641202 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:42.641160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" event={"ID":"79d86cf0-23a2-47f6-a129-f1ee41ef850d","Type":"ContainerStarted","Data":"3049a0e611628cbbf17ad42ecdfe19ef4f589fd03ba8397834b60da417f64cb0"} Jun 11 16:29:42.641599 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:42.641297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:42.662472 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:42.662425 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" podStartSLOduration=1.712705267 podStartE2EDuration="4.662410876s" totalImagesPullingTime="2.949705609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:42.660790401 +0000 UTC m=+586.826756588" watchObservedRunningTime="2026-06-11 16:29:42.662410876 +0000 UTC m=+586.828377085" Jun 11 16:29:53.648564 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:53.648536 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-65hvk" Jun 11 16:29:56.284340 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:56.284312 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:29:56.287640 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:29:56.287610 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:31:12.759011 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.758980 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:12.761279 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.761264 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.764543 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.764525 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:31:12.764627 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.764600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jmb4g\"" Jun 11 16:31:12.764692 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.764673 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:31:12.778746 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.775601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:12.802725 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.802703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.802836 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.802783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rb5\" (UniqueName: \"kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.903485 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.903456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.903624 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.903558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rb5\" (UniqueName: \"kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.906016 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.905986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.911940 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.911910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rb5\" (UniqueName: \"kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5\") pod \"maas-controller-7879698b44-zmkln\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:12.973775 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.973750 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:31:12.976196 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.976173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:12.995248 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:12.995226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:31:13.004595 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.004571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29v8\" (UniqueName: \"kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.004712 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.004694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.071794 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.071721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:13.105569 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.105540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.105717 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.105597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29v8\" (UniqueName: \"kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.108022 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.107996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.116806 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.116781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29v8\" (UniqueName: \"kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8\") pod \"maas-controller-649cbd5bf-z6nld\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.205978 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.205936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:13.208363 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:31:13.208336 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04027b25_c354_42d4_b42b_c0591ec13f56.slice/crio-5a9da1a0f7b4ba6f4e17a3ad028a0b3516fd96dc429b1ce372e065157f4779e6 WatchSource:0}: Error finding container 5a9da1a0f7b4ba6f4e17a3ad028a0b3516fd96dc429b1ce372e065157f4779e6: Status 404 returned error can't find the container with id 5a9da1a0f7b4ba6f4e17a3ad028a0b3516fd96dc429b1ce372e065157f4779e6 Jun 11 16:31:13.209562 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.209544 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:31:13.286805 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.286765 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:13.413768 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:13.413739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:31:13.416710 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:31:13.416684 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b734ea6_8681_4841_b80b_fba886579ae8.slice/crio-56b062766ad8daed8d32a6e35932aff8746ec814ed0afbffe68f26179baad4e7 WatchSource:0}: Error finding container 56b062766ad8daed8d32a6e35932aff8746ec814ed0afbffe68f26179baad4e7: Status 404 returned error can't find the container with id 56b062766ad8daed8d32a6e35932aff8746ec814ed0afbffe68f26179baad4e7 Jun 11 16:31:14.046340 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:14.046270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-649cbd5bf-z6nld" event={"ID":"2b734ea6-8681-4841-b80b-fba886579ae8","Type":"ContainerStarted","Data":"56b062766ad8daed8d32a6e35932aff8746ec814ed0afbffe68f26179baad4e7"} Jun 11 16:31:14.048589 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:14.048529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7879698b44-zmkln" event={"ID":"04027b25-c354-42d4-b42b-c0591ec13f56","Type":"ContainerStarted","Data":"5a9da1a0f7b4ba6f4e17a3ad028a0b3516fd96dc429b1ce372e065157f4779e6"} Jun 11 16:31:16.064101 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.063999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-649cbd5bf-z6nld" event={"ID":"2b734ea6-8681-4841-b80b-fba886579ae8","Type":"ContainerStarted","Data":"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e"} Jun 11 16:31:16.064521 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.064197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:16.065620 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.065599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7879698b44-zmkln" event={"ID":"04027b25-c354-42d4-b42b-c0591ec13f56","Type":"ContainerStarted","Data":"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56"} Jun 11 16:31:16.065737 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.065723 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:16.090751 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.090701 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-649cbd5bf-z6nld" podStartSLOduration=1.744468247 podStartE2EDuration="4.090683683s" totalImagesPullingTime="2.346215436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:16.088823899 +0000 UTC m=+680.254790068" watchObservedRunningTime="2026-06-11 16:31:16.090683683 +0000 UTC m=+680.256649850" Jun 11 16:31:16.127221 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:16.127161 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7879698b44-zmkln" podStartSLOduration=1.537327551 podStartE2EDuration="4.127140062s" totalImagesPullingTime="2.589812511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:16.12620657 +0000 UTC m=+680.292172738" watchObservedRunningTime="2026-06-11 16:31:16.127140062 +0000 UTC m=+680.293106221" Jun 11 16:31:27.075626 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.075597 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:31:27.076117 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.075662 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:27.159633 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.159601 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:27.159965 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.159882 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7879698b44-zmkln" podUID="04027b25-c354-42d4-b42b-c0591ec13f56" containerName="manager" containerID="cri-o://47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56" gracePeriod=30 Jun 11 16:31:27.405480 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.405456 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:27.529739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.529705 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8rb5\" (UniqueName: \"kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5\") pod \"04027b25-c354-42d4-b42b-c0591ec13f56\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " Jun 11 16:31:27.529937 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.529753 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert\") pod \"04027b25-c354-42d4-b42b-c0591ec13f56\" (UID: \"04027b25-c354-42d4-b42b-c0591ec13f56\") " Jun 11 16:31:27.531823 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.531794 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5" (OuterVolumeSpecName: "kube-api-access-q8rb5") pod "04027b25-c354-42d4-b42b-c0591ec13f56" (UID: "04027b25-c354-42d4-b42b-c0591ec13f56"). InnerVolumeSpecName "kube-api-access-q8rb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:31:27.531913 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.531877 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "04027b25-c354-42d4-b42b-c0591ec13f56" (UID: "04027b25-c354-42d4-b42b-c0591ec13f56"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:31:27.630569 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.630534 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8rb5\" (UniqueName: \"kubernetes.io/projected/04027b25-c354-42d4-b42b-c0591ec13f56-kube-api-access-q8rb5\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:31:27.630569 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:27.630565 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04027b25-c354-42d4-b42b-c0591ec13f56-webhook-cert\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:31:28.132512 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.132480 2562 generic.go:356] "Generic (PLEG): container finished" podID="04027b25-c354-42d4-b42b-c0591ec13f56" containerID="47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56" exitCode=0 Jun 11 16:31:28.132946 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.132521 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7879698b44-zmkln" Jun 11 16:31:28.132946 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.132570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7879698b44-zmkln" event={"ID":"04027b25-c354-42d4-b42b-c0591ec13f56","Type":"ContainerDied","Data":"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56"} Jun 11 16:31:28.132946 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.132632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7879698b44-zmkln" event={"ID":"04027b25-c354-42d4-b42b-c0591ec13f56","Type":"ContainerDied","Data":"5a9da1a0f7b4ba6f4e17a3ad028a0b3516fd96dc429b1ce372e065157f4779e6"} Jun 11 16:31:28.132946 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.132668 2562 scope.go:117] "RemoveContainer" containerID="47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56" Jun 11 16:31:28.141356 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.141341 2562 scope.go:117] "RemoveContainer" containerID="47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56" Jun 11 16:31:28.141617 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:31:28.141600 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56\": container with ID starting with 47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56 not found: ID does not exist" containerID="47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56" Jun 11 16:31:28.141663 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.141624 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56"} err="failed to get container status \"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56\": rpc error: code = NotFound desc = could not find container \"47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56\": container with ID starting with 47e6efdde557c15fce2d6667b1cf949f4634912514043576ae1a3c308bb68b56 not found: ID does not exist" Jun 11 16:31:28.158669 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.158647 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:28.162842 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.162820 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7879698b44-zmkln"] Jun 11 16:31:28.330818 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:28.330782 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04027b25-c354-42d4-b42b-c0591ec13f56" path="/var/lib/kubelet/pods/04027b25-c354-42d4-b42b-c0591ec13f56/volumes" Jun 11 16:31:47.546303 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.546269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:31:47.786147 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.786112 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tgpdd"] Jun 11 16:31:47.786545 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.786526 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04027b25-c354-42d4-b42b-c0591ec13f56" containerName="manager" Jun 11 16:31:47.786635 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.786547 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04027b25-c354-42d4-b42b-c0591ec13f56" containerName="manager" Jun 11 16:31:47.786688 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.786660 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04027b25-c354-42d4-b42b-c0591ec13f56" containerName="manager" Jun 11 16:31:47.788904 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.788882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:47.791366 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.791349 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:31:47.791479 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.791457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pmn9x\"" Jun 11 16:31:47.799097 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.799024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tgpdd"] Jun 11 16:31:47.901409 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:47.901380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vzn\" (UniqueName: \"kubernetes.io/projected/f08cd957-de29-486a-87de-8fa1c780546c-kube-api-access-b4vzn\") pod \"payload-processing-699b6cd6c-tgpdd\" (UID: \"f08cd957-de29-486a-87de-8fa1c780546c\") " pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:48.002025 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:48.001987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vzn\" (UniqueName: \"kubernetes.io/projected/f08cd957-de29-486a-87de-8fa1c780546c-kube-api-access-b4vzn\") pod \"payload-processing-699b6cd6c-tgpdd\" (UID: \"f08cd957-de29-486a-87de-8fa1c780546c\") " pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:48.011550 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:48.011518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vzn\" (UniqueName: \"kubernetes.io/projected/f08cd957-de29-486a-87de-8fa1c780546c-kube-api-access-b4vzn\") pod \"payload-processing-699b6cd6c-tgpdd\" (UID: \"f08cd957-de29-486a-87de-8fa1c780546c\") " pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:48.100577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:48.100497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:48.242781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:48.242759 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tgpdd"] Jun 11 16:31:48.245268 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:31:48.245243 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08cd957_de29_486a_87de_8fa1c780546c.slice/crio-2e459f04d4b66768a88f3fc7dc569832552fc60af3ae4deed150dfae0e9cddff WatchSource:0}: Error finding container 2e459f04d4b66768a88f3fc7dc569832552fc60af3ae4deed150dfae0e9cddff: Status 404 returned error can't find the container with id 2e459f04d4b66768a88f3fc7dc569832552fc60af3ae4deed150dfae0e9cddff Jun 11 16:31:49.229482 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:49.229390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" event={"ID":"f08cd957-de29-486a-87de-8fa1c780546c","Type":"ContainerStarted","Data":"2e459f04d4b66768a88f3fc7dc569832552fc60af3ae4deed150dfae0e9cddff"} Jun 11 16:31:51.240528 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:51.240493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" event={"ID":"f08cd957-de29-486a-87de-8fa1c780546c","Type":"ContainerStarted","Data":"b955f848670c74658304c934ba02c686555fdd96681cf2a2fee719462d12de05"} Jun 11 16:31:51.241004 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:51.240618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:31:51.257023 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:31:51.256969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" podStartSLOduration=2.146882197 podStartE2EDuration="4.256951205s" totalImagesPullingTime="2.110069008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:51.256288168 +0000 UTC m=+715.422254340" watchObservedRunningTime="2026-06-11 16:31:51.256951205 +0000 UTC m=+715.422917374" Jun 11 16:32:02.247260 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:32:02.247223 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-tgpdd" Jun 11 16:34:56.316493 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:34:56.316463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:34:56.317348 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:34:56.317325 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:35:06.934400 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:06.934365 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:10.123314 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:10.123275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:17.393289 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.393258 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k"] Jun 11 16:35:17.395896 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.395871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.398747 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.398723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:35:17.398884 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.398723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 16:35:17.399714 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.399697 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lfnwp\"" Jun 11 16:35:17.399801 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.399738 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:35:17.407974 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.407952 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k"] Jun 11 16:35:17.547552 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.547722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h2w6\" (UniqueName: \"kubernetes.io/projected/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kube-api-access-8h2w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.547722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.547722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.547722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.547923 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.547818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.648929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.648853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.648929 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.648896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649178 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h2w6\" (UniqueName: \"kubernetes.io/projected/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kube-api-access-8h2w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649178 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649290 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649346 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649346 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649454 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.649519 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.649502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.651367 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.651336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.651536 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.651515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.661195 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.661174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h2w6\" (UniqueName: \"kubernetes.io/projected/fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0-kube-api-access-8h2w6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k\" (UID: \"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.708290 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.708254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:17.839322 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:17.839298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k"] Jun 11 16:35:17.841669 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:35:17.841647 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb5d532_ca5e_4d0e_9884_16faf7fbb5b0.slice/crio-6fbc1c61253ef7bc7f84bbab464a6dd324dce6055ac51cab705a38f8b1e86c5e WatchSource:0}: Error finding container 6fbc1c61253ef7bc7f84bbab464a6dd324dce6055ac51cab705a38f8b1e86c5e: Status 404 returned error can't find the container with id 6fbc1c61253ef7bc7f84bbab464a6dd324dce6055ac51cab705a38f8b1e86c5e Jun 11 16:35:18.107045 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:18.106974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:18.182881 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:18.182838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" event={"ID":"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0","Type":"ContainerStarted","Data":"6fbc1c61253ef7bc7f84bbab464a6dd324dce6055ac51cab705a38f8b1e86c5e"} Jun 11 16:35:21.201802 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:21.201759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" event={"ID":"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0","Type":"ContainerStarted","Data":"f8b92f292e7561f1bb63a8c7469735a4b4733b3b334a46dbd6f73920aec7b49d"} Jun 11 16:35:31.108909 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:31.108875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:31.254501 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:31.254464 2562 generic.go:356] "Generic (PLEG): container finished" podID="fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0" containerID="f8b92f292e7561f1bb63a8c7469735a4b4733b3b334a46dbd6f73920aec7b49d" exitCode=0 Jun 11 16:35:31.254660 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:31.254536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" event={"ID":"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0","Type":"ContainerDied","Data":"f8b92f292e7561f1bb63a8c7469735a4b4733b3b334a46dbd6f73920aec7b49d"} Jun 11 16:35:33.265927 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:33.265884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" event={"ID":"fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0","Type":"ContainerStarted","Data":"04bb2b448881bf6885866f495b7784ebc2ace41fea2742403a7f60b92f016e80"} Jun 11 16:35:33.296719 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:33.296664 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" podStartSLOduration=2.82410359 podStartE2EDuration="16.296643984s" totalImagesPullingTime="3.95621244s" totalInitContainerRuntime="9.516327954s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:33.296369921 +0000 UTC m=+937.462336089" watchObservedRunningTime="2026-06-11 16:35:33.296643984 +0000 UTC m=+937.462610153" Jun 11 16:35:35.870425 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.870389 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7"] Jun 11 16:35:35.873153 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.873135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.875396 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.875376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 16:35:35.882739 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.882717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7"] Jun 11 16:35:35.893803 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.893779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pglw\" (UniqueName: \"kubernetes.io/projected/fb250b50-8a42-4d15-a3e5-4366c777df64-kube-api-access-2pglw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.893883 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.893837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.893948 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.893898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.893999 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.893966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.894059 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.894013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.894141 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.894060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb250b50-8a42-4d15-a3e5-4366c777df64-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994467 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb250b50-8a42-4d15-a3e5-4366c777df64-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994600 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pglw\" (UniqueName: \"kubernetes.io/projected/fb250b50-8a42-4d15-a3e5-4366c777df64-kube-api-access-2pglw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994807 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994807 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994923 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.994987 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.994937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.996657 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.996631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb250b50-8a42-4d15-a3e5-4366c777df64-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:35.996987 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:35.996967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb250b50-8a42-4d15-a3e5-4366c777df64-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:36.004211 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:36.004192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pglw\" (UniqueName: \"kubernetes.io/projected/fb250b50-8a42-4d15-a3e5-4366c777df64-kube-api-access-2pglw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rqll7\" (UID: \"fb250b50-8a42-4d15-a3e5-4366c777df64\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:36.184134 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:36.184101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:36.322823 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:36.322794 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7"] Jun 11 16:35:36.326668 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:35:36.326639 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb250b50_8a42_4d15_a3e5_4366c777df64.slice/crio-188c29c966f22ae864f7b2736b53898f488d3bad0fb1cbd50db5c4df5b2efcb2 WatchSource:0}: Error finding container 188c29c966f22ae864f7b2736b53898f488d3bad0fb1cbd50db5c4df5b2efcb2: Status 404 returned error can't find the container with id 188c29c966f22ae864f7b2736b53898f488d3bad0fb1cbd50db5c4df5b2efcb2 Jun 11 16:35:37.072200 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.072168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:37.289811 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.289775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" event={"ID":"fb250b50-8a42-4d15-a3e5-4366c777df64","Type":"ContainerStarted","Data":"fb76e5701c2d625e905ce12c4390d417a1bb0e3c1c72fac400ad7bc15c35b570"} Jun 11 16:35:37.289963 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.289827 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" event={"ID":"fb250b50-8a42-4d15-a3e5-4366c777df64","Type":"ContainerStarted","Data":"188c29c966f22ae864f7b2736b53898f488d3bad0fb1cbd50db5c4df5b2efcb2"} Jun 11 16:35:37.708395 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.708368 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:37.708528 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.708508 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:37.721368 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:37.721349 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:38.295588 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:38.295559 2562 generic.go:356] "Generic (PLEG): container finished" podID="fb250b50-8a42-4d15-a3e5-4366c777df64" containerID="fb76e5701c2d625e905ce12c4390d417a1bb0e3c1c72fac400ad7bc15c35b570" exitCode=0 Jun 11 16:35:38.295953 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:38.295640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" event={"ID":"fb250b50-8a42-4d15-a3e5-4366c777df64","Type":"ContainerDied","Data":"fb76e5701c2d625e905ce12c4390d417a1bb0e3c1c72fac400ad7bc15c35b570"} Jun 11 16:35:38.307173 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:38.307154 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k" Jun 11 16:35:39.302079 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:39.302035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" event={"ID":"fb250b50-8a42-4d15-a3e5-4366c777df64","Type":"ContainerStarted","Data":"657258d2c86d9b812bbc3f3ea19e4c586e2673fdb513e9f571d59e27cad45c59"} Jun 11 16:35:39.325756 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:39.325704 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" podStartSLOduration=2.8104866 podStartE2EDuration="4.325683778s" totalImagesPullingTime="220.891919ms" totalInitContainerRuntime="1.294305259s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:39.322452825 +0000 UTC m=+943.488418993" watchObservedRunningTime="2026-06-11 16:35:39.325683778 +0000 UTC m=+943.491649946" Jun 11 16:35:43.593369 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:43.593332 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:35:46.184820 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:46.184778 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:46.185247 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:46.184852 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:46.197440 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:46.197417 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:35:46.347438 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:35:46.347414 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rqll7" Jun 11 16:36:40.358815 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.358782 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:36:40.362139 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.362118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.379077 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.379037 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:36:40.512875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.512838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.512875 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.512874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9zz\" (UniqueName: \"kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.614462 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.614381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.614462 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.614411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9zz\" (UniqueName: \"kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.616816 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.616785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.623481 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.623459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9zz\" (UniqueName: \"kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz\") pod \"maas-controller-d4cc65c97-qt5nx\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.672157 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.672136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:40.801766 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.801739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:36:40.803808 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:36:40.803781 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb084a4c8_5821_4a7a_bf37_af0d2b45ca2a.slice/crio-89f392510057a4a9e01c58ac37cd2f7a81c1ec6a4165ab79ef020267357d1df2 WatchSource:0}: Error finding container 89f392510057a4a9e01c58ac37cd2f7a81c1ec6a4165ab79ef020267357d1df2: Status 404 returned error can't find the container with id 89f392510057a4a9e01c58ac37cd2f7a81c1ec6a4165ab79ef020267357d1df2 Jun 11 16:36:40.805208 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:40.805191 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:36:41.587976 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:41.587939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" event={"ID":"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a","Type":"ContainerStarted","Data":"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031"} Jun 11 16:36:41.588373 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:41.587991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" event={"ID":"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a","Type":"ContainerStarted","Data":"89f392510057a4a9e01c58ac37cd2f7a81c1ec6a4165ab79ef020267357d1df2"} Jun 11 16:36:41.588373 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:41.588074 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:41.607118 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:41.607054 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" podStartSLOduration=1.033028882 podStartE2EDuration="1.607040512s" totalImagesPullingTime="574.01163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:41.605805283 +0000 UTC m=+1005.771771451" watchObservedRunningTime="2026-06-11 16:36:41.607040512 +0000 UTC m=+1005.773006708" Jun 11 16:36:52.599886 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:52.599856 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:36:52.666347 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:52.666318 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:36:52.666547 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:52.666523 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-649cbd5bf-z6nld" podUID="2b734ea6-8681-4841-b80b-fba886579ae8" containerName="manager" containerID="cri-o://7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e" gracePeriod=30 Jun 11 16:36:52.911256 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:52.911234 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:36:53.015352 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.015319 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g29v8\" (UniqueName: \"kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8\") pod \"2b734ea6-8681-4841-b80b-fba886579ae8\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " Jun 11 16:36:53.015505 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.015433 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert\") pod \"2b734ea6-8681-4841-b80b-fba886579ae8\" (UID: \"2b734ea6-8681-4841-b80b-fba886579ae8\") " Jun 11 16:36:53.017476 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.017445 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8" (OuterVolumeSpecName: "kube-api-access-g29v8") pod "2b734ea6-8681-4841-b80b-fba886579ae8" (UID: "2b734ea6-8681-4841-b80b-fba886579ae8"). InnerVolumeSpecName "kube-api-access-g29v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:53.017590 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.017523 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b734ea6-8681-4841-b80b-fba886579ae8" (UID: "2b734ea6-8681-4841-b80b-fba886579ae8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:53.116692 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.116659 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g29v8\" (UniqueName: \"kubernetes.io/projected/2b734ea6-8681-4841-b80b-fba886579ae8-kube-api-access-g29v8\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:36:53.116692 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.116686 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b734ea6-8681-4841-b80b-fba886579ae8-webhook-cert\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:36:53.643821 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.643786 2562 generic.go:356] "Generic (PLEG): container finished" podID="2b734ea6-8681-4841-b80b-fba886579ae8" containerID="7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e" exitCode=0 Jun 11 16:36:53.644277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.643835 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-649cbd5bf-z6nld" Jun 11 16:36:53.644277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.643873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-649cbd5bf-z6nld" event={"ID":"2b734ea6-8681-4841-b80b-fba886579ae8","Type":"ContainerDied","Data":"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e"} Jun 11 16:36:53.644277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.643936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-649cbd5bf-z6nld" event={"ID":"2b734ea6-8681-4841-b80b-fba886579ae8","Type":"ContainerDied","Data":"56b062766ad8daed8d32a6e35932aff8746ec814ed0afbffe68f26179baad4e7"} Jun 11 16:36:53.644277 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.643971 2562 scope.go:117] "RemoveContainer" containerID="7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e" Jun 11 16:36:53.653295 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.653283 2562 scope.go:117] "RemoveContainer" containerID="7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e" Jun 11 16:36:53.653518 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:36:53.653492 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e\": container with ID starting with 7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e not found: ID does not exist" containerID="7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e" Jun 11 16:36:53.653584 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.653518 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e"} err="failed to get container status \"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e\": rpc error: code = NotFound desc = could not find container \"7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e\": container with ID starting with 7b29f9fb28f4679eef7d7ecb68d072d939558551a2c9a6b0063c765719ece34e not found: ID does not exist" Jun 11 16:36:53.674715 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.674691 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:36:53.681862 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:53.681841 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-649cbd5bf-z6nld"] Jun 11 16:36:54.329975 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:36:54.329941 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b734ea6-8681-4841-b80b-fba886579ae8" path="/var/lib/kubelet/pods/2b734ea6-8681-4841-b80b-fba886579ae8/volumes" Jun 11 16:37:14.632748 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:14.632715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:37:18.900345 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:18.900312 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:37:25.399548 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:25.399508 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:37:35.288132 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:35.288098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:37:44.878577 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:44.878544 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:37:55.223753 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:37:55.223713 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:38:04.101991 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:04.101958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:38:14.694320 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:14.694287 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:38:22.285542 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.285505 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:38:22.285988 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.285700 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" podUID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" containerName="manager" containerID="cri-o://4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031" gracePeriod=30 Jun 11 16:38:22.525439 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.525417 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:38:22.625735 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.625710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert\") pod \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " Jun 11 16:38:22.625911 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.625813 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld9zz\" (UniqueName: \"kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz\") pod \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\" (UID: \"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a\") " Jun 11 16:38:22.627826 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.627793 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz" (OuterVolumeSpecName: "kube-api-access-ld9zz") pod "b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" (UID: "b084a4c8-5821-4a7a-bf37-af0d2b45ca2a"). InnerVolumeSpecName "kube-api-access-ld9zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:38:22.627826 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.627811 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" (UID: "b084a4c8-5821-4a7a-bf37-af0d2b45ca2a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:38:22.727209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.727186 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld9zz\" (UniqueName: \"kubernetes.io/projected/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-kube-api-access-ld9zz\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:38:22.727209 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:22.727207 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a-webhook-cert\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:38:23.070479 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.070393 2562 generic.go:356] "Generic (PLEG): container finished" podID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" containerID="4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031" exitCode=0 Jun 11 16:38:23.070479 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.070442 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" Jun 11 16:38:23.070643 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.070479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" event={"ID":"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a","Type":"ContainerDied","Data":"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031"} Jun 11 16:38:23.070643 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.070532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-qt5nx" event={"ID":"b084a4c8-5821-4a7a-bf37-af0d2b45ca2a","Type":"ContainerDied","Data":"89f392510057a4a9e01c58ac37cd2f7a81c1ec6a4165ab79ef020267357d1df2"} Jun 11 16:38:23.070643 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.070556 2562 scope.go:117] "RemoveContainer" containerID="4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031" Jun 11 16:38:23.079698 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.079681 2562 scope.go:117] "RemoveContainer" containerID="4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031" Jun 11 16:38:23.079929 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:38:23.079910 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031\": container with ID starting with 4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031 not found: ID does not exist" containerID="4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031" Jun 11 16:38:23.079978 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.079938 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031"} err="failed to get container status \"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031\": rpc error: code = NotFound desc = could not find container \"4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031\": container with ID starting with 4b674f56013b293d54a41c4b880f36fa3b3fd45bc96bacbd29634d89b40e5031 not found: ID does not exist" Jun 11 16:38:23.090017 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.089997 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:38:23.094058 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.094040 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-qt5nx"] Jun 11 16:38:23.846452 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846419 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4cc65c97-5gxmf"] Jun 11 16:38:23.846817 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846744 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b734ea6-8681-4841-b80b-fba886579ae8" containerName="manager" Jun 11 16:38:23.846817 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846756 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b734ea6-8681-4841-b80b-fba886579ae8" containerName="manager" Jun 11 16:38:23.846817 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846772 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" containerName="manager" Jun 11 16:38:23.846817 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846777 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" containerName="manager" Jun 11 16:38:23.846947 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846838 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b734ea6-8681-4841-b80b-fba886579ae8" containerName="manager" Jun 11 16:38:23.846947 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.846847 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" containerName="manager" Jun 11 16:38:23.850781 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.850764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:23.854836 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.854815 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jmb4g\"" Jun 11 16:38:23.854966 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.854815 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:38:23.854966 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.854820 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:38:23.857835 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.857709 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-5gxmf"] Jun 11 16:38:23.936009 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.935981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-webhook-cert\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:23.936170 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:23.936055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqfk\" (UniqueName: \"kubernetes.io/projected/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-kube-api-access-pbqfk\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.036616 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.036586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqfk\" (UniqueName: \"kubernetes.io/projected/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-kube-api-access-pbqfk\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.036770 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.036630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-webhook-cert\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.038984 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.038959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-webhook-cert\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.046137 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.046109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqfk\" (UniqueName: \"kubernetes.io/projected/a4c23cc7-27a0-46e8-b4cf-e8de660d82f8-kube-api-access-pbqfk\") pod \"maas-controller-d4cc65c97-5gxmf\" (UID: \"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8\") " pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.162566 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.162539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:24.291382 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.291207 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4cc65c97-5gxmf"] Jun 11 16:38:24.294043 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:38:24.294020 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c23cc7_27a0_46e8_b4cf_e8de660d82f8.slice/crio-f366aeb2618267d087252af7a546010ef59680ac6a009fad6fbe63c90e4b2811 WatchSource:0}: Error finding container f366aeb2618267d087252af7a546010ef59680ac6a009fad6fbe63c90e4b2811: Status 404 returned error can't find the container with id f366aeb2618267d087252af7a546010ef59680ac6a009fad6fbe63c90e4b2811 Jun 11 16:38:24.335228 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:24.332961 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b084a4c8-5821-4a7a-bf37-af0d2b45ca2a" path="/var/lib/kubelet/pods/b084a4c8-5821-4a7a-bf37-af0d2b45ca2a/volumes" Jun 11 16:38:25.082282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:25.082201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" event={"ID":"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8","Type":"ContainerStarted","Data":"1add8cc4a54881ceb39299028307da7d8f95dc6eada7ab1a0cca65f6ca084efd"} Jun 11 16:38:25.082282 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:25.082260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" event={"ID":"a4c23cc7-27a0-46e8-b4cf-e8de660d82f8","Type":"ContainerStarted","Data":"f366aeb2618267d087252af7a546010ef59680ac6a009fad6fbe63c90e4b2811"} Jun 11 16:38:25.082647 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:25.082296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:25.115686 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:25.115642 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" podStartSLOduration=1.726597032 podStartE2EDuration="2.115628574s" totalImagesPullingTime="389.031542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:38:25.11420653 +0000 UTC m=+1109.280172699" watchObservedRunningTime="2026-06-11 16:38:25.115628574 +0000 UTC m=+1109.281594766" Jun 11 16:38:36.096207 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:36.096173 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4cc65c97-5gxmf" Jun 11 16:38:46.912926 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:46.912890 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:38:52.386648 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:38:52.386612 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:39:19.783559 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:19.783482 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:39:23.983000 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:23.982967 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:39:44.986105 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:44.986058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:39:53.885791 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:53.885760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:39:56.351998 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:56.351972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:39:56.352426 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:39:56.351974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:40:10.793841 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:40:10.793810 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:40:19.190638 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:40:19.190603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:40:36.597193 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:40:36.597160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:40:44.584436 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:40:44.584403 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:41:17.383955 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:41:17.383914 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:41:26.682753 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:41:26.682721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:41:34.183076 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:41:34.183045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:41:42.594635 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:41:42.594595 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:41:51.084148 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:41:51.084114 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:42:16.490113 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:42:16.490005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:42:29.777955 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:42:29.777916 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:43:18.289898 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:43:18.289863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:43:26.184890 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:43:26.184849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:43:45.584818 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:43:45.584738 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:43:50.475610 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:43:50.475579 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:43:53.480093 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:43:53.480047 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:02.489848 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:02.489813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:11.081491 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:11.081456 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:20.179176 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:20.179139 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:28.895439 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:28.895408 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:37.592035 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:37.592004 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:45.588092 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:45.586999 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:54.511179 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:54.511146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:44:56.382774 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:56.382748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:44:56.383172 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:44:56.382954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:45:02.778057 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:45:02.778024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:46:04.550248 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.550218 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:46:04.550814 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.550442 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" podUID="2091cc28-e376-47f3-acd9-c31c41455fd3" containerName="manager" containerID="cri-o://67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934" gracePeriod=10 Jun 11 16:46:04.794375 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.794350 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:46:04.957852 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.957818 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lghlf\" (UniqueName: \"kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf\") pod \"2091cc28-e376-47f3-acd9-c31c41455fd3\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " Jun 11 16:46:04.958006 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.957926 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume\") pod \"2091cc28-e376-47f3-acd9-c31c41455fd3\" (UID: \"2091cc28-e376-47f3-acd9-c31c41455fd3\") " Jun 11 16:46:04.958296 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.958274 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2091cc28-e376-47f3-acd9-c31c41455fd3" (UID: "2091cc28-e376-47f3-acd9-c31c41455fd3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:46:04.959843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:04.959812 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf" (OuterVolumeSpecName: "kube-api-access-lghlf") pod "2091cc28-e376-47f3-acd9-c31c41455fd3" (UID: "2091cc28-e376-47f3-acd9-c31c41455fd3"). InnerVolumeSpecName "kube-api-access-lghlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:46:05.058673 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.058638 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2091cc28-e376-47f3-acd9-c31c41455fd3-extensions-socket-volume\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:46:05.058673 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.058667 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lghlf\" (UniqueName: \"kubernetes.io/projected/2091cc28-e376-47f3-acd9-c31c41455fd3-kube-api-access-lghlf\") on node \"ip-10-0-129-97.ec2.internal\" DevicePath \"\"" Jun 11 16:46:05.213478 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.213382 2562 generic.go:356] "Generic (PLEG): container finished" podID="2091cc28-e376-47f3-acd9-c31c41455fd3" containerID="67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934" exitCode=0 Jun 11 16:46:05.213478 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.213442 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" Jun 11 16:46:05.213478 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.213466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" event={"ID":"2091cc28-e376-47f3-acd9-c31c41455fd3","Type":"ContainerDied","Data":"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934"} Jun 11 16:46:05.213744 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.213546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6" event={"ID":"2091cc28-e376-47f3-acd9-c31c41455fd3","Type":"ContainerDied","Data":"509f77471fa2b8e2dc6ea52f9ed3fa16ec4657b144d5c5bad62b3ad288b0e9c6"} Jun 11 16:46:05.213744 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.213569 2562 scope.go:117] "RemoveContainer" containerID="67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934" Jun 11 16:46:05.222801 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.222784 2562 scope.go:117] "RemoveContainer" containerID="67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934" Jun 11 16:46:05.223052 ip-10-0-129-97 kubenswrapper[2562]: E0611 16:46:05.223035 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934\": container with ID starting with 67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934 not found: ID does not exist" containerID="67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934" Jun 11 16:46:05.223128 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.223096 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934"} err="failed to get container status \"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934\": rpc error: code = NotFound desc = could not find container \"67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934\": container with ID starting with 67e2421cf0bd251fca3ccd827d2e4901938516f577fb9bcae6a79f25c0b27934 not found: ID does not exist" Jun 11 16:46:05.258920 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.258894 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:46:05.278174 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:05.278149 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6f7k6"] Jun 11 16:46:06.332762 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:46:06.332732 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2091cc28-e376-47f3-acd9-c31c41455fd3" path="/var/lib/kubelet/pods/2091cc28-e376-47f3-acd9-c31c41455fd3/volumes" Jun 11 16:47:10.769899 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.769861 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8"] Jun 11 16:47:10.770327 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.770228 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2091cc28-e376-47f3-acd9-c31c41455fd3" containerName="manager" Jun 11 16:47:10.770327 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.770239 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2091cc28-e376-47f3-acd9-c31c41455fd3" containerName="manager" Jun 11 16:47:10.770327 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.770303 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2091cc28-e376-47f3-acd9-c31c41455fd3" containerName="manager" Jun 11 16:47:10.774365 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.774346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.777915 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.777893 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-46q49\"" Jun 11 16:47:10.792861 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.792835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b128a601-8cc3-44c0-99fe-7fe2378f788a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.792968 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.792915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lxr5\" (UniqueName: \"kubernetes.io/projected/b128a601-8cc3-44c0-99fe-7fe2378f788a-kube-api-access-4lxr5\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.799166 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.799145 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8"] Jun 11 16:47:10.893722 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.893687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b128a601-8cc3-44c0-99fe-7fe2378f788a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.893862 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.893778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lxr5\" (UniqueName: \"kubernetes.io/projected/b128a601-8cc3-44c0-99fe-7fe2378f788a-kube-api-access-4lxr5\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.894054 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.894034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b128a601-8cc3-44c0-99fe-7fe2378f788a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:10.909371 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:10.909343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lxr5\" (UniqueName: \"kubernetes.io/projected/b128a601-8cc3-44c0-99fe-7fe2378f788a-kube-api-access-4lxr5\") pod \"kuadrant-operator-controller-manager-86878c769f-vcrg8\" (UID: \"b128a601-8cc3-44c0-99fe-7fe2378f788a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:11.084225 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.084142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:11.234146 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.234116 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8"] Jun 11 16:47:11.238296 ip-10-0-129-97 kubenswrapper[2562]: W0611 16:47:11.238269 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb128a601_8cc3_44c0_99fe_7fe2378f788a.slice/crio-f1b1ee8bc881dbe59eaeaccb142084a415b979debd5abb4a772dd0030162baec WatchSource:0}: Error finding container f1b1ee8bc881dbe59eaeaccb142084a415b979debd5abb4a772dd0030162baec: Status 404 returned error can't find the container with id f1b1ee8bc881dbe59eaeaccb142084a415b979debd5abb4a772dd0030162baec Jun 11 16:47:11.511597 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.511557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" event={"ID":"b128a601-8cc3-44c0-99fe-7fe2378f788a","Type":"ContainerStarted","Data":"7a0be480249af2b805c589d03fca38507329c5142646e9a1b6c5d786c844da53"} Jun 11 16:47:11.511786 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.511609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" event={"ID":"b128a601-8cc3-44c0-99fe-7fe2378f788a","Type":"ContainerStarted","Data":"f1b1ee8bc881dbe59eaeaccb142084a415b979debd5abb4a772dd0030162baec"} Jun 11 16:47:11.511786 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.511642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:11.550515 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:11.550465 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" podStartSLOduration=1.5504496570000001 podStartE2EDuration="1.550449657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:47:11.547884121 +0000 UTC m=+1635.713850300" watchObservedRunningTime="2026-06-11 16:47:11.550449657 +0000 UTC m=+1635.716415825" Jun 11 16:47:22.518054 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:22.518026 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vcrg8" Jun 11 16:47:31.753268 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:31.753230 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:47:37.157889 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:47:37.157852 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:03.419838 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:03.419808 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:08.296564 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:08.296526 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:17.494813 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:17.494727 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:28.294843 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:28.294810 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:36.778561 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:36.778531 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:47.096126 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:47.096093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:48:56.097632 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:48:56.097595 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:49:06.419115 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:06.419078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:49:15.358458 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:15.358420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:49:25.591902 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:25.591863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:49:35.109689 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:35.109653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:49:56.409763 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:56.409735 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:49:56.410255 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:49:56.409983 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:50:07.881249 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:50:07.881214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:50:50.884456 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:50:50.884425 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:50:59.188214 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:50:59.188183 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:07.997564 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:07.997526 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:16.480947 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:16.480868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:25.087574 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:25.087539 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:35.881244 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:35.881214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:44.585374 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:44.585339 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:49.790314 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:49.790280 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:51:56.790634 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:51:56.790601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:04.784464 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:04.784427 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:13.415894 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:13.415862 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:23.795604 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:23.795568 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:41.754665 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:41.754633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:49.997912 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:49.997876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:52:59.122494 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:52:59.122454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:07.185454 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:07.185422 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:24.590407 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:24.590376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:33.130041 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:33.129997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:41.788138 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:41.788105 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:49.991100 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:49.991055 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:53:58.486610 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:53:58.486572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:07.681034 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:07.680998 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:16.580301 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:16.580223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:27.483428 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:27.483392 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:36.780172 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:36.780143 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:47.653546 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:47.653514 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:54:56.442780 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:56.442752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:54:56.445207 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:56.445184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:54:57.312320 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:54:57.312287 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:02.802522 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:02.802490 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:11.128997 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:11.128965 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:16.694841 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:16.694807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:33.406644 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:33.406609 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:42.182906 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:42.182870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:51.592796 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:51.592764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:55:57.688767 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:55:57.688732 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:56:21.490868 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:56:21.490831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:56:33.709672 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:56:33.709637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:58:34.306963 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:58:34.306932 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:58:38.810851 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:58:38.810818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:58:43.954438 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:58:43.954404 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 16:59:56.470349 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:59:56.470310 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 16:59:56.472138 ip-10-0-129-97 kubenswrapper[2562]: I0611 16:59:56.472116 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 17:01:55.887380 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:01:55.887346 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 17:02:02.199092 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:02:02.199045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65hvk"] Jun 11 17:04:56.498219 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:04:56.498187 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 17:04:56.501236 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:04:56.501210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7sjk_081c2d95-9307-4ea5-bac0-601220da8858/ovn-acl-logging/0.log" Jun 11 17:06:34.417987 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:34.417876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56659f465f-8c9h9_b157e859-80e6-4bf1-a516-bdcc33d9f7fd/nginx/0.log" Jun 11 17:06:34.673743 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:34.673658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ptcsp_cacaf176-2903-4e45-9778-29d67d9375bc/manager/0.log" Jun 11 17:06:34.797838 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:34.797796 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-l58hw_d33bec4a-3db9-431f-8024-a1617e740772/manager/0.log" Jun 11 17:06:35.286783 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:35.286754 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4cc65c97-5gxmf_a4c23cc7-27a0-46e8-b4cf-e8de660d82f8/manager/0.log" Jun 11 17:06:35.425449 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:35.425417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zwt22_a11eb79c-711e-4b65-b527-067f7a787720/server/0.log" Jun 11 17:06:35.558706 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:35.558628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-gxsdp_986daf60-475f-43ef-89b3-c84cdaca56e2/manager/0.log" Jun 11 17:06:35.978560 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:35.978535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-txsnr_212710ba-9d4e-431f-8a0b-223171c4a135/copy-manifests/0.log" Jun 11 17:06:35.988127 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:35.988092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-txsnr_212710ba-9d4e-431f-8a0b-223171c4a135/manager/0.log" Jun 11 17:06:37.959484 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:37.959451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vcrg8_b128a601-8cc3-44c0-99fe-7fe2378f788a/manager/0.log" Jun 11 17:06:38.089692 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:38.089662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-65hvk_79d86cf0-23a2-47f6-a129-f1ee41ef850d/limitador/0.log" Jun 11 17:06:38.666484 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:38.666448 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sqjjr_9d496664-0732-4e25-ba57-c88dda56aa8a/discovery/0.log" Jun 11 17:06:38.787739 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:38.787713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84dc499667-9qmwh_7e685a5d-c6be-442f-8975-a4d91f27f86a/kube-auth-proxy/0.log" Jun 11 17:06:39.294461 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:39.294431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tgpdd_f08cd957-de29-486a-87de-8fa1c780546c/payload-processing/0.log" Jun 11 17:06:40.019372 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:40.019341 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k_fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0/storage-initializer/0.log" Jun 11 17:06:40.038576 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:40.038542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-x8f7k_fcb5d532-ca5e-4d0e-9884-16faf7fbb5b0/main/0.log" Jun 11 17:06:40.274909 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:40.274825 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rqll7_fb250b50-8a42-4d15-a3e5-4366c777df64/storage-initializer/0.log" Jun 11 17:06:40.298712 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:40.298682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rqll7_fb250b50-8a42-4d15-a3e5-4366c777df64/main/0.log" Jun 11 17:06:48.463323 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:48.463290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klqv4_e8aea942-23de-4019-a7e7-0dab4f206e5b/global-pull-secret-syncer/0.log" Jun 11 17:06:48.643224 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:48.643198 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbqq8_4befebd6-db8b-4372-9075-a3295859fe9a/konnectivity-agent/0.log" Jun 11 17:06:48.732882 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:48.732795 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-97.ec2.internal_eb29ebae2d068e8f9fd0436c62039ef2/haproxy/0.log" Jun 11 17:06:50.938495 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:50.938461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-pzvb9_b40ab885-55ef-476a-ba07-0ad0f280644b/sail-operator/0.log" Jun 11 17:06:54.887328 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:54.887293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vcrg8_b128a601-8cc3-44c0-99fe-7fe2378f788a/manager/0.log" Jun 11 17:06:54.992597 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:54.992570 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-65hvk_79d86cf0-23a2-47f6-a129-f1ee41ef850d/limitador/0.log" Jun 11 17:06:57.211773 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:57.211739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-x44kg_0c68f40c-9f83-414e-8ae7-cfd4dbf8010e/cluster-monitoring-operator/0.log" Jun 11 17:06:57.687697 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:57.687668 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mclpf_db1880ac-1f65-4f85-9e88-7df8bedb563a/node-exporter/0.log" Jun 11 17:06:57.727242 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:57.727213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mclpf_db1880ac-1f65-4f85-9e88-7df8bedb563a/kube-rbac-proxy/0.log" Jun 11 17:06:57.779759 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:57.779734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mclpf_db1880ac-1f65-4f85-9e88-7df8bedb563a/init-textfile/0.log" Jun 11 17:06:59.493485 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.493442 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn"] Jun 11 17:06:59.501595 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.501563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.505151 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.505126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47zhp\"/\"default-dockercfg-mbxvh\"" Jun 11 17:06:59.505994 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.505971 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47zhp\"/\"kube-root-ca.crt\"" Jun 11 17:06:59.506114 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.506018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47zhp\"/\"openshift-service-ca.crt\"" Jun 11 17:06:59.516976 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.516950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn"] Jun 11 17:06:59.608101 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.608042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-lib-modules\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.608277 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.608164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kf2n\" (UniqueName: \"kubernetes.io/projected/7451c6f3-aa70-4209-9062-c0e37b2a759d-kube-api-access-2kf2n\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.608277 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.608211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-sys\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.608277 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.608247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-proc\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.608434 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.608287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-podres\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709452 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-lib-modules\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709640 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kf2n\" (UniqueName: \"kubernetes.io/projected/7451c6f3-aa70-4209-9062-c0e37b2a759d-kube-api-access-2kf2n\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709640 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-sys\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709640 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-sys\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709640 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-proc\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709844 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-proc\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709844 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-podres\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709844 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-lib-modules\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.709844 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.709738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7451c6f3-aa70-4209-9062-c0e37b2a759d-podres\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.721412 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.721375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kf2n\" (UniqueName: \"kubernetes.io/projected/7451c6f3-aa70-4209-9062-c0e37b2a759d-kube-api-access-2kf2n\") pod \"perf-node-gather-daemonset-vxjxn\" (UID: \"7451c6f3-aa70-4209-9062-c0e37b2a759d\") " pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.811513 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.811422 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:06:59.958598 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:06:59.958573 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn"] Jun 11 17:06:59.960214 ip-10-0-129-97 kubenswrapper[2562]: W0611 17:06:59.960185 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7451c6f3_aa70_4209_9062_c0e37b2a759d.slice/crio-3d2a035b39b81b3b9f1130333770b351383b352696eb94ff6d25a69b2bbd09af WatchSource:0}: Error finding container 3d2a035b39b81b3b9f1130333770b351383b352696eb94ff6d25a69b2bbd09af: Status 404 returned error can't find the container with id 3d2a035b39b81b3b9f1130333770b351383b352696eb94ff6d25a69b2bbd09af Jun 11 17:07:00.075387 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:00.075291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" event={"ID":"7451c6f3-aa70-4209-9062-c0e37b2a759d","Type":"ContainerStarted","Data":"f46059c266df114524386726d5b7f8f17442d05dd3f50066a644933c7b32b350"} Jun 11 17:07:00.075387 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:00.075342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" event={"ID":"7451c6f3-aa70-4209-9062-c0e37b2a759d","Type":"ContainerStarted","Data":"3d2a035b39b81b3b9f1130333770b351383b352696eb94ff6d25a69b2bbd09af"} Jun 11 17:07:00.075598 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:00.075397 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:07:00.106185 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:00.106139 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" podStartSLOduration=1.106121917 podStartE2EDuration="1.106121917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:07:00.10566422 +0000 UTC m=+2824.271630387" watchObservedRunningTime="2026-06-11 17:07:00.106121917 +0000 UTC m=+2824.272088085" Jun 11 17:07:03.944244 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:03.944192 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdx5w_4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917/dns/0.log" Jun 11 17:07:03.997460 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:03.997424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdx5w_4a9b3d15-8f9a-48dd-a35c-a17bbcc8c917/kube-rbac-proxy/0.log" Jun 11 17:07:04.059025 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:04.059001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2r7dk_458a36dd-6930-443e-9dda-94ba59f28d93/dns-node-resolver/0.log" Jun 11 17:07:04.970443 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:04.970409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzzmh_af864790-82a7-4fa9-a810-d7fdf64121f9/node-ca/0.log" Jun 11 17:07:06.090054 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:06.090030 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47zhp/perf-node-gather-daemonset-vxjxn" Jun 11 17:07:06.386165 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:06.386132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sqjjr_9d496664-0732-4e25-ba57-c88dda56aa8a/discovery/0.log" Jun 11 17:07:06.476402 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:06.476370 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84dc499667-9qmwh_7e685a5d-c6be-442f-8975-a4d91f27f86a/kube-auth-proxy/0.log" Jun 11 17:07:06.891406 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:06.891371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tgpdd_f08cd957-de29-486a-87de-8fa1c780546c/payload-processing/0.log" Jun 11 17:07:07.830631 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:07.830602 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nz5lx_cff79bb3-476e-46e0-9a92-845bcee811a0/serve-healthcheck-canary/0.log" Jun 11 17:07:08.587936 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:08.587842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2tmnk_d1016106-7e6e-4653-b059-2905d0f869c5/insights-operator/0.log" Jun 11 17:07:08.589158 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:08.589139 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2tmnk_d1016106-7e6e-4653-b059-2905d0f869c5/insights-operator/1.log" Jun 11 17:07:08.839790 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:08.839713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k87jg_c215851f-b751-4916-acec-e1ae7894caac/kube-rbac-proxy/0.log" Jun 11 17:07:08.867161 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:08.867134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k87jg_c215851f-b751-4916-acec-e1ae7894caac/exporter/0.log" Jun 11 17:07:08.894624 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:08.894598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k87jg_c215851f-b751-4916-acec-e1ae7894caac/extractor/0.log" Jun 11 17:07:11.773390 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:11.773351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56659f465f-8c9h9_b157e859-80e6-4bf1-a516-bdcc33d9f7fd/nginx/0.log" Jun 11 17:07:11.895120 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:11.895083 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ptcsp_cacaf176-2903-4e45-9778-29d67d9375bc/manager/0.log" Jun 11 17:07:12.051261 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.051182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-l58hw_d33bec4a-3db9-431f-8024-a1617e740772/manager/0.log" Jun 11 17:07:12.485760 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.485727 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4cc65c97-5gxmf_a4c23cc7-27a0-46e8-b4cf-e8de660d82f8/manager/0.log" Jun 11 17:07:12.669392 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.669363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zwt22_a11eb79c-711e-4b65-b527-067f7a787720/server/0.log" Jun 11 17:07:12.741377 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.741272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sqjjr_9d496664-0732-4e25-ba57-c88dda56aa8a/discovery/0.log" Jun 11 17:07:12.867978 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.867952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84dc499667-9qmwh_7e685a5d-c6be-442f-8975-a4d91f27f86a/kube-auth-proxy/0.log" Jun 11 17:07:12.970150 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:12.970122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-gxsdp_986daf60-475f-43ef-89b3-c84cdaca56e2/manager/0.log" Jun 11 17:07:13.320584 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:13.320554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tgpdd_f08cd957-de29-486a-87de-8fa1c780546c/payload-processing/0.log" Jun 11 17:07:13.751495 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:13.751464 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-txsnr_212710ba-9d4e-431f-8a0b-223171c4a135/manager/0.log" Jun 11 17:07:13.832327 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:13.832298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc59bf699-txsnr_212710ba-9d4e-431f-8a0b-223171c4a135/copy-manifests/0.log" Jun 11 17:07:14.896495 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:14.896452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sqjjr_9d496664-0732-4e25-ba57-c88dda56aa8a/discovery/0.log" Jun 11 17:07:15.173000 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:15.172919 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84dc499667-9qmwh_7e685a5d-c6be-442f-8975-a4d91f27f86a/kube-auth-proxy/0.log" Jun 11 17:07:15.395474 ip-10-0-129-97 kubenswrapper[2562]: I0611 17:07:15.395438 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tgpdd_f08cd957-de29-486a-87de-8fa1c780546c/payload-processing/0.log"