Jun 09 00:19:47.840384 ip-10-0-143-64 systemd[1]: Starting Kubernetes Kubelet... Jun 09 00:19:48.264737 ip-10-0-143-64 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.264737 ip-10-0-143-64 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 00:19:48.264737 ip-10-0-143-64 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.264737 ip-10-0-143-64 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 00:19:48.264737 ip-10-0-143-64 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.265317 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.264789 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 00:19:48.270180 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270164 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.270180 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270178 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.270180 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270182 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270186 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270190 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270193 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270197 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270200 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270203 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270205 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270209 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270211 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270219 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270222 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270225 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270228 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270230 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270233 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270237 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270239 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270242 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270245 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.270272 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270247 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270250 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270253 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270255 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270258 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270260 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270263 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270266 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270268 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270271 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270274 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270276 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270279 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270283 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270286 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270288 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270291 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270294 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270298 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.270747 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270302 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270305 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270308 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270310 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270314 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270316 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270319 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270321 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270324 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270326 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270329 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270331 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270334 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270336 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270339 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270343 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270346 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270348 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270351 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270353 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.271234 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270356 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270358 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270361 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270363 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270366 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270368 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270371 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270373 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270376 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270378 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270381 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270384 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270386 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270389 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270393 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270396 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270399 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270402 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270405 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.271728 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270408 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270411 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270413 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270416 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270419 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270424 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270427 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270430 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270433 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270436 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270439 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270441 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270444 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270447 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270449 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270452 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270454 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270457 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.270460 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271155 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.272201 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271161 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271164 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271167 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271171 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271173 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271176 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271179 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271182 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271184 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271187 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271190 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271192 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271195 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271198 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271201 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271204 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271206 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271209 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271212 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.272676 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271215 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271218 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271221 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271224 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271227 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271231 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271234 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271236 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271239 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271242 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271245 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271248 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271250 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271253 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271256 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271258 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271262 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271265 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271267 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.273192 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271270 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271273 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271275 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271278 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271280 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271283 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271286 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271288 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271291 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271294 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271296 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271299 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271301 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271304 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271307 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271310 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271312 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271315 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271317 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271320 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.273681 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271322 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271325 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271327 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271330 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271332 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271335 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271338 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271340 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271343 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271345 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271348 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271350 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271352 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271356 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271358 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271361 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271363 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271368 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271372 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.274183 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271375 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271378 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271381 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271385 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271391 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271394 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271397 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271400 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271403 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271406 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271409 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271412 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271414 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271417 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271419 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271422 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271425 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271427 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271430 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.274647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271433 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271435 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271770 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271774 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271777 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271779 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271782 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271785 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271787 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271791 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271794 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271797 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271799 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271802 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271805 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271807 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271810 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271814 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271817 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271820 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.275124 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271822 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271825 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271828 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271830 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271833 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271835 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271838 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271841 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271845 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271849 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271853 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271856 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271859 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271862 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271865 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271868 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271871 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271873 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271877 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.275605 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271879 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271882 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271885 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271887 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271890 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271893 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271895 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271897 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271900 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271903 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271906 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271909 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271913 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271916 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271918 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271921 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271923 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271926 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271928 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.276090 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271931 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271934 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271936 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271939 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271942 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271944 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271947 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271949 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271952 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271954 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271956 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271959 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271962 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271964 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271967 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271969 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271972 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271975 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271978 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271980 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.276555 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271983 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271986 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271988 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271992 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271994 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.271998 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272001 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272003 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272006 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272008 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272010 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272013 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272016 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272032 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272035 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272037 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272040 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272043 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272045 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272048 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.277050 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272052 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272055 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272059 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272128 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272135 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272142 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272149 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272155 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272160 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272166 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272171 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272174 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272177 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272180 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272183 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272187 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272191 2557 flags.go:64] FLAG: --cgroup-root="" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272195 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272198 2557 flags.go:64] FLAG: --client-ca-file="" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272201 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272204 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272207 2557 flags.go:64] FLAG: --cluster-domain="" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272211 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272214 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 00:19:48.277553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272217 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272221 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272224 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272227 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272230 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272234 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272236 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272239 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272242 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272245 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272248 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272252 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272255 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272258 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272261 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272264 2557 flags.go:64] FLAG: --enable-server="true" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272267 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272271 2557 flags.go:64] FLAG: --event-burst="100" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272274 2557 flags.go:64] FLAG: --event-qps="50" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272277 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272280 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272283 2557 flags.go:64] FLAG: --eviction-hard="" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272287 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272290 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272293 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 00:19:48.278243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272297 2557 flags.go:64] FLAG: --eviction-soft="" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272300 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272303 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272306 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272309 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272311 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272314 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272317 2557 flags.go:64] FLAG: --feature-gates="" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272321 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272324 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272327 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272330 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272332 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272335 2557 flags.go:64] FLAG: --help="false" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272338 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272341 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272344 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272347 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272351 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272354 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272357 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272360 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272363 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 00:19:48.279223 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272365 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272368 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272372 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272375 2557 flags.go:64] FLAG: --kube-reserved="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272378 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272380 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272384 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272387 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272390 2557 flags.go:64] FLAG: --lock-file="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272393 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272396 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272399 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272405 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272408 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272411 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272414 2557 flags.go:64] FLAG: --logging-format="text" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272416 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272420 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272423 2557 flags.go:64] FLAG: --manifest-url="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272426 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272430 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272433 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272437 2557 flags.go:64] FLAG: --max-pods="110" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272440 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272443 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 00:19:48.279860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272446 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272449 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272452 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272455 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272458 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272465 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272468 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272471 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272474 2557 flags.go:64] FLAG: --pod-cidr="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272476 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272483 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272485 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272488 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272492 2557 flags.go:64] FLAG: --port="10250" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272495 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272498 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0874863eeee5450b6" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272501 2557 flags.go:64] FLAG: --qos-reserved="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272505 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272508 2557 flags.go:64] FLAG: --register-node="true" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272511 2557 flags.go:64] FLAG: --register-with-taints="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272515 2557 flags.go:64] FLAG: --registry-burst="10" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272518 2557 flags.go:64] FLAG: --registry-qps="5" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272520 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272523 2557 flags.go:64] FLAG: --reserved-memory="" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272532 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 00:19:48.280505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272535 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272538 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272541 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272544 2557 flags.go:64] FLAG: --runonce="false" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272547 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272551 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272554 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272557 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272559 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272562 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272566 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272568 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272572 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272574 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272577 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272580 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272583 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272586 2557 flags.go:64] FLAG: --system-cgroups="" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272602 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272611 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272614 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272617 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272620 2557 flags.go:64] FLAG: --tls-min-version="" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272623 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272626 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 00:19:48.281140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272629 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272632 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272634 2557 flags.go:64] FLAG: --v="2" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272638 2557 flags.go:64] FLAG: --version="false" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272642 2557 flags.go:64] FLAG: --vmodule="" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272645 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.272649 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272753 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272757 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272760 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272763 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272766 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272769 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272772 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272775 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272778 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272780 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272785 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272788 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272791 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272794 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.281795 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272796 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272799 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272802 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272805 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272808 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272812 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272815 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272819 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272822 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272826 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272829 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272832 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272834 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272837 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272839 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272842 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272845 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272847 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272850 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272852 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.282433 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272855 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272858 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272860 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272863 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272865 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272868 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272871 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272874 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272876 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272879 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272882 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272884 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272887 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272890 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272892 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272895 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272897 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272900 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272907 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272911 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.282965 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272914 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272918 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272920 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272923 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272926 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272928 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272931 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272934 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272936 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272939 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272942 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272944 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272947 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272949 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272952 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272956 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272960 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272963 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272966 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272968 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.283471 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272971 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272973 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272977 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272981 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272984 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272987 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272989 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272992 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272994 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.272997 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273000 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273004 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273007 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273011 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273014 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273016 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273032 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273035 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273038 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.283951 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273041 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273044 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273046 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273049 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273052 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.273054 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.273060 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.280557 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.280572 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.281511 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.281522 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281582 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281587 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281590 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.284427 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281594 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281598 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281601 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281603 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281607 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281609 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281612 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281615 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281618 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281620 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281623 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281625 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281628 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281631 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281633 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281636 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281639 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281642 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281645 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281648 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.284776 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281651 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281653 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281656 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281670 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281673 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281676 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281680 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281682 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281685 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281688 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281690 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281693 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281696 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281699 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281702 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281706 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281709 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281712 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281715 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.285318 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281718 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281721 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281724 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281726 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281730 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281734 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281737 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281740 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281743 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281746 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281749 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281752 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281755 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281757 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281760 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281763 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281766 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281768 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281771 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281774 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.285810 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281777 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281779 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281782 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281785 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281788 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281791 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281793 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281796 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281799 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281801 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281805 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281807 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281810 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281813 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281815 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281818 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281820 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281824 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281826 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281829 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.286316 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281832 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281834 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281837 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281839 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281842 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281845 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281848 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281851 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281854 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281856 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281859 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281862 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281866 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281870 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281873 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281875 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.286801 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281878 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.281883 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.281995 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282001 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282004 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282008 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282012 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282016 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282034 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282039 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282042 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282045 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282048 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282051 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.287270 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282054 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282057 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282059 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282062 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282064 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282067 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282070 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282073 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282076 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282078 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282081 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282083 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282086 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282089 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282091 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282094 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282097 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282099 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282102 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282105 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.287610 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282107 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282110 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282112 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282115 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282118 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282120 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282123 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282126 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282128 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282131 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282134 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282136 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282139 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282142 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282145 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282147 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282150 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282153 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282155 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282158 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.288102 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282161 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282163 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282166 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282168 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282171 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282174 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282176 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282179 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282182 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282184 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282187 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282189 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282191 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282194 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282197 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282199 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282202 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282205 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282207 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282210 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.288583 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282212 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282215 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282217 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282220 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282222 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282225 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282228 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282230 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282232 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282235 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282238 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282241 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282243 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282246 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282249 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282251 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282254 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282256 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282259 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.289076 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282262 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282265 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282268 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282271 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282273 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282276 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282278 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:48.282281 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.282285 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.282388 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.285380 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.286707 2557 server.go:1019] "Starting client certificate rotation" Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.286805 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 00:19:48.289559 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.286843 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 00:19:48.289918 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.289219 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 00:19:48.290357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.290308 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 00:19:48.300594 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.300575 2557 log.go:25] "Validated CRI v1 runtime API" Jun 09 00:19:48.304891 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.304877 2557 log.go:25] "Validated CRI v1 image API" Jun 09 00:19:48.305665 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.305642 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 00:19:48.308135 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.308118 2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7a2cffb8-ce45-40b3-8452-e5c956499bd2:/dev/nvme0n1p4 b92a1f44-a784-436b-9ac4-e6e20ea50c8f:/dev/nvme0n1p3] Jun 09 00:19:48.308177 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.308135 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 00:19:48.313010 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.312992 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 00:19:48.314669 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.314567 2557 manager.go:216] Machine: {Timestamp:2026-06-09 00:19:48.313431179 +0000 UTC m=+0.346527932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091301 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c423267a7f7427347b0266ef54344 SystemUUID:ec2c4232-67a7-f742-7347-b0266ef54344 BootID:a7661ca4-df88-41b8-bcf8-1dc143f744d0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:f7:ed:71:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:f7:ed:71:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:0f:59:47:ff:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 00:19:48.314669 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.314664 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 00:19:48.314771 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.314754 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 00:19:48.318007 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.317985 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 00:19:48.318148 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.318010 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 00:19:48.318679 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.318671 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 00:19:48.318708 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.318681 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 00:19:48.318708 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.318689 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 00:19:48.319467 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.319458 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 00:19:48.320264 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.320254 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 00:19:48.323249 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323238 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 09 00:19:48.323353 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323344 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 00:19:48.323388 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323372 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 09 00:19:48.323388 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323381 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 00:19:48.323449 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323392 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 00:19:48.323449 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323401 2557 kubelet.go:398] "Adding apiserver pod source" Jun 09 00:19:48.323449 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323408 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 00:19:48.323722 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323709 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 00:19:48.323787 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.323734 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 00:19:48.325862 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.325844 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 00:19:48.327100 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.327086 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 00:19:48.327156 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.327116 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 00:19:48.328139 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328128 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328144 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328149 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328155 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328163 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328168 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328176 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328181 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328187 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328193 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328210 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 00:19:48.328240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.328215 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 00:19:48.329675 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.329662 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 00:19:48.329675 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.329673 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 00:19:48.333106 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.333067 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 00:19:48.333198 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.333176 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 00:19:48.333260 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.333209 2557 server.go:1268] "Started kubelet" Jun 09 00:19:48.333334 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.333283 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 00:19:48.333372 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.333361 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 00:19:48.333513 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.333276 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 00:19:48.333586 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.333525 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 00:19:48.334057 ip-10-0-143-64 systemd[1]: Started Kubernetes Kubelet. Jun 09 00:19:48.335767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.335585 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 00:19:48.335900 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.335885 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 09 00:19:48.339757 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.339731 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 00:19:48.340683 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.340670 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 00:19:48.340803 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.340785 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.340880 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.340863 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 00:19:48.341310 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341294 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 00:19:48.341310 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341297 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 00:19:48.341430 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341320 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 00:19:48.341430 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341398 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 09 00:19:48.341430 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341407 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 09 00:19:48.341726 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341710 2557 factory.go:55] Registering systemd factory Jun 09 00:19:48.341808 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.341746 2557 factory.go:223] Registration of the systemd container factory successfully Jun 09 00:19:48.341808 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.340795 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdc387700 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.333188864 +0000 UTC m=+0.366285618,LastTimestamp:2026-06-09 00:19:48.333188864 +0000 UTC m=+0.366285618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.342291 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342273 2557 factory.go:153] Registering CRI-O factory Jun 09 00:19:48.342291 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342291 2557 factory.go:223] Registration of the crio container factory successfully Jun 09 00:19:48.342421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342406 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 00:19:48.342472 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342429 2557 factory.go:103] Registering Raw factory Jun 09 00:19:48.342472 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342443 2557 manager.go:1196] Started watching for new ooms in manager Jun 09 00:19:48.342867 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.342853 2557 manager.go:349] Starting recovery of all containers Jun 09 00:19:48.346705 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.346675 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 00:19:48.346903 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.346880 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 00:19:48.354715 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.354697 2557 manager.go:354] Recovery completed Jun 09 00:19:48.358719 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.358702 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.360956 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.360937 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.361006 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.360969 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.361006 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.360982 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.361435 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.361422 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 00:19:48.361435 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.361433 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 00:19:48.361546 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.361446 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 09 00:19:48.361546 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.361422 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.362627 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362614 2557 policy_none.go:49] "None policy: Start" Jun 09 00:19:48.362682 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362634 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 00:19:48.362682 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362650 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 00:19:48.362774 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362724 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.362774 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362753 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.362774 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.362768 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.363073 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.362986 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde02589 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.360955273 +0000 UTC m=+0.394052028,LastTimestamp:2026-06-09 00:19:48.360955273 +0000 UTC m=+0.394052028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.363534 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.363524 2557 policy_none.go:47] "Start" Jun 09 00:19:48.373634 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.373578 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde075d6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.36097583 +0000 UTC m=+0.394072583,LastTimestamp:2026-06-09 00:19:48.36097583 +0000 UTC m=+0.394072583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.380636 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.380556 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde09d4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.360985931 +0000 UTC m=+0.394082684,LastTimestamp:2026-06-09 00:19:48.360985931 +0000 UTC m=+0.394082684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.388527 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.388464 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-64.ec2.internal.18b741acdde02589\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde02589 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.360955273 +0000 UTC m=+0.394052028,LastTimestamp:2026-06-09 00:19:48.362736995 +0000 UTC m=+0.395833749,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.397195 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.397133 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-64.ec2.internal.18b741acdde075d6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde075d6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.36097583 +0000 UTC m=+0.394072583,LastTimestamp:2026-06-09 00:19:48.36276086 +0000 UTC m=+0.395857614,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399259 2557 manager.go:337] "Starting Device Plugin manager" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.399283 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399292 2557 server.go:87] "Starting device plugin registration server" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399480 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399489 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399580 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399676 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.399684 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.400051 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.400135 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.404162 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-64.ec2.internal.18b741acdde09d4b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741acdde09d4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-64.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.360985931 +0000 UTC m=+0.394082684,LastTimestamp:2026-06-09 00:19:48.362773569 +0000 UTC m=+0.395870323,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.412524 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.413734 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.413765 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.413783 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 00:19:48.414283 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.413816 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 00:19:48.420849 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.420776 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18b741ace0e2bf4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.411457358 +0000 UTC m=+0.444554103,LastTimestamp:2026-06-09 00:19:48.411457358 +0000 UTC m=+0.444554103,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}" Jun 09 00:19:48.420849 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.420843 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 09 00:19:48.430788 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.430768 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dz4g2" Jun 09 00:19:48.438041 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.438014 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dz4g2" Jun 09 00:19:48.500381 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.500354 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.501099 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.501084 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.501184 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.501110 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.501184 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.501122 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.501184 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.501142 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.514832 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.514782 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"] Jun 09 00:19:48.514887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.514838 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.516058 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.516042 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.516149 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.516068 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.516149 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.516086 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.517171 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517160 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.517297 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517284 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.517356 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517317 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.517832 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517816 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.517919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517844 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.517919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517857 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.517919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517820 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.518130 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517921 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.518130 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.517942 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.519113 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.519098 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.519170 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.519124 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.519784 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.519769 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.519844 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.519795 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.519844 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.519809 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.521725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.521709 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.521791 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.521732 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-64.ec2.internal\": node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.548406 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.548383 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.548678 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.548663 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-64.ec2.internal\" not found" node="ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.553064 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.553047 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-64.ec2.internal\" not found" node="ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.642669 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.642651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.642764 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.642680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.642764 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.642706 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/464bdd4c02355b35b4e35ac2feecd187-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"464bdd4c02355b35b4e35ac2feecd187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.648749 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.648731 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.743778 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.743858 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.743858 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.743927 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743788 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe13a689376d51cd6cdd1f530e726b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"cbe13a689376d51cd6cdd1f530e726b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.743927 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/464bdd4c02355b35b4e35ac2feecd187-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"464bdd4c02355b35b4e35ac2feecd187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.743927 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.743898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/464bdd4c02355b35b4e35ac2feecd187-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"464bdd4c02355b35b4e35ac2feecd187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.748819 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.748805 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.849624 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.849571 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:48.852735 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.852718 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.857384 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:48.857365 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:48.950467 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:48.950443 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:49.050893 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.050872 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:49.151371 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.151322 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:49.251792 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.251772 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found" Jun 09 00:19:49.281081 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.281052 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.286459 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.286440 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 00:19:49.286558 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.286527 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 00:19:49.324193 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.324018 2557 apiserver.go:52] "Watching apiserver" Jun 09 00:19:49.341368 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.341346 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 00:19:49.341462 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.341347 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" Jun 09 00:19:49.343064 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.343046 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 00:19:49.343319 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.343299 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nxsfk","openshift-ovn-kubernetes/ovnkube-node-96krg","kube-system/global-pull-secret-syncer-5854h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv","openshift-cluster-node-tuning-operator/tuned-lnx98","openshift-image-registry/node-ca-9nsw6","openshift-network-diagnostics/network-check-target-tlj8z","openshift-network-operator/iptables-alerter-rg2wk","kube-system/konnectivity-agent-gtv8r","openshift-dns/node-resolver-6gnf4","openshift-multus/multus-additional-cni-plugins-rxcqj","openshift-multus/multus-mcksm"] Jun 09 00:19:49.345712 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.345621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.345776 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.345703 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:49.346668 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.346654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.347915 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.347897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.348501 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.348484 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 00:19:49.349145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349081 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 00:19:49.349252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349235 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.349316 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349263 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.349368 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349346 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxg7h\"" Jun 09 00:19:49.349742 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349729 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 00:19:49.349808 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349767 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.349924 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.349873 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 00:19:49.350249 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.350231 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.350353 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.350263 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbnk4\"" Jun 09 00:19:49.350353 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.350303 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 00:19:49.350575 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.350560 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.351672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.351651 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:49.351755 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.351710 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:19:49.352405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352242 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.352405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352301 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.352405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352311 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 00:19:49.352405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352364 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.352659 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352589 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.352659 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352609 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 00:19:49.352783 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352669 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.352838 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352795 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ghcwt\"" Jun 09 00:19:49.352887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352850 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nggt2\"" Jun 09 00:19:49.353003 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.352981 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.354259 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.354241 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.354996 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.354975 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.355238 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.355226 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.355335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.355321 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 00:19:49.355439 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.355336 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qc9p5\"" Jun 09 00:19:49.355603 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.355591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.356219 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.356198 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 00:19:49.356304 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.356285 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qsp7w\"" Jun 09 00:19:49.356593 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.356559 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 00:19:49.356910 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.356890 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 00:19:49.357007 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.356984 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" Jun 09 00:19:49.357187 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.357159 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe13a689376d51cd6cdd1f530e726b2.slice/crio-c1ba962c0c2bacf410e1c8483321b7e158ccd406be9422ab0e550b7e18422802 WatchSource:0}: Error finding container c1ba962c0c2bacf410e1c8483321b7e158ccd406be9422ab0e550b7e18422802: Status 404 returned error can't find the container with id c1ba962c0c2bacf410e1c8483321b7e158ccd406be9422ab0e550b7e18422802 Jun 09 00:19:49.357389 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.357370 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.357765 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.357741 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464bdd4c02355b35b4e35ac2feecd187.slice/crio-7e0675d9301e7fdf1b01a47786bb001e0bc133f16fa1a68c47001653003764d1 WatchSource:0}: Error finding container 7e0675d9301e7fdf1b01a47786bb001e0bc133f16fa1a68c47001653003764d1: Status 404 returned error can't find the container with id 7e0675d9301e7fdf1b01a47786bb001e0bc133f16fa1a68c47001653003764d1 Jun 09 00:19:49.358686 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.358668 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j968d\"" Jun 09 00:19:49.359135 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.359101 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.359732 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.359714 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.360453 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.360428 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 00:19:49.360805 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.360777 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 00:19:49.360972 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.360954 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-462nj\"" Jun 09 00:19:49.361115 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.361074 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 00:19:49.361186 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.361165 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 00:19:49.361788 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.361536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.361788 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.361542 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 00:19:49.362880 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.362829 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"] Jun 09 00:19:49.363359 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.363062 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.363359 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.363212 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:49.363458 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.363400 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 00:19:49.363924 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.363897 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wkbr9\"" Jun 09 00:19:49.364880 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.364852 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 00:19:49.364968 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.364930 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"] Jun 09 00:19:49.366340 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.366325 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:19:49.376738 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.376700 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rrkjv" Jun 09 00:19:49.386406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.386383 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rrkjv" Jun 09 00:19:49.416325 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.416294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" event={"ID":"464bdd4c02355b35b4e35ac2feecd187","Type":"ContainerStarted","Data":"7e0675d9301e7fdf1b01a47786bb001e0bc133f16fa1a68c47001653003764d1"} Jun 09 00:19:49.417197 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.417177 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"cbe13a689376d51cd6cdd1f530e726b2","Type":"ContainerStarted","Data":"c1ba962c0c2bacf410e1c8483321b7e158ccd406be9422ab0e550b7e18422802"} Jun 09 00:19:49.440892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.440855 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 00:14:48 +0000 UTC" deadline="2028-03-19 04:53:35.26003089 +0000 UTC" Jun 09 00:19:49.440892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.440888 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15580h33m45.819145195s" Jun 09 00:19:49.442599 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.442581 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 00:19:49.447137 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-env-overrides\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447211 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447143 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-sys-fs\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.447211 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshj9\" (UniqueName: \"kubernetes.io/projected/f4ddab19-0527-4ca4-ba15-00e20df9e14a-kube-api-access-tshj9\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.447211 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447174 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-conf\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447211 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-kubelet-config\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.447335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovn-node-metrics-cert\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447255 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-konnectivity-ca\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.447335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447270 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.447335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447289 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-cnibin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-netns\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447335 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-var-lib-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-script-lib\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-sys\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-tmp\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4c0f27-48c8-408b-a88a-bccb34e8746c-host-slash\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.447474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xkcr\" (UniqueName: \"kubernetes.io/projected/7a4c0f27-48c8-408b-a88a-bccb34e8746c-kube-api-access-5xkcr\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-systemd-units\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447490 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-device-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38611a13-6d81-46c4-acf8-a0aeacff9be9-tmp-dir\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447543 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-cnibin\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-os-release\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-hostroot\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447602 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-etc-selinux\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.447637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-agent-certs\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-multus\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447683 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-daemon-config\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447696 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysconfig\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-systemd\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-var-lib-kubelet\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-netns\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-etc-kubernetes\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-dbus\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-slash\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.447887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ddab19-0527-4ca4-ba15-00e20df9e14a-host\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447908 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-kubernetes\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-system-cni-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-system-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-cni-binary-copy\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.447977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8xl\" (UniqueName: \"kubernetes.io/projected/f5708cea-7f0f-4176-947d-721399db9e83-kube-api-access-jb8xl\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448002 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a4c0f27-48c8-408b-a88a-bccb34e8746c-iptables-alerter-script\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzwlk\" (UniqueName: \"kubernetes.io/projected/b295cec4-98da-4da3-9241-f65da92ea4d4-kube-api-access-xzwlk\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-socket-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448086 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-registration-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmphk\" (UniqueName: \"kubernetes.io/projected/a4510fdb-c93c-40a6-bf76-598ab484e22d-kube-api-access-pmphk\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-modprobe-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-bin\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-netd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448207 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448225 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-os-release\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-etc-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-log-socket\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448287 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4ddab19-0527-4ca4-ba15-00e20df9e14a-serviceca\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448305 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd76j\" (UniqueName: \"kubernetes.io/projected/38611a13-6d81-46c4-acf8-a0aeacff9be9-kube-api-access-dd76j\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448333 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-tuned\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swh4\" (UniqueName: \"kubernetes.io/projected/853488b5-5daa-4681-b1c4-47a4f2572bcd-kube-api-access-2swh4\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-k8s-cni-cncf-io\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-run\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-host\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448444 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-kubelet\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.448678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-lib-modules\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-socket-dir-parent\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-bin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-multus-certs\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448582 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-config\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bncr\" (UniqueName: \"kubernetes.io/projected/43252a7c-f346-47c5-a53c-e0a0c54caed9-kube-api-access-9bncr\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38611a13-6d81-46c4-acf8-a0aeacff9be9-hosts-file\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448643 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-conf-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-node-log\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd7ph\" (UniqueName: \"kubernetes.io/projected/e912166d-7b2c-4e32-862c-ae7c784f1eb0-kube-api-access-rd7ph\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448711 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-kubelet\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-ovn\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.449164 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.448737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-systemd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549257 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549350 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-kubelet\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549350 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-lib-modules\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.549350 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549296 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.549504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549415 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-lib-modules\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.549504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549419 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-kubelet\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-socket-dir-parent\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549488 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-bin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-multus-certs\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-config\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549545 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-socket-dir-parent\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bncr\" (UniqueName: \"kubernetes.io/projected/43252a7c-f346-47c5-a53c-e0a0c54caed9-kube-api-access-9bncr\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549547 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-bin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-multus-certs\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38611a13-6d81-46c4-acf8-a0aeacff9be9-hosts-file\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-conf-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549626 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38611a13-6d81-46c4-acf8-a0aeacff9be9-hosts-file\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549646 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-node-log\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-conf-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7ph\" (UniqueName: \"kubernetes.io/projected/e912166d-7b2c-4e32-862c-ae7c784f1eb0-kube-api-access-rd7ph\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549690 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-node-log\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-kubelet\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.549753 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-kubelet\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-ovn\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-systemd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549858 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-env-overrides\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-sys-fs\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549893 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-ovn\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549910 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-systemd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshj9\" (UniqueName: \"kubernetes.io/projected/f4ddab19-0527-4ca4-ba15-00e20df9e14a-kube-api-access-tshj9\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-conf\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549952 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-sys-fs\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549967 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-kubelet-config\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.549981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovn-node-metrics-cert\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550006 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-konnectivity-ca\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-kubelet-config\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550090 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-config\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.550432 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550107 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-conf\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-cnibin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-netns\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-var-lib-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550188 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-cnibin\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550205 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-script-lib\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-netns\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-sys\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550285 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-var-lib-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550287 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-sys\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550302 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-tmp\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550329 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4c0f27-48c8-408b-a88a-bccb34e8746c-host-slash\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550304 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-env-overrides\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4c0f27-48c8-408b-a88a-bccb34e8746c-host-slash\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xkcr\" (UniqueName: \"kubernetes.io/projected/7a4c0f27-48c8-408b-a88a-bccb34e8746c-kube-api-access-5xkcr\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-systemd-units\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.551215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-device-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550500 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-systemd-units\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38611a13-6d81-46c4-acf8-a0aeacff9be9-tmp-dir\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-cnibin\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550557 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-konnectivity-ca\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-os-release\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-device-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-hostroot\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550625 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-cnibin\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-etc-selinux\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-hostroot\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550691 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovnkube-script-lib\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550691 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-agent-certs\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550740 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-multus\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.550812 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:49.552047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-daemon-config\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-etc-selinux\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550856 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-var-lib-cni-multus\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550649 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-os-release\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.550868 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:50.050849168 +0000 UTC m=+2.083945931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550882 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38611a13-6d81-46c4-acf8-a0aeacff9be9-tmp-dir\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550909 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysconfig\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.550984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-systemd\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-var-lib-kubelet\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551046 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-netns\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551052 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysconfig\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551069 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-etc-kubernetes\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-systemd\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-dbus\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-slash\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.552884 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551120 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-netns\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ddab19-0527-4ca4-ba15-00e20df9e14a-host\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551158 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-kubernetes\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-etc-kubernetes\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551166 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-var-lib-kubelet\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-system-cni-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551209 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-system-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551219 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-slash\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551227 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ddab19-0527-4ca4-ba15-00e20df9e14a-host\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-cni-binary-copy\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6b5c674-712e-4301-9527-ea6b6bb97348-dbus\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551256 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8xl\" (UniqueName: \"kubernetes.io/projected/f5708cea-7f0f-4176-947d-721399db9e83-kube-api-access-jb8xl\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551284 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853488b5-5daa-4681-b1c4-47a4f2572bcd-system-cni-dir\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551294 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-kubernetes\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-system-cni-dir\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a4c0f27-48c8-408b-a88a-bccb34e8746c-iptables-alerter-script\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzwlk\" (UniqueName: \"kubernetes.io/projected/b295cec4-98da-4da3-9241-f65da92ea4d4-kube-api-access-xzwlk\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-socket-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.553725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-registration-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmphk\" (UniqueName: \"kubernetes.io/projected/a4510fdb-c93c-40a6-bf76-598ab484e22d-kube-api-access-pmphk\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-modprobe-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-multus-daemon-config\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551663 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-bin\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-netd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b295cec4-98da-4da3-9241-f65da92ea4d4-cni-binary-copy\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551713 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-run-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551705 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-registration-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551755 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551771 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-modprobe-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.551790 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-os-release\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.554578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551795 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4510fdb-c93c-40a6-bf76-598ab484e22d-socket-dir\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551826 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-bin\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551831 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-host-cni-netd\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.551834 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:50.05181857 +0000 UTC m=+2.084915316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551860 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-os-release\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-etc-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-log-socket\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551914 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4ddab19-0527-4ca4-ba15-00e20df9e14a-serviceca\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd76j\" (UniqueName: \"kubernetes.io/projected/38611a13-6d81-46c4-acf8-a0aeacff9be9-kube-api-access-dd76j\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-etc-openvswitch\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43252a7c-f346-47c5-a53c-e0a0c54caed9-log-socket\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.551979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-tuned\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swh4\" (UniqueName: \"kubernetes.io/projected/853488b5-5daa-4681-b1c4-47a4f2572bcd-kube-api-access-2swh4\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-k8s-cni-cncf-io\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-run\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a4c0f27-48c8-408b-a88a-bccb34e8746c-iptables-alerter-script\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-host\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552243 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552287 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4ddab19-0527-4ca4-ba15-00e20df9e14a-serviceca\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552326 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b295cec4-98da-4da3-9241-f65da92ea4d4-host-run-k8s-cni-cncf-io\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552352 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-run\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552362 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-sysctl-d\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552406 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e912166d-7b2c-4e32-862c-ae7c784f1eb0-host\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.552534 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/853488b5-5daa-4681-b1c4-47a4f2572bcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.554270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-tmp\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.554398 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43252a7c-f346-47c5-a53c-e0a0c54caed9-ovn-node-metrics-cert\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.554422 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14-agent-certs\") pod \"konnectivity-agent-gtv8r\" (UID: \"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14\") " pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.555750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.554640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e912166d-7b2c-4e32-862c-ae7c784f1eb0-etc-tuned\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.556881 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.556854 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:49.556881 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.556870 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:49.556881 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.556881 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:49.557086 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:49.556924 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:19:50.056914295 +0000 UTC m=+2.090011036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:49.557379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.557350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd7ph\" (UniqueName: \"kubernetes.io/projected/e912166d-7b2c-4e32-862c-ae7c784f1eb0-kube-api-access-rd7ph\") pod \"tuned-lnx98\" (UID: \"e912166d-7b2c-4e32-862c-ae7c784f1eb0\") " pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.557379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.557365 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bncr\" (UniqueName: \"kubernetes.io/projected/43252a7c-f346-47c5-a53c-e0a0c54caed9-kube-api-access-9bncr\") pod \"ovnkube-node-96krg\" (UID: \"43252a7c-f346-47c5-a53c-e0a0c54caed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.558145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.558127 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshj9\" (UniqueName: \"kubernetes.io/projected/f4ddab19-0527-4ca4-ba15-00e20df9e14a-kube-api-access-tshj9\") pod \"node-ca-9nsw6\" (UID: \"f4ddab19-0527-4ca4-ba15-00e20df9e14a\") " pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.558279 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.558250 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xkcr\" (UniqueName: \"kubernetes.io/projected/7a4c0f27-48c8-408b-a88a-bccb34e8746c-kube-api-access-5xkcr\") pod \"iptables-alerter-rg2wk\" (UID: \"7a4c0f27-48c8-408b-a88a-bccb34e8746c\") " pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.560416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.560392 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzwlk\" (UniqueName: \"kubernetes.io/projected/b295cec4-98da-4da3-9241-f65da92ea4d4-kube-api-access-xzwlk\") pod \"multus-mcksm\" (UID: \"b295cec4-98da-4da3-9241-f65da92ea4d4\") " pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.560654 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.560637 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmphk\" (UniqueName: \"kubernetes.io/projected/a4510fdb-c93c-40a6-bf76-598ab484e22d-kube-api-access-pmphk\") pod \"aws-ebs-csi-driver-node-frkxv\" (UID: \"a4510fdb-c93c-40a6-bf76-598ab484e22d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.560934 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.560915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swh4\" (UniqueName: \"kubernetes.io/projected/853488b5-5daa-4681-b1c4-47a4f2572bcd-kube-api-access-2swh4\") pod \"multus-additional-cni-plugins-rxcqj\" (UID: \"853488b5-5daa-4681-b1c4-47a4f2572bcd\") " pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.561314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.561298 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd76j\" (UniqueName: \"kubernetes.io/projected/38611a13-6d81-46c4-acf8-a0aeacff9be9-kube-api-access-dd76j\") pod \"node-resolver-6gnf4\" (UID: \"38611a13-6d81-46c4-acf8-a0aeacff9be9\") " pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.561564 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.561550 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8xl\" (UniqueName: \"kubernetes.io/projected/f5708cea-7f0f-4176-947d-721399db9e83-kube-api-access-jb8xl\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:49.620178 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.620157 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.667056 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.666996 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:19:49.672526 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.672510 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.673602 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.673573 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" Jun 09 00:19:49.675331 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.675311 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43252a7c_f346_47c5_a53c_e0a0c54caed9.slice/crio-58bddd5503c3ef16b61136ca70f1a9fe1889bd0ec032549dc8fb517f670f12ed WatchSource:0}: Error finding container 58bddd5503c3ef16b61136ca70f1a9fe1889bd0ec032549dc8fb517f670f12ed: Status 404 returned error can't find the container with id 58bddd5503c3ef16b61136ca70f1a9fe1889bd0ec032549dc8fb517f670f12ed Jun 09 00:19:49.680144 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.680127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnx98" Jun 09 00:19:49.680383 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.680365 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4510fdb_c93c_40a6_bf76_598ab484e22d.slice/crio-68bea795ee5e05d618ab17868be6537113e453707cdcb4af06a120b7fb735697 WatchSource:0}: Error finding container 68bea795ee5e05d618ab17868be6537113e453707cdcb4af06a120b7fb735697: Status 404 returned error can't find the container with id 68bea795ee5e05d618ab17868be6537113e453707cdcb4af06a120b7fb735697 Jun 09 00:19:49.684773 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.684755 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nsw6" Jun 09 00:19:49.686579 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.686561 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode912166d_7b2c_4e32_862c_ae7c784f1eb0.slice/crio-d3d34fb59e7ac0846424a1ee5e48ed525d0d92a7159ad855a6bc76c3550c52a8 WatchSource:0}: Error finding container d3d34fb59e7ac0846424a1ee5e48ed525d0d92a7159ad855a6bc76c3550c52a8: Status 404 returned error can't find the container with id d3d34fb59e7ac0846424a1ee5e48ed525d0d92a7159ad855a6bc76c3550c52a8 Jun 09 00:19:49.690522 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.690506 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg2wk" Jun 09 00:19:49.692151 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.692132 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ddab19_0527_4ca4_ba15_00e20df9e14a.slice/crio-2bfadc016a60ef4c892a12cd60043e0e6398c34e8fc98c1d7f78ef831b1f0e39 WatchSource:0}: Error finding container 2bfadc016a60ef4c892a12cd60043e0e6398c34e8fc98c1d7f78ef831b1f0e39: Status 404 returned error can't find the container with id 2bfadc016a60ef4c892a12cd60043e0e6398c34e8fc98c1d7f78ef831b1f0e39 Jun 09 00:19:49.695311 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.695295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:19:49.697979 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.697963 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4c0f27_48c8_408b_a88a_bccb34e8746c.slice/crio-aea51ea3270e9f6a36b350d541c6e72c7e6352f244be47e0bf4c5a93cb32d00d WatchSource:0}: Error finding container aea51ea3270e9f6a36b350d541c6e72c7e6352f244be47e0bf4c5a93cb32d00d: Status 404 returned error can't find the container with id aea51ea3270e9f6a36b350d541c6e72c7e6352f244be47e0bf4c5a93cb32d00d Jun 09 00:19:49.700377 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.700351 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6gnf4" Jun 09 00:19:49.703517 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.703490 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e602c6_0d6c_4b36_a4d3_74f4e5cdbf14.slice/crio-64af60b0fbb3d4d9e39c5d943286b7f875eb8f53711b05a483ee28ee71e05367 WatchSource:0}: Error finding container 64af60b0fbb3d4d9e39c5d943286b7f875eb8f53711b05a483ee28ee71e05367: Status 404 returned error can't find the container with id 64af60b0fbb3d4d9e39c5d943286b7f875eb8f53711b05a483ee28ee71e05367 Jun 09 00:19:49.705890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.705869 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" Jun 09 00:19:49.710554 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.710414 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcksm" Jun 09 00:19:49.710688 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.710670 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38611a13_6d81_46c4_acf8_a0aeacff9be9.slice/crio-26d8289333b79681deaa4eba20b97e30f7b05854cb0f8ecda50dcac277f328ce WatchSource:0}: Error finding container 26d8289333b79681deaa4eba20b97e30f7b05854cb0f8ecda50dcac277f328ce: Status 404 returned error can't find the container with id 26d8289333b79681deaa4eba20b97e30f7b05854cb0f8ecda50dcac277f328ce Jun 09 00:19:49.714490 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.714468 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853488b5_5daa_4681_b1c4_47a4f2572bcd.slice/crio-4c54368de5a267d25b589f3e100dc3d06f3099c10759fe4b9a8263119b0eef3d WatchSource:0}: Error finding container 4c54368de5a267d25b589f3e100dc3d06f3099c10759fe4b9a8263119b0eef3d: Status 404 returned error can't find the container with id 4c54368de5a267d25b589f3e100dc3d06f3099c10759fe4b9a8263119b0eef3d Jun 09 00:19:49.718486 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:19:49.718468 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb295cec4_98da_4da3_9241_f65da92ea4d4.slice/crio-e1008937c0cfc060293bea9b0b532ada8502dfccd4d483e5abbdbc06c25b6411 WatchSource:0}: Error finding container e1008937c0cfc060293bea9b0b532ada8502dfccd4d483e5abbdbc06c25b6411: Status 404 returned error can't find the container with id e1008937c0cfc060293bea9b0b532ada8502dfccd4d483e5abbdbc06c25b6411 Jun 09 00:19:49.833811 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:49.833755 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:50.056483 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.056399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:50.056483 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.056455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:50.056691 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.056563 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:50.056691 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.056588 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.056691 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.056637 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.056615783 +0000 UTC m=+3.089712535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:50.056691 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.056659 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.056647002 +0000 UTC m=+3.089743759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.157421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.157389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:50.157634 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.157580 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:50.157722 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.157644 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:50.157722 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.157658 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:50.157722 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:50.157715 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.157697156 +0000 UTC m=+3.190793899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:50.389099 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.388952 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 00:14:49 +0000 UTC" deadline="2028-03-04 01:21:25.42403246 +0000 UTC" Jun 09 00:19:50.389099 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.389010 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h1m35.035025963s" Jun 09 00:19:50.436398 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.436352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" event={"ID":"a4510fdb-c93c-40a6-bf76-598ab484e22d","Type":"ContainerStarted","Data":"68bea795ee5e05d618ab17868be6537113e453707cdcb4af06a120b7fb735697"} Jun 09 00:19:50.454183 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.443789 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcksm" event={"ID":"b295cec4-98da-4da3-9241-f65da92ea4d4","Type":"ContainerStarted","Data":"e1008937c0cfc060293bea9b0b532ada8502dfccd4d483e5abbdbc06c25b6411"} Jun 09 00:19:50.454183 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.445708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtv8r" event={"ID":"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14","Type":"ContainerStarted","Data":"64af60b0fbb3d4d9e39c5d943286b7f875eb8f53711b05a483ee28ee71e05367"} Jun 09 00:19:50.454183 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.447539 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg2wk" event={"ID":"7a4c0f27-48c8-408b-a88a-bccb34e8746c","Type":"ContainerStarted","Data":"aea51ea3270e9f6a36b350d541c6e72c7e6352f244be47e0bf4c5a93cb32d00d"} Jun 09 00:19:50.455141 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.455081 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nsw6" event={"ID":"f4ddab19-0527-4ca4-ba15-00e20df9e14a","Type":"ContainerStarted","Data":"2bfadc016a60ef4c892a12cd60043e0e6398c34e8fc98c1d7f78ef831b1f0e39"} Jun 09 00:19:50.481356 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.481177 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnx98" event={"ID":"e912166d-7b2c-4e32-862c-ae7c784f1eb0","Type":"ContainerStarted","Data":"d3d34fb59e7ac0846424a1ee5e48ed525d0d92a7159ad855a6bc76c3550c52a8"} Jun 09 00:19:50.501229 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.501202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"58bddd5503c3ef16b61136ca70f1a9fe1889bd0ec032549dc8fb517f670f12ed"} Jun 09 00:19:50.503612 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.503589 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerStarted","Data":"4c54368de5a267d25b589f3e100dc3d06f3099c10759fe4b9a8263119b0eef3d"} Jun 09 00:19:50.520476 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:50.520449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6gnf4" event={"ID":"38611a13-6d81-46c4-acf8-a0aeacff9be9","Type":"ContainerStarted","Data":"26d8289333b79681deaa4eba20b97e30f7b05854cb0f8ecda50dcac277f328ce"} Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.065104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.065170 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.065227 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.065297 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.065301 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:53.065280702 +0000 UTC m=+5.098377444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:51.065385 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.065360 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:53.065344895 +0000 UTC m=+5.098441640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:51.165735 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.165701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:51.165930 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.165904 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:51.165930 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.165921 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:51.165930 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.165933 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:51.166129 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.165987 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:19:53.165969021 +0000 UTC m=+5.199065778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:51.389289 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.389196 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 00:14:49 +0000 UTC" deadline="2028-03-24 06:12:27.896751404 +0000 UTC" Jun 09 00:19:51.389289 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.389235 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15701h52m36.507521119s" Jun 09 00:19:51.414609 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.414582 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:51.414743 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.414704 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:19:51.415195 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.415172 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:51.415314 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.415276 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:51.415390 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.415358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:51.415454 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:51.415439 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:51.810800 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:51.810721 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.082364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.082422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.082546 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.082605 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:57.082588106 +0000 UTC m=+9.115684860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.082985 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:53.083084 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.083052 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:57.083036092 +0000 UTC m=+9.116132847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:53.183234 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.183201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:53.183412 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.183395 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:53.183506 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.183420 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:53.183506 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.183432 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:53.183506 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.183487 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:19:57.183466797 +0000 UTC m=+9.216563543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:53.414334 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.414255 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:53.414478 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.414390 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:53.414676 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.414657 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:53.414746 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:53.414678 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:53.414798 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.414780 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:53.414925 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:53.414870 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:19:55.414308 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:55.414273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:55.414820 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:55.414410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:55.414820 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:55.414415 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:55.414820 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:55.414644 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:19:55.414820 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:55.414713 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:55.415114 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:55.414818 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:57.110646 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.110612 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:57.111109 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.110676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:57.111109 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.110781 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:57.111109 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.110843 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:05.110826313 +0000 UTC m=+17.143923054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:57.111109 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.110781 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:57.111109 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.110946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:05.110924805 +0000 UTC m=+17.144021562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:57.211593 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.211556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:57.211764 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.211743 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:57.211809 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.211770 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:57.211809 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.211784 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:57.211909 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.211851 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:20:05.211831839 +0000 UTC m=+17.244928582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:57.414220 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.414111 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:57.414220 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.414139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:57.414220 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:57.414139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:57.414543 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.414221 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:57.414602 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.414533 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:57.414656 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:57.414603 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:19:59.414133 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:59.414100 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:19:59.414620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:59.414108 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:19:59.414620 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:59.414200 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:19:59.414620 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:59.414304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:19:59.414620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:19:59.414108 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:19:59.414620 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:19:59.414383 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:01.414544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:01.414488 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:01.414876 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:01.414589 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:01.414876 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:01.414598 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:01.414876 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:01.414620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:01.414876 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:01.414700 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:01.414876 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:01.414766 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:01.549295 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:01.549262 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" event={"ID":"464bdd4c02355b35b4e35ac2feecd187","Type":"ContainerStarted","Data":"dd880e0a3b33ebe896819e2539697b2d3df34ede3b99c884f4a070f60e57af91"} Jun 09 00:20:01.561671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:01.561610 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" podStartSLOduration=12.561592834 podStartE2EDuration="12.561592834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:01.561273355 +0000 UTC m=+13.594370146" watchObservedRunningTime="2026-06-09 00:20:01.561592834 +0000 UTC m=+13.594689589" Jun 09 00:20:03.414785 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.414748 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:03.415276 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.414807 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:03.415276 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.414921 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:03.415276 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:03.414927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:03.415276 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:03.414999 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:03.415276 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:03.415102 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:03.553885 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.553848 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"cbe13a689376d51cd6cdd1f530e726b2","Type":"ContainerStarted","Data":"e0f44b875caaf7539bb0cbb77c2a6d0bf2b2870711d9b6f64334270f07ffb9be"} Jun 09 00:20:03.555564 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.555540 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nsw6" event={"ID":"f4ddab19-0527-4ca4-ba15-00e20df9e14a","Type":"ContainerStarted","Data":"7655211659b06d734587bc22f9d67a2064b604cee0d0edc009b9f9a51c62f18f"} Jun 09 00:20:03.580144 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:03.580090 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9nsw6" podStartSLOduration=4.187519108 podStartE2EDuration="15.580070252s" totalImagesPullingTime="11.392551144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:03.579418632 +0000 UTC m=+15.612515394" watchObservedRunningTime="2026-06-09 00:20:03.580070252 +0000 UTC m=+15.613167017" Jun 09 00:20:05.174154 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.174122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:05.174594 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.174166 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:05.174594 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.174278 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:05.174594 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.174288 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:05.174594 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.174344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:21.174325238 +0000 UTC m=+33.207421982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:05.174594 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.174360 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:21.174353909 +0000 UTC m=+33.207450649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:05.274691 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.274662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:05.274844 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.274799 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:20:05.274844 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.274815 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:20:05.274844 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.274828 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:05.274964 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.274883 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:20:21.274866883 +0000 UTC m=+33.307963642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:05.414744 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.414643 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:05.414744 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.414679 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:05.414976 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.414760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:05.414976 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.414780 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:05.414976 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.414869 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:05.414976 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:05.414955 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:05.560749 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.560689 2557 generic.go:356] "Generic (PLEG): container finished" podID="cbe13a689376d51cd6cdd1f530e726b2" containerID="e0f44b875caaf7539bb0cbb77c2a6d0bf2b2870711d9b6f64334270f07ffb9be" exitCode=0 Jun 09 00:20:05.560749 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:05.560731 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"cbe13a689376d51cd6cdd1f530e726b2","Type":"ContainerDied","Data":"e0f44b875caaf7539bb0cbb77c2a6d0bf2b2870711d9b6f64334270f07ffb9be"} Jun 09 00:20:07.414438 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:07.414405 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:07.414888 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:07.414518 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:07.414888 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:07.414528 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:07.414888 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:07.414593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:07.414888 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:07.414628 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:07.414888 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:07.414738 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:09.414371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:09.414339 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:09.414776 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:09.414435 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:09.414776 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:09.414443 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:09.414776 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:09.414451 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:09.414776 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:09.414549 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:09.414776 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:09.414598 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:10.570778 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.570750 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"cbe13a689376d51cd6cdd1f530e726b2","Type":"ContainerStarted","Data":"c84775133385f89f64f0c5a906295e85949511f52e20f51ada488e01d2ce9056"} Jun 09 00:20:10.572136 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.572112 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="afddb83849f2feb5ce43bdf5f53d79d44b11951c887aa05130e549fbe9fba17b" exitCode=0 Jun 09 00:20:10.572252 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.572170 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"afddb83849f2feb5ce43bdf5f53d79d44b11951c887aa05130e549fbe9fba17b"} Jun 09 00:20:10.575596 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.575571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6gnf4" event={"ID":"38611a13-6d81-46c4-acf8-a0aeacff9be9","Type":"ContainerStarted","Data":"e3a72ec906d4afc5d65205324010cb92b5f164def5fb756e4cd211dd99c9891e"} Jun 09 00:20:10.577881 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.577858 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" event={"ID":"a4510fdb-c93c-40a6-bf76-598ab484e22d","Type":"ContainerStarted","Data":"27890a4cc6574819840625ac121b44c8b8cb0a0e41a6594244ac743831d7a159"} Jun 09 00:20:10.579473 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.579447 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcksm" event={"ID":"b295cec4-98da-4da3-9241-f65da92ea4d4","Type":"ContainerStarted","Data":"626e97d77a38b5d234db693d4d96128cd1a381756d46cfc2d26bd6903c34ada4"} Jun 09 00:20:10.581060 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.580997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtv8r" event={"ID":"d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14","Type":"ContainerStarted","Data":"1cc454a68e8ca783c2ded8b914bc65d4dba59da18130ae24bdafb68b5253cc1a"} Jun 09 00:20:10.582623 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.582598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnx98" event={"ID":"e912166d-7b2c-4e32-862c-ae7c784f1eb0","Type":"ContainerStarted","Data":"b23e4314d33a4557c43fcb75ab04594c58a37217aa7afcd1beffca4920b33829"} Jun 09 00:20:10.584566 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.584543 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"497e185f2306abffc0bee995430b1ed27f891c8bb16bb68f9eea763ee177ac69"} Jun 09 00:20:10.584951 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.584907 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" podStartSLOduration=21.584891278 podStartE2EDuration="21.584891278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:10.584432637 +0000 UTC m=+22.617529401" watchObservedRunningTime="2026-06-09 00:20:10.584891278 +0000 UTC m=+22.617988042" Jun 09 00:20:10.598628 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.598594 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6gnf4" podStartSLOduration=11.148767789 podStartE2EDuration="22.598581555s" totalImagesPullingTime="11.449813766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:10.597933814 +0000 UTC m=+22.631030576" watchObservedRunningTime="2026-06-09 00:20:10.598581555 +0000 UTC m=+22.631678317" Jun 09 00:20:10.632343 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.632300 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lnx98" podStartSLOduration=11.14037609 podStartE2EDuration="22.6322848s" totalImagesPullingTime="11.49190871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:10.631624034 +0000 UTC m=+22.664720796" watchObservedRunningTime="2026-06-09 00:20:10.6322848 +0000 UTC m=+22.665381562" Jun 09 00:20:10.643736 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.643691 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gtv8r" podStartSLOduration=11.188442893 podStartE2EDuration="22.643650944s" totalImagesPullingTime="11.455208051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:10.643268979 +0000 UTC m=+22.676365742" watchObservedRunningTime="2026-06-09 00:20:10.643650944 +0000 UTC m=+22.676747707" Jun 09 00:20:10.661439 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:10.661408 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mcksm" podStartSLOduration=2.6081386650000002 podStartE2EDuration="22.661399768s" totalImagesPullingTime="20.053261103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:10.661259148 +0000 UTC m=+22.694355911" watchObservedRunningTime="2026-06-09 00:20:10.661399768 +0000 UTC m=+22.694496530" Jun 09 00:20:11.281426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.281404 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 00:20:11.411367 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.411227 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T00:20:11.281420736Z","UUID":"8b52f2be-e233-4e5f-bda6-6544501049b9","Handler":null,"Name":"","Endpoint":""} Jun 09 00:20:11.414007 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.413539 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 00:20:11.414007 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.413592 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 00:20:11.414195 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.414068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:11.414246 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:11.414218 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:11.414936 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.414672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:11.414936 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:11.414799 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:11.414936 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.414843 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:11.415146 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:11.415101 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:11.588685 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.588652 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" event={"ID":"a4510fdb-c93c-40a6-bf76-598ab484e22d","Type":"ContainerStarted","Data":"839d0227fb41a38aa708dc5496547f15b019982ba335ca4ec3767af2f65112f4"} Jun 09 00:20:11.590206 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.590160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg2wk" event={"ID":"7a4c0f27-48c8-408b-a88a-bccb34e8746c","Type":"ContainerStarted","Data":"1bba06e4a3e2a559a0e65747578de99e2af079e1c86ed8665208a6d9b891132a"} Jun 09 00:20:11.593333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593312 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:20:11.593722 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593694 2557 generic.go:356] "Generic (PLEG): container finished" podID="43252a7c-f346-47c5-a53c-e0a0c54caed9" containerID="36a2d5e036fc4a24b9402d5fc6d1007e044ce23693ccb4012d64a015ee0d9467" exitCode=1 Jun 09 00:20:11.593814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593787 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"a5d5ee26ab91c32ec38ba281f318954c1c364abf2ecfbfa680575bd5b0fc86b2"} Jun 09 00:20:11.593934 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"86c24a81b1f2ddfde9c49ef24f0d8637e60c769a07590119db096063d1c01c28"} Jun 09 00:20:11.594001 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593940 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"ee76edfe720f6dd1fb18d0a28dad78a4f7eb539dd9d1cebe8a89844017ab1f4f"} Jun 09 00:20:11.594001 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.593998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"bae603f53fa29adf9e9c564f07d2d975a9d3ee58f3506ecf4422f2fe9a143722"} Jun 09 00:20:11.594128 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.594066 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerDied","Data":"36a2d5e036fc4a24b9402d5fc6d1007e044ce23693ccb4012d64a015ee0d9467"} Jun 09 00:20:11.603492 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:11.603450 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rg2wk" podStartSLOduration=12.189391758 podStartE2EDuration="23.60343704s" totalImagesPullingTime="11.414045282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:11.603062056 +0000 UTC m=+23.636158819" watchObservedRunningTime="2026-06-09 00:20:11.60343704 +0000 UTC m=+23.636533802" Jun 09 00:20:13.414877 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:13.414704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:13.415433 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:13.414731 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:13.415433 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:13.414967 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:13.415433 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:13.414775 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:13.415433 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:13.415056 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:13.415433 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:13.415139 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:13.601085 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:13.601045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" event={"ID":"a4510fdb-c93c-40a6-bf76-598ab484e22d","Type":"ContainerStarted","Data":"d74d259ce3964430065c219edf519d4ca61d00242995f8be2db1f61f137b11d2"} Jun 09 00:20:13.622355 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:13.622301 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frkxv" podStartSLOduration=11.468653257 podStartE2EDuration="25.622286137s" totalImagesPullingTime="14.15363288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:13.621591901 +0000 UTC m=+25.654688646" watchObservedRunningTime="2026-06-09 00:20:13.622286137 +0000 UTC m=+25.655382899" Jun 09 00:20:15.027633 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.027594 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:20:15.028225 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.028135 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:20:15.414155 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.414129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:15.414308 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.414229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:15.414308 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:15.414234 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:15.414389 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.414235 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:15.414389 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:15.414309 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:15.414389 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:15.414370 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:15.608693 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.608668 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:20:15.609067 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.609047 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"b345a23117d1e417a61783e3dc2632a4e4c883b51ff87984c3ab38912edc6d18"} Jun 09 00:20:15.610609 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.610591 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="cf5e9a39eaee0abb1737498f3adcc37e5ab3642bb19dfddc94c5a6db865f7724" exitCode=0 Jun 09 00:20:15.610705 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.610672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"cf5e9a39eaee0abb1737498f3adcc37e5ab3642bb19dfddc94c5a6db865f7724"} Jun 09 00:20:15.610879 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.610862 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:20:15.611771 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:15.611752 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gtv8r" Jun 09 00:20:17.414975 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.414775 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:17.415396 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.414776 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:17.415396 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:17.415083 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:17.415396 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.414776 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:17.415396 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:17.415130 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:17.415396 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:17.415207 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:17.617810 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.617780 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="c496a597942a6730fa497955e9a86af48c55ec5f3cd3a93f6601853f23a2f960" exitCode=0 Jun 09 00:20:17.617953 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.617860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"c496a597942a6730fa497955e9a86af48c55ec5f3cd3a93f6601853f23a2f960"} Jun 09 00:20:17.621337 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.621321 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:20:17.621731 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.621706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"af0d9636bc40f3059d5fc280139ac668d207954cada5f021b4ef1a830a2db229"} Jun 09 00:20:17.621982 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.621966 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:17.622071 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.622050 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:17.622125 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.622069 2557 scope.go:117] "RemoveContainer" containerID="36a2d5e036fc4a24b9402d5fc6d1007e044ce23693ccb4012d64a015ee0d9467" Jun 09 00:20:17.637540 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:17.637517 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:18.628254 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.628234 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:20:18.628713 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.628559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" event={"ID":"43252a7c-f346-47c5-a53c-e0a0c54caed9","Type":"ContainerStarted","Data":"8f818d9fed6700eba5c1260f89b8eaa140b708c3159879826c99ccd9dfc96144"} Jun 09 00:20:18.628834 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.628812 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:18.630991 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.630967 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="dc81f584582bf0eb7a101e9bb227189d2763011edea2541307c95e158a2d2236" exitCode=0 Jun 09 00:20:18.631092 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.631002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"dc81f584582bf0eb7a101e9bb227189d2763011edea2541307c95e158a2d2236"} Jun 09 00:20:18.643250 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.643232 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:18.689435 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:18.689343 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" podStartSLOduration=9.978123887 podStartE2EDuration="30.689323136s" totalImagesPullingTime="20.711199249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:18.661724248 +0000 UTC m=+30.694821011" watchObservedRunningTime="2026-06-09 00:20:18.689323136 +0000 UTC m=+30.722419900" Jun 09 00:20:19.191503 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.191472 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5854h"] Jun 09 00:20:19.191657 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.191622 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:19.191748 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:19.191719 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:19.195931 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.195621 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlj8z"] Jun 09 00:20:19.195931 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.195795 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:19.196108 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:19.196067 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:19.200207 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.196421 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxsfk"] Jun 09 00:20:19.200494 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:19.200466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:19.201057 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:19.201001 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:20.414842 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:20.414803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:20.414842 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:20.414820 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:20.415479 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:20.414936 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:20.415479 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:20.414986 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:20.415479 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:20.414998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:20.415479 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:20.415099 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:21.197301 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:21.197261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:21.197479 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:21.197354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:21.197479 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.197430 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:21.197479 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.197454 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:21.197612 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.197504 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret podName:a6b5c674-712e-4301-9527-ea6b6bb97348 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:53.197485157 +0000 UTC m=+65.230581915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret") pod "global-pull-secret-syncer-5854h" (UID: "a6b5c674-712e-4301-9527-ea6b6bb97348") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:21.197612 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.197522 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:53.197513178 +0000 UTC m=+65.230609921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:21.298666 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:21.298586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:21.298812 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.298762 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:20:21.298812 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.298786 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:20:21.298812 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.298801 2557 projected.go:196] Error preparing data for projected volume kube-api-access-9z5nq for pod openshift-network-diagnostics/network-check-target-tlj8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:21.298932 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:21.298862 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq podName:3350ea89-8aaa-4903-9c31-a223b6431ebd nodeName:}" failed. No retries permitted until 2026-06-09 00:20:53.298843817 +0000 UTC m=+65.331940563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9z5nq" (UniqueName: "kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq") pod "network-check-target-tlj8z" (UID: "3350ea89-8aaa-4903-9c31-a223b6431ebd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:22.414889 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:22.414859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:22.414889 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:22.414894 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:22.415548 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:22.414859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:22.415548 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:22.414985 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:20:22.415548 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:22.415075 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlj8z" podUID="3350ea89-8aaa-4903-9c31-a223b6431ebd" Jun 09 00:20:22.415548 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:22.415161 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5854h" podUID="a6b5c674-712e-4301-9527-ea6b6bb97348" Jun 09 00:20:22.642772 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:22.642745 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerStarted","Data":"ae1fbc13b31e08a2c8c545f86d519903cd36a87b6cb70f5e086f137960dcaf80"} Jun 09 00:20:23.646916 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.646884 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="ae1fbc13b31e08a2c8c545f86d519903cd36a87b6cb70f5e086f137960dcaf80" exitCode=0 Jun 09 00:20:23.647501 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.646945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"ae1fbc13b31e08a2c8c545f86d519903cd36a87b6cb70f5e086f137960dcaf80"} Jun 09 00:20:23.811928 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.811909 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeReady" Jun 09 00:20:23.812077 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.812066 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 00:20:23.842430 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.842408 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:20:23.844038 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.844006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:23.846266 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.846244 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xd9lg\"" Jun 09 00:20:23.846266 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.846259 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 00:20:23.846414 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.846256 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 00:20:23.846414 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.846385 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 00:20:23.851137 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.851118 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 00:20:23.860891 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.860871 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:20:23.861494 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.861477 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-46p6k"] Jun 09 00:20:23.863249 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.863227 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dgzfk"] Jun 09 00:20:23.863368 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.863352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:23.864998 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.864894 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:23.867105 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.867086 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 00:20:23.867187 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.867113 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfdgk\"" Jun 09 00:20:23.867763 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.867750 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 00:20:23.868056 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.868039 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 00:20:23.868161 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.868046 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4nj5d\"" Jun 09 00:20:23.868574 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.868555 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 00:20:23.868661 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.868582 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 00:20:23.889130 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.889110 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgzfk"] Jun 09 00:20:23.889632 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:23.889618 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46p6k"] Jun 09 00:20:24.021405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c5627a-fd6d-460d-8a79-be70d444d52b-tmp-dir\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.021405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8k6\" (UniqueName: \"kubernetes.io/projected/b8c5627a-fd6d-460d-8a79-be70d444d52b-kube-api-access-8b8k6\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.021563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c5627a-fd6d-460d-8a79-be70d444d52b-config-volume\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.021563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd2eff74-5a71-4257-98fe-372e69274d94-cert\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.021563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs2pz\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021683 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.021720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021899 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021899 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.021899 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.021820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spt9\" (UniqueName: \"kubernetes.io/projected/bd2eff74-5a71-4257-98fe-372e69274d94-kube-api-access-4spt9\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.122214 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122194 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c5627a-fd6d-460d-8a79-be70d444d52b-tmp-dir\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.122292 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8k6\" (UniqueName: \"kubernetes.io/projected/b8c5627a-fd6d-460d-8a79-be70d444d52b-kube-api-access-8b8k6\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.122292 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c5627a-fd6d-460d-8a79-be70d444d52b-config-volume\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.122292 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd2eff74-5a71-4257-98fe-372e69274d94-cert\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.122292 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs2pz\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.122468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122480 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122505 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spt9\" (UniqueName: \"kubernetes.io/projected/bd2eff74-5a71-4257-98fe-372e69274d94-kube-api-access-4spt9\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122566 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c5627a-fd6d-460d-8a79-be70d444d52b-tmp-dir\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.122624 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.122690 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:24.622673049 +0000 UTC m=+36.655769789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:24.122814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.122765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.123190 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.122855 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:24.123190 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.122870 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:24.123190 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.122926 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:24.622908414 +0000 UTC m=+36.656005178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:24.123190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.123058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c5627a-fd6d-460d-8a79-be70d444d52b-config-volume\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.123190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.123065 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.123814 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.123796 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.126523 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.126501 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.126621 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.126501 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.126621 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.126554 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd2eff74-5a71-4257-98fe-372e69274d94-cert\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.130645 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.130618 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs2pz\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.130879 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.130859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.131091 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.131074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spt9\" (UniqueName: \"kubernetes.io/projected/bd2eff74-5a71-4257-98fe-372e69274d94-kube-api-access-4spt9\") pod \"ingress-canary-dgzfk\" (UID: \"bd2eff74-5a71-4257-98fe-372e69274d94\") " pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.131344 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.131330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8k6\" (UniqueName: \"kubernetes.io/projected/b8c5627a-fd6d-460d-8a79-be70d444d52b-kube-api-access-8b8k6\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.179653 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.179627 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgzfk" Jun 09 00:20:24.304837 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.304612 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgzfk"] Jun 09 00:20:24.307872 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:20:24.307849 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2eff74_5a71_4257_98fe_372e69274d94.slice/crio-16935fb6a202086e9f929a2481f6b5031500819942e6c34f56f25c533aeb5595 WatchSource:0}: Error finding container 16935fb6a202086e9f929a2481f6b5031500819942e6c34f56f25c533aeb5595: Status 404 returned error can't find the container with id 16935fb6a202086e9f929a2481f6b5031500819942e6c34f56f25c533aeb5595 Jun 09 00:20:24.414186 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.414164 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:24.414271 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.414184 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:24.414425 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.414404 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:24.416650 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416577 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:20:24.416650 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416615 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:20:24.416650 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416627 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:20:24.417049 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416674 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ldwg\"" Jun 09 00:20:24.417049 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416630 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f26v2\"" Jun 09 00:20:24.417049 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.416616 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:20:24.625911 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.625893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:24.626009 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.625917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:24.626009 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.625996 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:24.626009 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.626006 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:24.626131 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.626050 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:24.626131 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.626072 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:25.62605767 +0000 UTC m=+37.659154409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:24.626131 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:24.626096 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:25.626084012 +0000 UTC m=+37.659180756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:24.650553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.650526 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgzfk" event={"ID":"bd2eff74-5a71-4257-98fe-372e69274d94","Type":"ContainerStarted","Data":"16935fb6a202086e9f929a2481f6b5031500819942e6c34f56f25c533aeb5595"} Jun 09 00:20:24.653461 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.653437 2557 generic.go:356] "Generic (PLEG): container finished" podID="853488b5-5daa-4681-b1c4-47a4f2572bcd" containerID="720dcddb44b39883fae226bff1d937cf2f7c5e4a2d780058eab8c5b7d273bf6a" exitCode=0 Jun 09 00:20:24.653534 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:24.653476 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerDied","Data":"720dcddb44b39883fae226bff1d937cf2f7c5e4a2d780058eab8c5b7d273bf6a"} Jun 09 00:20:25.633417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:25.633385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:25.633417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:25.633422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:25.633665 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:25.633521 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:25.633665 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:25.633584 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:27.633561799 +0000 UTC m=+39.666658540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:25.633665 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:25.633526 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:25.633665 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:25.633611 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:25.633665 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:25.633656 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:27.633643689 +0000 UTC m=+39.666740430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:25.658332 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:25.658310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" event={"ID":"853488b5-5daa-4681-b1c4-47a4f2572bcd","Type":"ContainerStarted","Data":"48cd9fb5e3078996416b8d8b19ce0283d13285168d421e3f7b3614950c1bba34"} Jun 09 00:20:25.682516 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:25.682469 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rxcqj" podStartSLOduration=7.696038923 podStartE2EDuration="37.682449329s" totalImagesPullingTime="29.986410406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:25.679074583 +0000 UTC m=+37.712171348" watchObservedRunningTime="2026-06-09 00:20:25.682449329 +0000 UTC m=+37.715546092" Jun 09 00:20:27.648671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:27.648628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:27.648671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:27.648672 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:27.649136 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:27.648789 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:27.649136 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:27.648804 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:27.649136 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:27.648863 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:31.648844556 +0000 UTC m=+43.681941303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:27.649136 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:27.648787 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:27.649136 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:27.648934 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:31.648912653 +0000 UTC m=+43.682009396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:28.668039 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:28.667864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgzfk" event={"ID":"bd2eff74-5a71-4257-98fe-372e69274d94","Type":"ContainerStarted","Data":"49d83f684d15472a3b1466769164fb4672636347c4627ee0ffd307618e725446"} Jun 09 00:20:28.683269 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:28.683226 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dgzfk" podStartSLOduration=1.899013642 podStartE2EDuration="5.683211775s" totalImagesPullingTime="3.784198133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:28.682578798 +0000 UTC m=+40.715675563" watchObservedRunningTime="2026-06-09 00:20:28.683211775 +0000 UTC m=+40.716308536" Jun 09 00:20:31.674973 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:31.674942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:31.674973 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:31.674975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:31.675487 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:31.675107 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:31.675487 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:31.675109 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:31.675487 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:31.675171 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:39.675155515 +0000 UTC m=+51.708252254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:31.675487 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:31.675117 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:31.675487 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:31.675252 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:39.675235113 +0000 UTC m=+51.708331874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:39.723006 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:39.722975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:39.723006 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:39.723007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:39.723518 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:39.723114 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:39.723518 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:39.723129 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:39.723518 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:39.723112 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:39.723518 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:39.723183 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:55.723168451 +0000 UTC m=+67.756265190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:39.723518 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:39.723197 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:55.723190231 +0000 UTC m=+67.756286971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:50.646124 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:50.646095 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96krg" Jun 09 00:20:53.216698 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.216655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:53.217130 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.216740 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:20:53.218971 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.218941 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:20:53.218971 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.218948 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:20:53.227827 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:53.227805 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:20:53.227913 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:53.227875 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:21:57.227857182 +0000 UTC m=+129.260953926 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : secret "metrics-daemon-secret" not found Jun 09 00:20:53.231758 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.231735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6b5c674-712e-4301-9527-ea6b6bb97348-original-pull-secret\") pod \"global-pull-secret-syncer-5854h\" (UID: \"a6b5c674-712e-4301-9527-ea6b6bb97348\") " pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:53.317461 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.317434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:53.319526 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.319509 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:20:53.329769 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.329750 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:20:53.340381 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.340349 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5nq\" (UniqueName: \"kubernetes.io/projected/3350ea89-8aaa-4903-9c31-a223b6431ebd-kube-api-access-9z5nq\") pod \"network-check-target-tlj8z\" (UID: \"3350ea89-8aaa-4903-9c31-a223b6431ebd\") " pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:53.526145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.526094 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ldwg\"" Jun 09 00:20:53.529663 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.529648 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5854h" Jun 09 00:20:53.535081 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.535065 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:53.659997 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.659972 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlj8z"] Jun 09 00:20:53.663138 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:20:53.663112 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3350ea89_8aaa_4903_9c31_a223b6431ebd.slice/crio-28e64b4c6ec93cf185aadcb2effa69d1ae1643e517a3dae710f43a07fe10450e WatchSource:0}: Error finding container 28e64b4c6ec93cf185aadcb2effa69d1ae1643e517a3dae710f43a07fe10450e: Status 404 returned error can't find the container with id 28e64b4c6ec93cf185aadcb2effa69d1ae1643e517a3dae710f43a07fe10450e Jun 09 00:20:53.675605 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.675584 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5854h"] Jun 09 00:20:53.678407 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:20:53.678383 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b5c674_712e_4301_9527_ea6b6bb97348.slice/crio-9c1c2c69da745c35f19a60020445ad2b35857330546c385d0ff17e99445ce47f WatchSource:0}: Error finding container 9c1c2c69da745c35f19a60020445ad2b35857330546c385d0ff17e99445ce47f: Status 404 returned error can't find the container with id 9c1c2c69da745c35f19a60020445ad2b35857330546c385d0ff17e99445ce47f Jun 09 00:20:53.722937 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.722913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlj8z" event={"ID":"3350ea89-8aaa-4903-9c31-a223b6431ebd","Type":"ContainerStarted","Data":"28e64b4c6ec93cf185aadcb2effa69d1ae1643e517a3dae710f43a07fe10450e"} Jun 09 00:20:53.723995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:53.723978 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5854h" event={"ID":"a6b5c674-712e-4301-9527-ea6b6bb97348","Type":"ContainerStarted","Data":"9c1c2c69da745c35f19a60020445ad2b35857330546c385d0ff17e99445ce47f"} Jun 09 00:20:55.736152 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:55.736116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:55.736165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:55.736274 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:55.736343 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:21:27.736323507 +0000 UTC m=+99.769420249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:55.736280 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:55.736379 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:20:55.736566 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:20:55.736426 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:21:27.736414573 +0000 UTC m=+99.769511313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:20:57.736333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:57.736175 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlj8z" event={"ID":"3350ea89-8aaa-4903-9c31-a223b6431ebd","Type":"ContainerStarted","Data":"d5c95cc616b898a97dcbd47814e5f99f9616872683eabf2586797d8b5b759dc2"} Jun 09 00:20:57.736333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:57.736272 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:20:57.749869 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:57.749818 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tlj8z" podStartSLOduration=66.69080027 podStartE2EDuration="1m9.74979982s" totalImagesPullingTime="3.05899955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:57.749042871 +0000 UTC m=+69.782139632" watchObservedRunningTime="2026-06-09 00:20:57.74979982 +0000 UTC m=+69.782896583" Jun 09 00:20:58.740309 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:58.740222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5854h" event={"ID":"a6b5c674-712e-4301-9527-ea6b6bb97348","Type":"ContainerStarted","Data":"9a8b63ee3c17528d5f13db4b4b34a5a6fd08c0cff9045f01f7771e21b3142708"} Jun 09 00:20:58.753329 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:20:58.753288 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5854h" podStartSLOduration=65.025513066 podStartE2EDuration="1m9.753274358s" totalImagesPullingTime="4.727761292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:58.752210299 +0000 UTC m=+70.785307093" watchObservedRunningTime="2026-06-09 00:20:58.753274358 +0000 UTC m=+70.786371117" Jun 09 00:21:27.750248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:21:27.750215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:21:27.750248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:21:27.750248 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:21:27.750775 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:27.750346 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:21:27.750775 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:27.750362 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98cd55f4d-xkw5v: secret "image-registry-tls" not found Jun 09 00:21:27.750775 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:27.750416 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls podName:a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:31.750401606 +0000 UTC m=+163.783498347 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls") pod "image-registry-98cd55f4d-xkw5v" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474") : secret "image-registry-tls" not found Jun 09 00:21:27.750775 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:27.750345 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:21:27.750775 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:27.750484 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls podName:b8c5627a-fd6d-460d-8a79-be70d444d52b nodeName:}" failed. No retries permitted until 2026-06-09 00:22:31.75047023 +0000 UTC m=+163.783566971 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls") pod "dns-default-46p6k" (UID: "b8c5627a-fd6d-460d-8a79-be70d444d52b") : secret "dns-default-metrics-tls" not found Jun 09 00:21:28.742858 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:21:28.742830 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tlj8z" Jun 09 00:21:57.245199 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:21:57.245146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:21:57.245692 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:57.245305 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:21:57.245692 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:21:57.245369 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs podName:f5708cea-7f0f-4176-947d-721399db9e83 nodeName:}" failed. No retries permitted until 2026-06-09 00:23:59.245351987 +0000 UTC m=+251.278448744 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs") pod "network-metrics-daemon-nxsfk" (UID: "f5708cea-7f0f-4176-947d-721399db9e83") : secret "metrics-daemon-secret" not found Jun 09 00:22:12.507087 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.507057 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-7snmp"] Jun 09 00:22:12.509511 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.509493 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.511842 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.511820 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 00:22:12.511982 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.511954 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 00:22:12.512081 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.512065 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tflrz\"" Jun 09 00:22:12.512149 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.512066 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 00:22:12.512582 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.512564 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 00:22:12.517121 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.517105 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 00:22:12.522309 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.522291 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7snmp"] Jun 09 00:22:12.609821 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.609790 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h"] Jun 09 00:22:12.612064 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.612047 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj"] Jun 09 00:22:12.612127 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.612099 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.613800 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.613777 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.614314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.614292 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 00:22:12.614314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.614306 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 00:22:12.614467 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.614334 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 00:22:12.614467 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.614344 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 00:22:12.615984 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.615967 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 00:22:12.616090 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.615985 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 00:22:12.616090 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.615989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 00:22:12.616525 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.616509 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 00:22:12.625169 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.625148 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj"] Jun 09 00:22:12.626065 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.626042 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h"] Jun 09 00:22:12.652062 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/553f3c5f-1187-4a71-9943-26484a044a3e-serving-cert\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.652157 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-snapshots\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.652157 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-trusted-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.652227 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-service-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.652227 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-tmp\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.652294 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.652237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2crhx\" (UniqueName: \"kubernetes.io/projected/553f3c5f-1187-4a71-9943-26484a044a3e-kube-api-access-2crhx\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.752730 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.752855 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ff25cee-3689-429b-a002-899e5258e17a-klusterlet-config\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.752855 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.752855 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.752855 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752830 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.752855 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqb97\" (UniqueName: \"kubernetes.io/projected/e615d96e-9c9c-448c-900d-96756b534fe3-kube-api-access-pqb97\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.753013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff25cee-3689-429b-a002-899e5258e17a-tmp\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.753013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-trusted-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-service-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.752985 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-tmp\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e615d96e-9c9c-448c-900d-96756b534fe3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.753248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753051 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2crhx\" (UniqueName: \"kubernetes.io/projected/553f3c5f-1187-4a71-9943-26484a044a3e-kube-api-access-2crhx\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/553f3c5f-1187-4a71-9943-26484a044a3e-serving-cert\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753116 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7hvg\" (UniqueName: \"kubernetes.io/projected/8ff25cee-3689-429b-a002-899e5258e17a-kube-api-access-c7hvg\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.753248 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-snapshots\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753473 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753434 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-tmp\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753645 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753626 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-service-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753695 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753668 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/553f3c5f-1187-4a71-9943-26484a044a3e-snapshots\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.753948 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.753932 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553f3c5f-1187-4a71-9943-26484a044a3e-trusted-ca-bundle\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.755332 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.755316 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/553f3c5f-1187-4a71-9943-26484a044a3e-serving-cert\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.761059 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.760995 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2crhx\" (UniqueName: \"kubernetes.io/projected/553f3c5f-1187-4a71-9943-26484a044a3e-kube-api-access-2crhx\") pod \"insights-operator-896549976-7snmp\" (UID: \"553f3c5f-1187-4a71-9943-26484a044a3e\") " pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.819184 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.819158 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7snmp" Jun 09 00:22:12.854236 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.854366 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.854366 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqb97\" (UniqueName: \"kubernetes.io/projected/e615d96e-9c9c-448c-900d-96756b534fe3-kube-api-access-pqb97\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff25cee-3689-429b-a002-899e5258e17a-tmp\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e615d96e-9c9c-448c-900d-96756b534fe3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7hvg\" (UniqueName: \"kubernetes.io/projected/8ff25cee-3689-429b-a002-899e5258e17a-kube-api-access-c7hvg\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ff25cee-3689-429b-a002-899e5258e17a-klusterlet-config\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.854918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.856406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.855774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff25cee-3689-429b-a002-899e5258e17a-tmp\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.857258 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.857207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.857498 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.857477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.857703 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.857682 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e615d96e-9c9c-448c-900d-96756b534fe3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.858694 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.858667 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ff25cee-3689-429b-a002-899e5258e17a-klusterlet-config\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.858694 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.858675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.858933 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.858908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e615d96e-9c9c-448c-900d-96756b534fe3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.861324 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.861300 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqb97\" (UniqueName: \"kubernetes.io/projected/e615d96e-9c9c-448c-900d-96756b534fe3-kube-api-access-pqb97\") pod \"cluster-proxy-proxy-agent-7fc88898f9-xhkmj\" (UID: \"e615d96e-9c9c-448c-900d-96756b534fe3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.861740 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.861721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7hvg\" (UniqueName: \"kubernetes.io/projected/8ff25cee-3689-429b-a002-899e5258e17a-kube-api-access-c7hvg\") pod \"klusterlet-addon-workmgr-749b944c74-9dm4h\" (UID: \"8ff25cee-3689-429b-a002-899e5258e17a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.922214 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.922183 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:12.938995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.938971 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:22:12.940627 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:12.940600 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7snmp"] Jun 09 00:22:12.945402 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:12.945377 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553f3c5f_1187_4a71_9943_26484a044a3e.slice/crio-f701c6781e412a38aa43afac7348f6425197ff3496a206a6281ba92d98e21b13 WatchSource:0}: Error finding container f701c6781e412a38aa43afac7348f6425197ff3496a206a6281ba92d98e21b13: Status 404 returned error can't find the container with id f701c6781e412a38aa43afac7348f6425197ff3496a206a6281ba92d98e21b13 Jun 09 00:22:13.046296 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:13.046269 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h"] Jun 09 00:22:13.049258 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:13.049229 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff25cee_3689_429b_a002_899e5258e17a.slice/crio-8a28894fedcfabb5643c2fcc8251c9d995255499cdbebaf3057fb5d652dfe26d WatchSource:0}: Error finding container 8a28894fedcfabb5643c2fcc8251c9d995255499cdbebaf3057fb5d652dfe26d: Status 404 returned error can't find the container with id 8a28894fedcfabb5643c2fcc8251c9d995255499cdbebaf3057fb5d652dfe26d Jun 09 00:22:13.066717 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:13.066694 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj"] Jun 09 00:22:13.069265 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:13.069239 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode615d96e_9c9c_448c_900d_96756b534fe3.slice/crio-d02e09cae517a111a7b3495fbd9edc81e427d060f518dd3e8ed4292b1561d8b2 WatchSource:0}: Error finding container d02e09cae517a111a7b3495fbd9edc81e427d060f518dd3e8ed4292b1561d8b2: Status 404 returned error can't find the container with id d02e09cae517a111a7b3495fbd9edc81e427d060f518dd3e8ed4292b1561d8b2 Jun 09 00:22:13.921196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:13.921102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7snmp" event={"ID":"553f3c5f-1187-4a71-9943-26484a044a3e","Type":"ContainerStarted","Data":"f701c6781e412a38aa43afac7348f6425197ff3496a206a6281ba92d98e21b13"} Jun 09 00:22:13.926704 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:13.926595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerStarted","Data":"d02e09cae517a111a7b3495fbd9edc81e427d060f518dd3e8ed4292b1561d8b2"} Jun 09 00:22:13.928548 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:13.928487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" event={"ID":"8ff25cee-3689-429b-a002-899e5258e17a","Type":"ContainerStarted","Data":"8a28894fedcfabb5643c2fcc8251c9d995255499cdbebaf3057fb5d652dfe26d"} Jun 09 00:22:18.948285 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.948249 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7snmp" event={"ID":"553f3c5f-1187-4a71-9943-26484a044a3e","Type":"ContainerStarted","Data":"c475e438ad75984f98e365f7ab64009fd279c5f9c7e0b358241dab7382eef0de"} Jun 09 00:22:18.950285 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.950262 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerStarted","Data":"2a982db6f3d78c21835886593229821fd72d1c01e997cd12094d3412f38cf5d2"} Jun 09 00:22:18.950419 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.950299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerStarted","Data":"a70a70b72c1861939b7c2a468361bcb639f98baf9fd8775c43931a7b96c7baec"} Jun 09 00:22:18.950419 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.950317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerStarted","Data":"b336c1b61f4f33f6222cbaede44e29d5aff875d1cfa06e83ce7d7a299d2e585e"} Jun 09 00:22:18.951705 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.951680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" event={"ID":"8ff25cee-3689-429b-a002-899e5258e17a","Type":"ContainerStarted","Data":"c85e10971b80326d30a2d93b3889b2b76274c6f9d6ace146dc0553b91b3280be"} Jun 09 00:22:18.951899 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.951882 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:18.953294 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.953277 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" Jun 09 00:22:18.964447 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.964411 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-7snmp" podStartSLOduration=1.442478483 podStartE2EDuration="6.964400134s" totalImagesPullingTime="5.521921651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:18.962950066 +0000 UTC m=+150.996046829" watchObservedRunningTime="2026-06-09 00:22:18.964400134 +0000 UTC m=+150.997496911" Jun 09 00:22:18.982148 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:18.982109 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749b944c74-9dm4h" podStartSLOduration=1.5457718 podStartE2EDuration="6.982098379s" totalImagesPullingTime="5.436326579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:18.981462238 +0000 UTC m=+151.014559004" watchObservedRunningTime="2026-06-09 00:22:18.982098379 +0000 UTC m=+151.015195140" Jun 09 00:22:19.001424 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:19.001389 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" podStartSLOduration=1.584146965 podStartE2EDuration="7.001377116s" totalImagesPullingTime="5.417230151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:19.000516864 +0000 UTC m=+151.033613664" watchObservedRunningTime="2026-06-09 00:22:19.001377116 +0000 UTC m=+151.034473878" Jun 09 00:22:21.723672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:21.723636 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6gnf4_38611a13-6d81-46c4-acf8-a0aeacff9be9/dns-node-resolver/0.log" Jun 09 00:22:23.122386 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:23.122358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nsw6_f4ddab19-0527-4ca4-ba15-00e20df9e14a/node-ca/0.log" Jun 09 00:22:23.522644 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:23.522560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgzfk_bd2eff74-5a71-4257-98fe-372e69274d94/serve-healthcheck-canary/0.log" Jun 09 00:22:26.853382 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:22:26.853334 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" Jun 09 00:22:26.872639 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:22:26.872603 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-46p6k" podUID="b8c5627a-fd6d-460d-8a79-be70d444d52b" Jun 09 00:22:26.977443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:26.977413 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:22:26.977443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:26.977440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:27.434444 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:22:27.434402 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nxsfk" podUID="f5708cea-7f0f-4176-947d-721399db9e83" Jun 09 00:22:31.791503 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:31.791464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:31.791503 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:31.791504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:22:31.793686 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:31.793666 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8c5627a-fd6d-460d-8a79-be70d444d52b-metrics-tls\") pod \"dns-default-46p6k\" (UID: \"b8c5627a-fd6d-460d-8a79-be70d444d52b\") " pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:31.793851 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:31.793836 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"image-registry-98cd55f4d-xkw5v\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:22:32.081171 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.081081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xd9lg\"" Jun 09 00:22:32.081171 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.081081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfdgk\"" Jun 09 00:22:32.088651 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.088628 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:22:32.088743 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.088729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:32.222593 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.222527 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:22:32.227100 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:32.227076 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59f5dc0_7dc3_42d2_90ce_fe1c7bdae474.slice/crio-38e7a0a6b627a3ed47ab92e14a5c474ffe63fa0d5cbcf8b53ffcf0d39c9329f2 WatchSource:0}: Error finding container 38e7a0a6b627a3ed47ab92e14a5c474ffe63fa0d5cbcf8b53ffcf0d39c9329f2: Status 404 returned error can't find the container with id 38e7a0a6b627a3ed47ab92e14a5c474ffe63fa0d5cbcf8b53ffcf0d39c9329f2 Jun 09 00:22:32.235255 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.235234 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46p6k"] Jun 09 00:22:32.237476 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:32.237453 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c5627a_fd6d_460d_8a79_be70d444d52b.slice/crio-03a37a3171c79a71a16d9b9e617a2ad2b0830fbd169a43bfdcaaec6dc31e853c WatchSource:0}: Error finding container 03a37a3171c79a71a16d9b9e617a2ad2b0830fbd169a43bfdcaaec6dc31e853c: Status 404 returned error can't find the container with id 03a37a3171c79a71a16d9b9e617a2ad2b0830fbd169a43bfdcaaec6dc31e853c Jun 09 00:22:32.999321 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:32.999281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46p6k" event={"ID":"b8c5627a-fd6d-460d-8a79-be70d444d52b","Type":"ContainerStarted","Data":"03a37a3171c79a71a16d9b9e617a2ad2b0830fbd169a43bfdcaaec6dc31e853c"} Jun 09 00:22:33.001044 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:33.000991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" event={"ID":"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474","Type":"ContainerStarted","Data":"512df7cddf7a8ab2deae7c4b57415069b0b029e4de8a020eca3c5b9cdeb85166"} Jun 09 00:22:33.001155 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:33.001056 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" event={"ID":"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474","Type":"ContainerStarted","Data":"38e7a0a6b627a3ed47ab92e14a5c474ffe63fa0d5cbcf8b53ffcf0d39c9329f2"} Jun 09 00:22:33.001155 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:33.001143 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:22:33.019475 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:33.019432 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" podStartSLOduration=165.019419466 podStartE2EDuration="2m45.019419466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:33.018423645 +0000 UTC m=+165.051520431" watchObservedRunningTime="2026-06-09 00:22:33.019419466 +0000 UTC m=+165.052516227" Jun 09 00:22:35.009357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:35.009303 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46p6k" event={"ID":"b8c5627a-fd6d-460d-8a79-be70d444d52b","Type":"ContainerStarted","Data":"a7ac461acd6e81015f9b0ece9b4776b5af7bc284bac61de4b7b117f04ef0a558"} Jun 09 00:22:35.009722 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:35.009415 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46p6k" event={"ID":"b8c5627a-fd6d-460d-8a79-be70d444d52b","Type":"ContainerStarted","Data":"40e26bb55b15ca580a336a7b48bf6794af88b329f66a44d03ff30cfb9409b492"} Jun 09 00:22:35.009722 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:35.009444 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:35.025204 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:35.025159 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-46p6k" podStartSLOduration=130.019150347 podStartE2EDuration="2m12.025144145s" totalImagesPullingTime="2.005993798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:35.023572529 +0000 UTC m=+167.056669277" watchObservedRunningTime="2026-06-09 00:22:35.025144145 +0000 UTC m=+167.058240907" Jun 09 00:22:38.418548 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:38.418520 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:22:41.641833 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.641793 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wzg9l"] Jun 09 00:22:41.644905 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.644885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.647442 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.647418 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rrnb\"" Jun 09 00:22:41.647912 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.647891 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 00:22:41.648000 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.647921 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 00:22:41.654625 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.654606 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wzg9l"] Jun 09 00:22:41.752507 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.752483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27294eb4-0292-48cd-a373-b8056ce6c157-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.752610 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.752522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27294eb4-0292-48cd-a373-b8056ce6c157-crio-socket\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.752610 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.752553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27294eb4-0292-48cd-a373-b8056ce6c157-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.752724 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.752609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27294eb4-0292-48cd-a373-b8056ce6c157-data-volume\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.752724 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.752650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8q4t\" (UniqueName: \"kubernetes.io/projected/27294eb4-0292-48cd-a373-b8056ce6c157-kube-api-access-b8q4t\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.852956 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.852932 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27294eb4-0292-48cd-a373-b8056ce6c157-crio-socket\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853079 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.852991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27294eb4-0292-48cd-a373-b8056ce6c157-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853079 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27294eb4-0292-48cd-a373-b8056ce6c157-data-volume\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853208 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27294eb4-0292-48cd-a373-b8056ce6c157-crio-socket\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853208 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8q4t\" (UniqueName: \"kubernetes.io/projected/27294eb4-0292-48cd-a373-b8056ce6c157-kube-api-access-b8q4t\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853208 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27294eb4-0292-48cd-a373-b8056ce6c157-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27294eb4-0292-48cd-a373-b8056ce6c157-data-volume\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.853629 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.853607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27294eb4-0292-48cd-a373-b8056ce6c157-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.855324 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.855308 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27294eb4-0292-48cd-a373-b8056ce6c157-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.862196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.862177 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8q4t\" (UniqueName: \"kubernetes.io/projected/27294eb4-0292-48cd-a373-b8056ce6c157-kube-api-access-b8q4t\") pod \"insights-runtime-extractor-wzg9l\" (UID: \"27294eb4-0292-48cd-a373-b8056ce6c157\") " pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:41.953780 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:41.953731 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wzg9l" Jun 09 00:22:42.073702 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:42.073602 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wzg9l"] Jun 09 00:22:42.076359 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:42.076331 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27294eb4_0292_48cd_a373_b8056ce6c157.slice/crio-31144f50d1a3ccd6025bb4a1bf4664cd6e7d0f4b51a51060100a64e24c206295 WatchSource:0}: Error finding container 31144f50d1a3ccd6025bb4a1bf4664cd6e7d0f4b51a51060100a64e24c206295: Status 404 returned error can't find the container with id 31144f50d1a3ccd6025bb4a1bf4664cd6e7d0f4b51a51060100a64e24c206295 Jun 09 00:22:43.036251 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:43.036189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzg9l" event={"ID":"27294eb4-0292-48cd-a373-b8056ce6c157","Type":"ContainerStarted","Data":"c33a63543d4c7444dca911207998e731e4a2efaaf484285b803706b037bd9ab8"} Jun 09 00:22:43.036251 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:43.036246 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzg9l" event={"ID":"27294eb4-0292-48cd-a373-b8056ce6c157","Type":"ContainerStarted","Data":"d17922ee94886630b7c0480e1a4eae4d390170174057b6bb2ab5f9a13759a45c"} Jun 09 00:22:43.036577 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:43.036268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzg9l" event={"ID":"27294eb4-0292-48cd-a373-b8056ce6c157","Type":"ContainerStarted","Data":"31144f50d1a3ccd6025bb4a1bf4664cd6e7d0f4b51a51060100a64e24c206295"} Jun 09 00:22:45.014558 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:45.014524 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-46p6k" Jun 09 00:22:45.046092 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:45.046061 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzg9l" event={"ID":"27294eb4-0292-48cd-a373-b8056ce6c157","Type":"ContainerStarted","Data":"66ad73fea32d1b65354b8c380fcf82ec4f174463a22e8487d2254bd84848f9c7"} Jun 09 00:22:45.061909 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:45.061867 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wzg9l" podStartSLOduration=1.886171585 podStartE2EDuration="4.061853419s" totalImagesPullingTime="2.175681834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:22:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:45.061154476 +0000 UTC m=+177.094251239" watchObservedRunningTime="2026-06-09 00:22:45.061853419 +0000 UTC m=+177.094950187" Jun 09 00:22:48.633572 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.633530 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7j7h4"] Jun 09 00:22:48.637174 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.637154 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.639291 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.639267 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 00:22:48.639541 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.639522 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 00:22:48.640147 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.640127 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 00:22:48.640265 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.640183 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 00:22:48.640265 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.640188 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 00:22:48.640265 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.640246 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 00:22:48.640433 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.640338 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-htc22\"" Jun 09 00:22:48.702039 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-sys\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-root\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-textfile\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-metrics-client-ca\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702309 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702309 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702309 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-wtmp\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702456 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-accelerators-collector-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.702456 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.702401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtkz\" (UniqueName: \"kubernetes.io/projected/48e1705d-da49-42e6-8feb-7654e7329553-kube-api-access-cbtkz\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtkz\" (UniqueName: \"kubernetes.io/projected/48e1705d-da49-42e6-8feb-7654e7329553-kube-api-access-cbtkz\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-sys\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-root\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-textfile\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-metrics-client-ca\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-sys\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803421 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803411 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-root\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803738 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803515 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803738 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-wtmp\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803738 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-accelerators-collector-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803868 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-wtmp\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.803868 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:22:48.803797 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 00:22:48.803868 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.803846 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-textfile\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.804018 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:22:48.803891 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls podName:48e1705d-da49-42e6-8feb-7654e7329553 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:49.303870716 +0000 UTC m=+181.336967482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls") pod "node-exporter-7j7h4" (UID: "48e1705d-da49-42e6-8feb-7654e7329553") : secret "node-exporter-tls" not found Jun 09 00:22:48.804212 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.804193 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-accelerators-collector-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.804270 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.804192 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e1705d-da49-42e6-8feb-7654e7329553-metrics-client-ca\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.805604 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.805587 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:48.811310 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:48.811291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtkz\" (UniqueName: \"kubernetes.io/projected/48e1705d-da49-42e6-8feb-7654e7329553-kube-api-access-cbtkz\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:49.307439 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:49.307399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:49.309762 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:49.309743 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e1705d-da49-42e6-8feb-7654e7329553-node-exporter-tls\") pod \"node-exporter-7j7h4\" (UID: \"48e1705d-da49-42e6-8feb-7654e7329553\") " pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:49.546938 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:49.546910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7j7h4" Jun 09 00:22:49.556507 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:22:49.556481 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e1705d_da49_42e6_8feb_7654e7329553.slice/crio-aa725017ef3ed1e5a1cd1444093ad0453e64de93923c0d24a5561d2a52214094 WatchSource:0}: Error finding container aa725017ef3ed1e5a1cd1444093ad0453e64de93923c0d24a5561d2a52214094: Status 404 returned error can't find the container with id aa725017ef3ed1e5a1cd1444093ad0453e64de93923c0d24a5561d2a52214094 Jun 09 00:22:50.063395 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:50.063353 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7j7h4" event={"ID":"48e1705d-da49-42e6-8feb-7654e7329553","Type":"ContainerStarted","Data":"aa725017ef3ed1e5a1cd1444093ad0453e64de93923c0d24a5561d2a52214094"} Jun 09 00:22:51.068323 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:51.068295 2557 generic.go:356] "Generic (PLEG): container finished" podID="48e1705d-da49-42e6-8feb-7654e7329553" containerID="f42d6b8f9924de72472919d38cbd75a60f23e1f37efd15055fdb22c8706d2cbf" exitCode=0 Jun 09 00:22:51.068727 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:51.068371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7j7h4" event={"ID":"48e1705d-da49-42e6-8feb-7654e7329553","Type":"ContainerDied","Data":"f42d6b8f9924de72472919d38cbd75a60f23e1f37efd15055fdb22c8706d2cbf"} Jun 09 00:22:52.073697 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:52.073663 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7j7h4" event={"ID":"48e1705d-da49-42e6-8feb-7654e7329553","Type":"ContainerStarted","Data":"f59f13559c26d2307034681d0586cf86c2b22026cc03510af6b4d276399f3ec9"} Jun 09 00:22:52.074058 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:52.073716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7j7h4" event={"ID":"48e1705d-da49-42e6-8feb-7654e7329553","Type":"ContainerStarted","Data":"47c95cab0da2c528102ee2cd660cb704623de7e74d9b982da989084f0b25e3b9"} Jun 09 00:22:52.092734 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:52.092684 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7j7h4" podStartSLOduration=3.23061999 podStartE2EDuration="4.092669185s" totalImagesPullingTime="800.548453ms" totalInitContainerRuntime="61.500742ms" isStatefulPod=true podCreationTimestamp="2026-06-09 00:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:52.09146346 +0000 UTC m=+184.124560223" watchObservedRunningTime="2026-06-09 00:22:52.092669185 +0000 UTC m=+184.125765947" Jun 09 00:22:52.093379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:52.093356 2557 patch_prober.go:28] interesting pod/image-registry-98cd55f4d-xkw5v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:22:52.093466 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:52.093403 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:22:54.009230 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:22:54.009197 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:23:03.112820 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.112788 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:23:03.114769 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.114753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.116800 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.116771 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 00:23:03.116800 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.116773 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:23:03.117503 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.117484 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 00:23:03.117607 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.117511 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 00:23:03.117691 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.117656 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:23:03.117691 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.117664 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 00:23:03.118295 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.118273 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ltrfd\"" Jun 09 00:23:03.118411 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.118394 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 00:23:03.121792 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.121774 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 00:23:03.126800 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.126780 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:23:03.206305 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206387 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206387 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206387 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206481 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmjpw\" (UniqueName: \"kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206481 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206456 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.206544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.206491 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.306995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.306993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmjpw\" (UniqueName: \"kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.307266 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.307043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.307678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.307622 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.307750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.307676 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.307750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.307735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.307981 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.307958 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.309470 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.309445 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.309562 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.309485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.317417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.317394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmjpw\" (UniqueName: \"kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw\") pod \"console-cf49b5895-46d6g\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.424299 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.424249 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:03.541533 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.541513 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:23:03.543711 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:23:03.543688 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c46eea_9730_4354_bc49_42d7b73f6093.slice/crio-011ca354272850950a619e5a819574905cdacf94b707e2900df73bfc72030870 WatchSource:0}: Error finding container 011ca354272850950a619e5a819574905cdacf94b707e2900df73bfc72030870: Status 404 returned error can't find the container with id 011ca354272850950a619e5a819574905cdacf94b707e2900df73bfc72030870 Jun 09 00:23:03.981302 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:03.981274 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:23:04.113257 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:04.113225 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49b5895-46d6g" event={"ID":"92c46eea-9730-4354-bc49-42d7b73f6093","Type":"ContainerStarted","Data":"011ca354272850950a619e5a819574905cdacf94b707e2900df73bfc72030870"} Jun 09 00:23:08.128939 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:08.128903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49b5895-46d6g" event={"ID":"92c46eea-9730-4354-bc49-42d7b73f6093","Type":"ContainerStarted","Data":"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d"} Jun 09 00:23:08.147995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:08.147950 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf49b5895-46d6g" podStartSLOduration=1.320472659 podStartE2EDuration="5.147935133s" totalImagesPullingTime="3.827462474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:23:08.14650116 +0000 UTC m=+200.179597948" watchObservedRunningTime="2026-06-09 00:23:08.147935133 +0000 UTC m=+200.181031896" Jun 09 00:23:13.424526 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:13.424498 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:13.424896 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:13.424552 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:13.428950 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:13.428920 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:14.150295 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:14.150270 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:23:25.182500 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:25.182469 2557 generic.go:356] "Generic (PLEG): container finished" podID="553f3c5f-1187-4a71-9943-26484a044a3e" containerID="c475e438ad75984f98e365f7ab64009fd279c5f9c7e0b358241dab7382eef0de" exitCode=0 Jun 09 00:23:25.182839 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:25.182521 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7snmp" event={"ID":"553f3c5f-1187-4a71-9943-26484a044a3e","Type":"ContainerDied","Data":"c475e438ad75984f98e365f7ab64009fd279c5f9c7e0b358241dab7382eef0de"} Jun 09 00:23:25.182839 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:25.182806 2557 scope.go:117] "RemoveContainer" containerID="c475e438ad75984f98e365f7ab64009fd279c5f9c7e0b358241dab7382eef0de" Jun 09 00:23:26.187775 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:26.187743 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7snmp" event={"ID":"553f3c5f-1187-4a71-9943-26484a044a3e","Type":"ContainerStarted","Data":"4445d955f900439b06d9b0aed5362924b66c1204a2dd1bc4716961cac5734792"} Jun 09 00:23:29.004320 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.004220 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerName="registry" containerID="cri-o://512df7cddf7a8ab2deae7c4b57415069b0b029e4de8a020eca3c5b9cdeb85166" gracePeriod=30 Jun 09 00:23:29.200308 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.200275 2557 generic.go:356] "Generic (PLEG): container finished" podID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerID="512df7cddf7a8ab2deae7c4b57415069b0b029e4de8a020eca3c5b9cdeb85166" exitCode=0 Jun 09 00:23:29.200431 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.200347 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" event={"ID":"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474","Type":"ContainerDied","Data":"512df7cddf7a8ab2deae7c4b57415069b0b029e4de8a020eca3c5b9cdeb85166"} Jun 09 00:23:29.238935 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.238916 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:23:29.380882 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380854 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381002 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380890 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381002 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380910 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381002 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380928 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs2pz\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381002 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380946 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381002 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.380972 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.381014 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.381065 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration\") pod \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\" (UID: \"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474\") " Jun 09 00:23:29.381672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.381447 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:29.381672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.381490 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:29.383757 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.383728 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:29.383860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.383734 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:29.383860 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.383841 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:29.383967 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.383882 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz" (OuterVolumeSpecName: "kube-api-access-cs2pz") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "kube-api-access-cs2pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:29.383967 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.383914 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:29.392605 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.392575 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" (UID: "a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:23:29.482438 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482416 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs2pz\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-kube-api-access-cs2pz\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482438 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482436 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-certificates\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482445 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-trusted-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482454 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-installation-pull-secrets\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482464 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-image-registry-private-configuration\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482472 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-registry-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482480 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-bound-sa-token\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:29.482544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:29.482488 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474-ca-trust-extracted\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:23:30.204709 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.204678 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" Jun 09 00:23:30.205161 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.204679 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98cd55f4d-xkw5v" event={"ID":"a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474","Type":"ContainerDied","Data":"38e7a0a6b627a3ed47ab92e14a5c474ffe63fa0d5cbcf8b53ffcf0d39c9329f2"} Jun 09 00:23:30.205161 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.204808 2557 scope.go:117] "RemoveContainer" containerID="512df7cddf7a8ab2deae7c4b57415069b0b029e4de8a020eca3c5b9cdeb85166" Jun 09 00:23:30.223740 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.223718 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:23:30.227338 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.227317 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-98cd55f4d-xkw5v"] Jun 09 00:23:30.418793 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:30.418768 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" path="/var/lib/kubelet/pods/a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474/volumes" Jun 09 00:23:32.940192 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:32.940160 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" podUID="e615d96e-9c9c-448c-900d-96756b534fe3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:23:42.940890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:42.940848 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" podUID="e615d96e-9c9c-448c-900d-96756b534fe3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:23:52.940387 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:52.940349 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" podUID="e615d96e-9c9c-448c-900d-96756b534fe3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:23:52.940861 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:52.940437 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" Jun 09 00:23:52.941075 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:52.941017 2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2a982db6f3d78c21835886593229821fd72d1c01e997cd12094d3412f38cf5d2"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 00:23:52.941166 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:52.941107 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" podUID="e615d96e-9c9c-448c-900d-96756b534fe3" containerName="service-proxy" containerID="cri-o://2a982db6f3d78c21835886593229821fd72d1c01e997cd12094d3412f38cf5d2" gracePeriod=30 Jun 09 00:23:53.283582 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:53.283501 2557 generic.go:356] "Generic (PLEG): container finished" podID="e615d96e-9c9c-448c-900d-96756b534fe3" containerID="2a982db6f3d78c21835886593229821fd72d1c01e997cd12094d3412f38cf5d2" exitCode=2 Jun 09 00:23:53.283707 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:53.283582 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerDied","Data":"2a982db6f3d78c21835886593229821fd72d1c01e997cd12094d3412f38cf5d2"} Jun 09 00:23:53.283707 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:53.283627 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fc88898f9-xhkmj" event={"ID":"e615d96e-9c9c-448c-900d-96756b534fe3","Type":"ContainerStarted","Data":"2cf9031ad59f1fd83e0901a79e8396e85863f2bce9627e958a439970442ed4fb"} Jun 09 00:23:59.297285 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:59.297200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:23:59.299394 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:59.299374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5708cea-7f0f-4176-947d-721399db9e83-metrics-certs\") pod \"network-metrics-daemon-nxsfk\" (UID: \"f5708cea-7f0f-4176-947d-721399db9e83\") " pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:23:59.421336 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:59.421306 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f26v2\"" Jun 09 00:23:59.429479 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:59.429457 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxsfk" Jun 09 00:23:59.547550 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:23:59.547489 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxsfk"] Jun 09 00:23:59.550515 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:23:59.550489 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5708cea_7f0f_4176_947d_721399db9e83.slice/crio-a2c7b9af4d899b89233c046627b39f1b5a91a8fb6b4c3e52f689ce26fb5592c9 WatchSource:0}: Error finding container a2c7b9af4d899b89233c046627b39f1b5a91a8fb6b4c3e52f689ce26fb5592c9: Status 404 returned error can't find the container with id a2c7b9af4d899b89233c046627b39f1b5a91a8fb6b4c3e52f689ce26fb5592c9 Jun 09 00:24:00.309425 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:00.309389 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxsfk" event={"ID":"f5708cea-7f0f-4176-947d-721399db9e83","Type":"ContainerStarted","Data":"a2c7b9af4d899b89233c046627b39f1b5a91a8fb6b4c3e52f689ce26fb5592c9"} Jun 09 00:24:01.314892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:01.314857 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxsfk" event={"ID":"f5708cea-7f0f-4176-947d-721399db9e83","Type":"ContainerStarted","Data":"00574c16685c30d7df141b96d3198cb18b529808b1cf967ab8d975e3ff1751f2"} Jun 09 00:24:01.315290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:01.314917 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxsfk" event={"ID":"f5708cea-7f0f-4176-947d-721399db9e83","Type":"ContainerStarted","Data":"b69af5e8a0309e28feea8e977076cb269570c336e66f638fc26bffc2f9cc1308"} Jun 09 00:24:01.329637 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:01.329590 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxsfk" podStartSLOduration=252.204237154 podStartE2EDuration="4m13.329578044s" totalImagesPullingTime="1.12534089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:24:01.329346959 +0000 UTC m=+253.362443722" watchObservedRunningTime="2026-06-09 00:24:01.329578044 +0000 UTC m=+253.362674783" Jun 09 00:24:34.485858 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:34.485825 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:24:48.358391 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:48.358354 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:24:48.360759 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:48.360732 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:24:48.361993 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:48.361968 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 00:24:59.505316 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.505275 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cf49b5895-46d6g" podUID="92c46eea-9730-4354-bc49-42d7b73f6093" containerName="console" containerID="cri-o://c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d" gracePeriod=15 Jun 09 00:24:59.735725 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.735704 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:24:59.797315 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797262 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797315 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797296 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797329 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797347 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797372 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797397 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmjpw\" (UniqueName: \"kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.797443 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797414 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert\") pod \"92c46eea-9730-4354-bc49-42d7b73f6093\" (UID: \"92c46eea-9730-4354-bc49-42d7b73f6093\") " Jun 09 00:24:59.798053 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.797979 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config" (OuterVolumeSpecName: "console-config") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:59.798158 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.798089 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca" (OuterVolumeSpecName: "service-ca") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:59.798219 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.798189 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:59.798278 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.798241 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:59.803064 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.801438 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:59.803064 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.801644 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:59.803429 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.803328 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw" (OuterVolumeSpecName: "kube-api-access-pmjpw") pod "92c46eea-9730-4354-bc49-42d7b73f6093" (UID: "92c46eea-9730-4354-bc49-42d7b73f6093"). InnerVolumeSpecName "kube-api-access-pmjpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:24:59.899076 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899054 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmjpw\" (UniqueName: \"kubernetes.io/projected/92c46eea-9730-4354-bc49-42d7b73f6093-kube-api-access-pmjpw\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899076 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899074 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-oauth-serving-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899084 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-serving-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899092 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899101 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-console-config\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899108 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92c46eea-9730-4354-bc49-42d7b73f6093-console-oauth-config\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:24:59.899196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:24:59.899115 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c46eea-9730-4354-bc49-42d7b73f6093-trusted-ca-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:25:00.519335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.519303 2557 generic.go:356] "Generic (PLEG): container finished" podID="92c46eea-9730-4354-bc49-42d7b73f6093" containerID="c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d" exitCode=0 Jun 09 00:25:00.519628 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.519351 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49b5895-46d6g" event={"ID":"92c46eea-9730-4354-bc49-42d7b73f6093","Type":"ContainerDied","Data":"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d"} Jun 09 00:25:00.519628 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.519366 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf49b5895-46d6g" Jun 09 00:25:00.519628 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.519393 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf49b5895-46d6g" event={"ID":"92c46eea-9730-4354-bc49-42d7b73f6093","Type":"ContainerDied","Data":"011ca354272850950a619e5a819574905cdacf94b707e2900df73bfc72030870"} Jun 09 00:25:00.519628 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.519420 2557 scope.go:117] "RemoveContainer" containerID="c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d" Jun 09 00:25:00.527212 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.527182 2557 scope.go:117] "RemoveContainer" containerID="c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d" Jun 09 00:25:00.527472 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:25:00.527453 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d\": container with ID starting with c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d not found: ID does not exist" containerID="c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d" Jun 09 00:25:00.527515 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.527479 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d"} err="failed to get container status \"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d\": rpc error: code = NotFound desc = could not find container \"c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d\": container with ID starting with c2054367189dcb66d72a71e1ed8f968509292efae0c7a8f685b9c1e8f7a0164d not found: ID does not exist" Jun 09 00:25:00.534663 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.534642 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:25:00.538562 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:00.538539 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf49b5895-46d6g"] Jun 09 00:25:02.418132 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:02.418100 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92c46eea-9730-4354-bc49-42d7b73f6093" path="/var/lib/kubelet/pods/92c46eea-9730-4354-bc49-42d7b73f6093/volumes" Jun 09 00:25:09.198974 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.198944 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6"] Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199158 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerName="registry" Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199168 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerName="registry" Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199177 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c46eea-9730-4354-bc49-42d7b73f6093" containerName="console" Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199183 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c46eea-9730-4354-bc49-42d7b73f6093" containerName="console" Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199228 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59f5dc0-7dc3-42d2-90ce-fe1c7bdae474" containerName="registry" Jun 09 00:25:09.199417 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.199238 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c46eea-9730-4354-bc49-42d7b73f6093" containerName="console" Jun 09 00:25:09.201876 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.201860 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.204270 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.204243 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 00:25:09.204395 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.204363 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:25:09.204616 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.204600 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7x8gd\"" Jun 09 00:25:09.214479 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.214459 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6"] Jun 09 00:25:09.260181 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.260157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.260284 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.260187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44w2z\" (UniqueName: \"kubernetes.io/projected/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-kube-api-access-44w2z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.361139 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.361115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w2z\" (UniqueName: \"kubernetes.io/projected/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-kube-api-access-44w2z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.361233 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.361168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.361453 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.361439 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.376104 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.376087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44w2z\" (UniqueName: \"kubernetes.io/projected/f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8-kube-api-access-44w2z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-snxz6\" (UID: \"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.510439 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.510377 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" Jun 09 00:25:09.634995 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.634970 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6"] Jun 09 00:25:09.638550 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:25:09.638527 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f45a67_54b7_4b8b_840d_0bcbb0ba87f8.slice/crio-3360d25b9ddab81a6b0511af44d1f11208fd10a29a6fe081dac489977f2e652c WatchSource:0}: Error finding container 3360d25b9ddab81a6b0511af44d1f11208fd10a29a6fe081dac489977f2e652c: Status 404 returned error can't find the container with id 3360d25b9ddab81a6b0511af44d1f11208fd10a29a6fe081dac489977f2e652c Jun 09 00:25:09.641307 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:09.641291 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:25:10.554720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:10.554687 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" event={"ID":"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8","Type":"ContainerStarted","Data":"3360d25b9ddab81a6b0511af44d1f11208fd10a29a6fe081dac489977f2e652c"} Jun 09 00:25:12.564367 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:12.564286 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" event={"ID":"f1f45a67-54b7-4b8b-840d-0bcbb0ba87f8","Type":"ContainerStarted","Data":"6625be9694d4b221247fbe4a045d344b96398c133a60b13a35d8a8dfbf0c0e5c"} Jun 09 00:25:12.584098 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:12.584017 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-snxz6" podStartSLOduration=0.930699127 podStartE2EDuration="3.584002527s" totalImagesPullingTime="2.6533034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:25:12.583415931 +0000 UTC m=+324.616512693" watchObservedRunningTime="2026-06-09 00:25:12.584002527 +0000 UTC m=+324.617099288" Jun 09 00:25:15.222283 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.222253 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk"] Jun 09 00:25:15.224579 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.224564 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.226779 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.226754 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:25:15.227304 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.227285 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:25:15.227414 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.227300 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:25:15.232534 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.232514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk"] Jun 09 00:25:15.303498 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.303460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.303670 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.303523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.303670 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.303554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5dch\" (UniqueName: \"kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.403924 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.403880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.403924 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.403926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5dch\" (UniqueName: \"kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.404156 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.403958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.404326 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.404311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.404366 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.404344 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.416765 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.416741 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5dch\" (UniqueName: \"kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.533947 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.533844 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:15.658139 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:15.658117 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk"] Jun 09 00:25:15.660722 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:25:15.660695 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b2e41e_7cf7_4338_9572_d76730ad0815.slice/crio-6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2 WatchSource:0}: Error finding container 6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2: Status 404 returned error can't find the container with id 6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2 Jun 09 00:25:16.580701 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:16.580657 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" event={"ID":"92b2e41e-7cf7-4338-9572-d76730ad0815","Type":"ContainerStarted","Data":"6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2"} Jun 09 00:25:24.275348 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.275319 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-7fj2v"] Jun 09 00:25:24.277501 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.277485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.279419 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.279396 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 00:25:24.279504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.279479 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 00:25:24.279546 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.279500 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ws4qg\"" Jun 09 00:25:24.288983 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.288953 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-7fj2v"] Jun 09 00:25:24.374458 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.374435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrlfr\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-kube-api-access-lrlfr\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.374544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.374471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-bound-sa-token\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.475068 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.475040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrlfr\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-kube-api-access-lrlfr\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.475156 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.475099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-bound-sa-token\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.482358 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.482335 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-bound-sa-token\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.482441 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.482381 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrlfr\" (UniqueName: \"kubernetes.io/projected/3ae1f3f4-e472-4412-89b1-930476e38e9c-kube-api-access-lrlfr\") pod \"cert-manager-59c77684cc-7fj2v\" (UID: \"3ae1f3f4-e472-4412-89b1-930476e38e9c\") " pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.586213 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.586151 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-7fj2v" Jun 09 00:25:24.609489 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.609461 2557 generic.go:356] "Generic (PLEG): container finished" podID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerID="4488c368d4ea2f5ac8df23d9f6b90644946ab765d746276c7f325591bacad1fc" exitCode=0 Jun 09 00:25:24.609597 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.609501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" event={"ID":"92b2e41e-7cf7-4338-9572-d76730ad0815","Type":"ContainerDied","Data":"4488c368d4ea2f5ac8df23d9f6b90644946ab765d746276c7f325591bacad1fc"} Jun 09 00:25:24.712222 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:24.711935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-7fj2v"] Jun 09 00:25:24.714329 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:25:24.714305 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ae1f3f4_e472_4412_89b1_930476e38e9c.slice/crio-2d6ac9ba3a6950d70de2f40d28295a2c07e9eb7a70c7fda41d9a36ef9b6e8194 WatchSource:0}: Error finding container 2d6ac9ba3a6950d70de2f40d28295a2c07e9eb7a70c7fda41d9a36ef9b6e8194: Status 404 returned error can't find the container with id 2d6ac9ba3a6950d70de2f40d28295a2c07e9eb7a70c7fda41d9a36ef9b6e8194 Jun 09 00:25:25.615334 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:25.615298 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-7fj2v" event={"ID":"3ae1f3f4-e472-4412-89b1-930476e38e9c","Type":"ContainerStarted","Data":"2d6ac9ba3a6950d70de2f40d28295a2c07e9eb7a70c7fda41d9a36ef9b6e8194"} Jun 09 00:25:28.626471 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:28.626440 2557 generic.go:356] "Generic (PLEG): container finished" podID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerID="71073ae87540839cfe381d4995ec4d3fb4bf5b49cb4a9c98114b40be805d6d30" exitCode=0 Jun 09 00:25:28.626783 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:28.626524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" event={"ID":"92b2e41e-7cf7-4338-9572-d76730ad0815","Type":"ContainerDied","Data":"71073ae87540839cfe381d4995ec4d3fb4bf5b49cb4a9c98114b40be805d6d30"} Jun 09 00:25:28.628046 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:28.628007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-7fj2v" event={"ID":"3ae1f3f4-e472-4412-89b1-930476e38e9c","Type":"ContainerStarted","Data":"299c5cce4c888bca33d601675d01cb26f527c5c02347ab9ffdc70c12dbe3214c"} Jun 09 00:25:28.656142 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:28.656100 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-7fj2v" podStartSLOduration=1.5046712439999999 podStartE2EDuration="4.656085988s" totalImagesPullingTime="3.151414744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:25:28.65467028 +0000 UTC m=+340.687767041" watchObservedRunningTime="2026-06-09 00:25:28.656085988 +0000 UTC m=+340.689182750" Jun 09 00:25:35.655327 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:35.655240 2557 generic.go:356] "Generic (PLEG): container finished" podID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerID="0c59b1492a6b50b52c21f23ebd70d7f44bcf8d1afa43eccb286b7bf8e8e810f7" exitCode=0 Jun 09 00:25:35.655691 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:35.655323 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" event={"ID":"92b2e41e-7cf7-4338-9572-d76730ad0815","Type":"ContainerDied","Data":"0c59b1492a6b50b52c21f23ebd70d7f44bcf8d1afa43eccb286b7bf8e8e810f7"} Jun 09 00:25:36.798887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.798861 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:36.962496 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.962427 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle\") pod \"92b2e41e-7cf7-4338-9572-d76730ad0815\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " Jun 09 00:25:36.962631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.962497 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5dch\" (UniqueName: \"kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch\") pod \"92b2e41e-7cf7-4338-9572-d76730ad0815\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " Jun 09 00:25:36.962631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.962546 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util\") pod \"92b2e41e-7cf7-4338-9572-d76730ad0815\" (UID: \"92b2e41e-7cf7-4338-9572-d76730ad0815\") " Jun 09 00:25:36.962809 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.962787 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle" (OuterVolumeSpecName: "bundle") pod "92b2e41e-7cf7-4338-9572-d76730ad0815" (UID: "92b2e41e-7cf7-4338-9572-d76730ad0815"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:36.964564 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.964540 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch" (OuterVolumeSpecName: "kube-api-access-k5dch") pod "92b2e41e-7cf7-4338-9572-d76730ad0815" (UID: "92b2e41e-7cf7-4338-9572-d76730ad0815"). InnerVolumeSpecName "kube-api-access-k5dch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:25:36.967085 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:36.967065 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util" (OuterVolumeSpecName: "util") pod "92b2e41e-7cf7-4338-9572-d76730ad0815" (UID: "92b2e41e-7cf7-4338-9572-d76730ad0815"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:37.064084 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.064060 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:25:37.064084 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.064082 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5dch\" (UniqueName: \"kubernetes.io/projected/92b2e41e-7cf7-4338-9572-d76730ad0815-kube-api-access-k5dch\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:25:37.064215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.064092 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92b2e41e-7cf7-4338-9572-d76730ad0815-util\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:25:37.663796 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.663757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" event={"ID":"92b2e41e-7cf7-4338-9572-d76730ad0815","Type":"ContainerDied","Data":"6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2"} Jun 09 00:25:37.663966 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.663809 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6wwpk" Jun 09 00:25:37.663966 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:37.663817 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d88639b26de7f76370f16bd6f7ec8783693f3ef52490c9f5b842160fb54a0d2" Jun 09 00:25:44.237128 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237084 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz"] Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237359 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="pull" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237372 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="pull" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237379 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="extract" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237386 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="extract" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237399 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="util" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237405 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="util" Jun 09 00:25:44.237667 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.237460 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b2e41e-7cf7-4338-9572-d76730ad0815" containerName="extract" Jun 09 00:25:44.240378 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.240356 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.242455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.242424 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 00:25:44.242455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.242446 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:25:44.243239 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.243210 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f5zrv\"" Jun 09 00:25:44.248498 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.248472 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz"] Jun 09 00:25:44.411620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.411595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmvn\" (UniqueName: \"kubernetes.io/projected/9bd4642a-9761-488b-977e-c7fe40142a85-kube-api-access-9jmvn\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.411742 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.411626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd4642a-9761-488b-977e-c7fe40142a85-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.512869 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.512808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmvn\" (UniqueName: \"kubernetes.io/projected/9bd4642a-9761-488b-977e-c7fe40142a85-kube-api-access-9jmvn\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.512869 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.512839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd4642a-9761-488b-977e-c7fe40142a85-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.513200 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.513184 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd4642a-9761-488b-977e-c7fe40142a85-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.519892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.519875 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmvn\" (UniqueName: \"kubernetes.io/projected/9bd4642a-9761-488b-977e-c7fe40142a85-kube-api-access-9jmvn\") pod \"openshift-lws-operator-fd8ccff4c-gjqkz\" (UID: \"9bd4642a-9761-488b-977e-c7fe40142a85\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.550795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.550772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" Jun 09 00:25:44.686423 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:44.686258 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz"] Jun 09 00:25:44.689263 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:25:44.689236 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bd4642a_9761_488b_977e_c7fe40142a85.slice/crio-c64e3d6280d27cc3cedd0a5895f2c1c0c147a1e09081c85c13ea147adda8a670 WatchSource:0}: Error finding container c64e3d6280d27cc3cedd0a5895f2c1c0c147a1e09081c85c13ea147adda8a670: Status 404 returned error can't find the container with id c64e3d6280d27cc3cedd0a5895f2c1c0c147a1e09081c85c13ea147adda8a670 Jun 09 00:25:45.694943 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:45.694910 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" event={"ID":"9bd4642a-9761-488b-977e-c7fe40142a85","Type":"ContainerStarted","Data":"c64e3d6280d27cc3cedd0a5895f2c1c0c147a1e09081c85c13ea147adda8a670"} Jun 09 00:25:48.708317 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:48.708243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" event={"ID":"9bd4642a-9761-488b-977e-c7fe40142a85","Type":"ContainerStarted","Data":"a9f8df502b049e96a511243ddea2758fa6b2e416ec07ab44ac20763183aee70e"} Jun 09 00:25:48.724126 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:25:48.724078 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gjqkz" podStartSLOduration=1.5264529740000001 podStartE2EDuration="4.724062749s" totalImagesPullingTime="3.197609775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:25:48.722353564 +0000 UTC m=+360.755450338" watchObservedRunningTime="2026-06-09 00:25:48.724062749 +0000 UTC m=+360.757159510" Jun 09 00:26:03.734213 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.734168 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc"] Jun 09 00:26:03.737947 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.737920 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.740371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.740187 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 00:26:03.740371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.740244 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 00:26:03.740371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.740265 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 00:26:03.740371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.740269 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 00:26:03.740371 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.740281 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qtb8w\"" Jun 09 00:26:03.746415 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.746389 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.746502 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.746426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.746502 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.746443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j2jm\" (UniqueName: \"kubernetes.io/projected/17a3e53a-198e-479b-acc4-43702f32b59b-kube-api-access-4j2jm\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.746587 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.746504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.746587 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.746548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.749116 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.749096 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc"] Jun 09 00:26:03.847433 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.847551 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.847551 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.847551 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j2jm\" (UniqueName: \"kubernetes.io/projected/17a3e53a-198e-479b-acc4-43702f32b59b-kube-api-access-4j2jm\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.847551 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.847868 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.847847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.849857 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.849837 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a3e53a-198e-479b-acc4-43702f32b59b-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.849948 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.849921 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.850001 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.849975 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a3e53a-198e-479b-acc4-43702f32b59b-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:03.857578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:03.857552 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j2jm\" (UniqueName: \"kubernetes.io/projected/17a3e53a-198e-479b-acc4-43702f32b59b-kube-api-access-4j2jm\") pod \"opendatahub-operator-controller-manager-cffbb876-45sjc\" (UID: \"17a3e53a-198e-479b-acc4-43702f32b59b\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:04.048336 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:04.048285 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:04.177220 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:04.177192 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc"] Jun 09 00:26:04.181122 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:04.181091 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a3e53a_198e_479b_acc4_43702f32b59b.slice/crio-d74e543682182c60727866274ab4ca299247d6d02c6d3d9573c2e92a8152d662 WatchSource:0}: Error finding container d74e543682182c60727866274ab4ca299247d6d02c6d3d9573c2e92a8152d662: Status 404 returned error can't find the container with id d74e543682182c60727866274ab4ca299247d6d02c6d3d9573c2e92a8152d662 Jun 09 00:26:04.772159 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:04.772121 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" event={"ID":"17a3e53a-198e-479b-acc4-43702f32b59b","Type":"ContainerStarted","Data":"d74e543682182c60727866274ab4ca299247d6d02c6d3d9573c2e92a8152d662"} Jun 09 00:26:07.789532 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:07.789498 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" event={"ID":"17a3e53a-198e-479b-acc4-43702f32b59b","Type":"ContainerStarted","Data":"4d84079675073fbf816c9917f56434eb1c622c579f3792d7b53774ea53362cd1"} Jun 09 00:26:08.794609 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:08.794578 2557 generic.go:356] "Generic (PLEG): container finished" podID="17a3e53a-198e-479b-acc4-43702f32b59b" containerID="4d84079675073fbf816c9917f56434eb1c622c579f3792d7b53774ea53362cd1" exitCode=0 Jun 09 00:26:08.794943 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:08.794649 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" event={"ID":"17a3e53a-198e-479b-acc4-43702f32b59b","Type":"ContainerDied","Data":"4d84079675073fbf816c9917f56434eb1c622c579f3792d7b53774ea53362cd1"} Jun 09 00:26:09.800127 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:09.800096 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" event={"ID":"17a3e53a-198e-479b-acc4-43702f32b59b","Type":"ContainerStarted","Data":"3ad01501d8180cbce13a891c1d346aed1ad2647c5dc07412126e8f7cbc2ff824"} Jun 09 00:26:09.800536 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:09.800218 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:09.822112 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:09.822068 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" podStartSLOduration=2.375650169 podStartE2EDuration="6.822056631s" totalImagesPullingTime="3.513158586s" totalInitContainerRuntime="933.247876ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:09.820908109 +0000 UTC m=+381.854004871" watchObservedRunningTime="2026-06-09 00:26:09.822056631 +0000 UTC m=+381.855153393" Jun 09 00:26:20.805913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:20.805877 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-45sjc" Jun 09 00:26:23.483672 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.483635 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn"] Jun 09 00:26:23.488722 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.488705 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.491402 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.491381 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 00:26:23.491503 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.491424 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 00:26:23.492102 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.492082 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dwl7f\"" Jun 09 00:26:23.492153 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.492090 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 00:26:23.492354 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.492335 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 00:26:23.497909 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.497891 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn"] Jun 09 00:26:23.542413 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.542387 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-sfd9r"] Jun 09 00:26:23.544403 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.544387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.546621 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.546605 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f2v8h\"" Jun 09 00:26:23.546720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.546648 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 00:26:23.555647 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.555626 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-sfd9r"] Jun 09 00:26:23.585671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.585647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-cert\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.585767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.585679 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfrj\" (UniqueName: \"kubernetes.io/projected/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-kube-api-access-4pfrj\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.585767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.585699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnqk6\" (UniqueName: \"kubernetes.io/projected/f7c83cae-d340-4cec-9d70-0862b63ff099-kube-api-access-cnqk6\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.585767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.585735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c83cae-d340-4cec-9d70-0862b63ff099-tmp\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.585887 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.585786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c83cae-d340-4cec-9d70-0862b63ff099-tls-certs\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.686915 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.686894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c83cae-d340-4cec-9d70-0862b63ff099-tls-certs\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.687012 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.686942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-cert\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.687012 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.686958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfrj\" (UniqueName: \"kubernetes.io/projected/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-kube-api-access-4pfrj\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.687012 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.686978 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnqk6\" (UniqueName: \"kubernetes.io/projected/f7c83cae-d340-4cec-9d70-0862b63ff099-kube-api-access-cnqk6\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.687176 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.687010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c83cae-d340-4cec-9d70-0862b63ff099-tmp\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.689299 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.689269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c83cae-d340-4cec-9d70-0862b63ff099-tmp\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.689413 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.689376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c83cae-d340-4cec-9d70-0862b63ff099-tls-certs\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.689531 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.689510 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-cert\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.696295 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.696273 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnqk6\" (UniqueName: \"kubernetes.io/projected/f7c83cae-d340-4cec-9d70-0862b63ff099-kube-api-access-cnqk6\") pod \"kube-auth-proxy-56cb979fbc-s5dkn\" (UID: \"f7c83cae-d340-4cec-9d70-0862b63ff099\") " pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.704684 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.704664 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfrj\" (UniqueName: \"kubernetes.io/projected/ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836-kube-api-access-4pfrj\") pod \"odh-model-controller-6dc94f689f-sfd9r\" (UID: \"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836\") " pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.797977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.797918 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" Jun 09 00:26:23.853405 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.853371 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:23.922913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.922884 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn"] Jun 09 00:26:23.927064 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:23.927040 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c83cae_d340_4cec_9d70_0862b63ff099.slice/crio-60d288670435393bdeb15f2db8ed9d7c2aa62a2e7285cc18ba6bc8afe456a143 WatchSource:0}: Error finding container 60d288670435393bdeb15f2db8ed9d7c2aa62a2e7285cc18ba6bc8afe456a143: Status 404 returned error can't find the container with id 60d288670435393bdeb15f2db8ed9d7c2aa62a2e7285cc18ba6bc8afe456a143 Jun 09 00:26:23.982823 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:23.982803 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-sfd9r"] Jun 09 00:26:23.985130 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:23.985107 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1fe3f7_e5d2_43a9_8383_cc20ebbe3836.slice/crio-70ecbe8b2ca15aace34741d46c1938ab6bfa3a37cb4252db99211224f051caa8 WatchSource:0}: Error finding container 70ecbe8b2ca15aace34741d46c1938ab6bfa3a37cb4252db99211224f051caa8: Status 404 returned error can't find the container with id 70ecbe8b2ca15aace34741d46c1938ab6bfa3a37cb4252db99211224f051caa8 Jun 09 00:26:24.168200 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.168168 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b4cg8"] Jun 09 00:26:24.171103 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.171088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.173160 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.173138 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 00:26:24.173160 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.173152 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-w4jcw\"" Jun 09 00:26:24.180187 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.180167 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b4cg8"] Jun 09 00:26:24.292032 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.292006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62k6\" (UniqueName: \"kubernetes.io/projected/530c7e52-2172-4001-9508-39b8fe5d4a82-kube-api-access-f62k6\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.292116 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.292057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530c7e52-2172-4001-9508-39b8fe5d4a82-tls-certs\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.393419 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.393389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62k6\" (UniqueName: \"kubernetes.io/projected/530c7e52-2172-4001-9508-39b8fe5d4a82-kube-api-access-f62k6\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.393556 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.393425 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530c7e52-2172-4001-9508-39b8fe5d4a82-tls-certs\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.395964 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.395942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530c7e52-2172-4001-9508-39b8fe5d4a82-tls-certs\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.400826 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.400808 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62k6\" (UniqueName: \"kubernetes.io/projected/530c7e52-2172-4001-9508-39b8fe5d4a82-kube-api-access-f62k6\") pod \"model-serving-api-5dd488fc48-b4cg8\" (UID: \"530c7e52-2172-4001-9508-39b8fe5d4a82\") " pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.481272 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.481219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:24.603389 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.603361 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b4cg8"] Jun 09 00:26:24.606092 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:24.606065 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530c7e52_2172_4001_9508_39b8fe5d4a82.slice/crio-b8ae2c9eee5751b0bc5037674b5351fc8f268a9b40a05551830733340fe792bb WatchSource:0}: Error finding container b8ae2c9eee5751b0bc5037674b5351fc8f268a9b40a05551830733340fe792bb: Status 404 returned error can't find the container with id b8ae2c9eee5751b0bc5037674b5351fc8f268a9b40a05551830733340fe792bb Jun 09 00:26:24.686691 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.686668 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz"] Jun 09 00:26:24.689772 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.689401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.691900 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.691709 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:26:24.691900 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.691768 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:26:24.692120 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.692102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:26:24.699889 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.699804 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz"] Jun 09 00:26:24.797134 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.797002 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.797134 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.797080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2km24\" (UniqueName: \"kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.797134 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.797128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.862497 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.862423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" event={"ID":"f7c83cae-d340-4cec-9d70-0862b63ff099","Type":"ContainerStarted","Data":"60d288670435393bdeb15f2db8ed9d7c2aa62a2e7285cc18ba6bc8afe456a143"} Jun 09 00:26:24.865954 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.865899 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" event={"ID":"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836","Type":"ContainerStarted","Data":"70ecbe8b2ca15aace34741d46c1938ab6bfa3a37cb4252db99211224f051caa8"} Jun 09 00:26:24.868233 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.868192 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" event={"ID":"530c7e52-2172-4001-9508-39b8fe5d4a82","Type":"ContainerStarted","Data":"b8ae2c9eee5751b0bc5037674b5351fc8f268a9b40a05551830733340fe792bb"} Jun 09 00:26:24.898913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.898180 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.898913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.898228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2km24\" (UniqueName: \"kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.898913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.898264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.898913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.898684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.899225 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.898933 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:24.909206 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:24.909183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2km24\" (UniqueName: \"kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:25.024545 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:25.024457 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:25.196953 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:25.196734 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz"] Jun 09 00:26:25.200817 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:25.200782 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6ec68a_1910_42e0_90c7_5cbfbc088eb0.slice/crio-d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2 WatchSource:0}: Error finding container d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2: Status 404 returned error can't find the container with id d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2 Jun 09 00:26:25.877097 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:25.877040 2557 generic.go:356] "Generic (PLEG): container finished" podID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerID="1f4c496178544eae37a8c85480bcebba0eaa9bf47a4ee02050b3c474fb4561dd" exitCode=0 Jun 09 00:26:25.877097 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:25.877090 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" event={"ID":"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0","Type":"ContainerDied","Data":"1f4c496178544eae37a8c85480bcebba0eaa9bf47a4ee02050b3c474fb4561dd"} Jun 09 00:26:25.877599 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:25.877169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" event={"ID":"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0","Type":"ContainerStarted","Data":"d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2"} Jun 09 00:26:29.896697 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.896658 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" event={"ID":"f7c83cae-d340-4cec-9d70-0862b63ff099","Type":"ContainerStarted","Data":"07fa0dda68f94a9dcff2b14bee2b3304ab8f4e26f2e2012ab8c566eff49853bf"} Jun 09 00:26:29.898296 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.898270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" event={"ID":"ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836","Type":"ContainerStarted","Data":"a4ff0bd56ce83734534320d3b2c003706bf86645cd4b40f3b4f8414704d066b3"} Jun 09 00:26:29.898419 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.898324 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:29.899724 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.899697 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" event={"ID":"530c7e52-2172-4001-9508-39b8fe5d4a82","Type":"ContainerStarted","Data":"69334b8b8b0a9aa651c12ba9e1113e368d8c85a2a3ddf92d6cc697272bed3932"} Jun 09 00:26:29.899915 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.899757 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:29.901442 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.901417 2557 generic.go:356] "Generic (PLEG): container finished" podID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerID="31830b5037d2640f2fba40d4428af8fcdf4016588d5f2aaf91c29f352075860b" exitCode=0 Jun 09 00:26:29.901534 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.901469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" event={"ID":"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0","Type":"ContainerDied","Data":"31830b5037d2640f2fba40d4428af8fcdf4016588d5f2aaf91c29f352075860b"} Jun 09 00:26:29.927375 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.927338 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56cb979fbc-s5dkn" podStartSLOduration=2.020247481 podStartE2EDuration="6.927326208s" totalImagesPullingTime="4.907078727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:29.926680276 +0000 UTC m=+401.959777064" watchObservedRunningTime="2026-06-09 00:26:29.927326208 +0000 UTC m=+401.960422969" Jun 09 00:26:29.962999 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.962951 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" podStartSLOduration=1.728700205 podStartE2EDuration="5.962931026s" totalImagesPullingTime="4.234230821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:29.960466971 +0000 UTC m=+401.993563741" watchObservedRunningTime="2026-06-09 00:26:29.962931026 +0000 UTC m=+401.996027789" Jun 09 00:26:29.984792 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:29.984747 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" podStartSLOduration=2.118342977 podStartE2EDuration="6.984731454s" totalImagesPullingTime="4.866388477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:29.98346718 +0000 UTC m=+402.016563942" watchObservedRunningTime="2026-06-09 00:26:29.984731454 +0000 UTC m=+402.017828217" Jun 09 00:26:30.907490 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:30.907456 2557 generic.go:356] "Generic (PLEG): container finished" podID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerID="4688d1488da9f7719c9776477250919ee47d5a071a151bb2c90a3e107f63978b" exitCode=0 Jun 09 00:26:30.907907 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:30.907547 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" event={"ID":"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0","Type":"ContainerDied","Data":"4688d1488da9f7719c9776477250919ee47d5a071a151bb2c90a3e107f63978b"} Jun 09 00:26:32.038808 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.038785 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:32.154815 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.154787 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle\") pod \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " Jun 09 00:26:32.154955 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.154823 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2km24\" (UniqueName: \"kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24\") pod \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " Jun 09 00:26:32.154955 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.154853 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util\") pod \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\" (UID: \"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0\") " Jun 09 00:26:32.155686 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.155663 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle" (OuterVolumeSpecName: "bundle") pod "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" (UID: "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:26:32.156975 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.156957 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24" (OuterVolumeSpecName: "kube-api-access-2km24") pod "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" (UID: "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0"). InnerVolumeSpecName "kube-api-access-2km24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:26:32.159333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.159308 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util" (OuterVolumeSpecName: "util") pod "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" (UID: "1c6ec68a-1910-42e0-90c7-5cbfbc088eb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:26:32.255809 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.255754 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:32.255809 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.255780 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2km24\" (UniqueName: \"kubernetes.io/projected/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-kube-api-access-2km24\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:32.255809 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.255790 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6ec68a-1910-42e0-90c7-5cbfbc088eb0-util\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:32.642823 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.642792 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hmb2q"] Jun 09 00:26:32.643072 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643060 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="extract" Jun 09 00:26:32.643131 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643074 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="extract" Jun 09 00:26:32.643131 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643089 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="pull" Jun 09 00:26:32.643131 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643094 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="pull" Jun 09 00:26:32.643131 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643104 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="util" Jun 09 00:26:32.643131 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643109 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="util" Jun 09 00:26:32.643271 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.643163 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c6ec68a-1910-42e0-90c7-5cbfbc088eb0" containerName="extract" Jun 09 00:26:32.646029 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.646001 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.649474 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.649457 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 00:26:32.649677 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.649662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p4zk6\"" Jun 09 00:26:32.662321 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.662301 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc"] Jun 09 00:26:32.664572 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.664557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.671172 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.671149 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hmb2q"] Jun 09 00:26:32.671535 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.671516 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-z4qq2\"" Jun 09 00:26:32.671680 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.671663 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 00:26:32.702833 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.702786 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc"] Jun 09 00:26:32.760859 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.760832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgv82\" (UniqueName: \"kubernetes.io/projected/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-kube-api-access-cgv82\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.760980 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.760863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.760980 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.760880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.760980 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.760906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxhl\" (UniqueName: \"kubernetes.io/projected/b9c3d83e-99eb-405b-b80b-8c8c6843c214-kube-api-access-9jxhl\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.861232 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.861207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxhl\" (UniqueName: \"kubernetes.io/projected/b9c3d83e-99eb-405b-b80b-8c8c6843c214-kube-api-access-9jxhl\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.861343 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.861259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgv82\" (UniqueName: \"kubernetes.io/projected/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-kube-api-access-cgv82\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.861343 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.861286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.861343 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.861311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.861442 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:26:32.861421 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 00:26:32.861485 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:26:32.861475 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert podName:b9c3d83e-99eb-405b-b80b-8c8c6843c214 nodeName:}" failed. No retries permitted until 2026-06-09 00:26:33.361458433 +0000 UTC m=+405.394555177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert") pod "kserve-controller-manager-69fc866d76-hmb2q" (UID: "b9c3d83e-99eb-405b-b80b-8c8c6843c214") : secret "kserve-webhook-server-cert" not found Jun 09 00:26:32.863732 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.863715 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.874509 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.874484 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgv82\" (UniqueName: \"kubernetes.io/projected/6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2-kube-api-access-cgv82\") pod \"llmisvc-controller-manager-864bfd7bc9-2zlcc\" (UID: \"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:32.874957 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.874942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxhl\" (UniqueName: \"kubernetes.io/projected/b9c3d83e-99eb-405b-b80b-8c8c6843c214-kube-api-access-9jxhl\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:32.918136 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.918074 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" event={"ID":"1c6ec68a-1910-42e0-90c7-5cbfbc088eb0","Type":"ContainerDied","Data":"d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2"} Jun 09 00:26:32.918136 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.918121 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d18aea83b492f0e914b74c6f33802d5792acdcf683994995ae3e318b707b2fb2" Jun 09 00:26:32.918136 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.918087 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06njqpz" Jun 09 00:26:32.974066 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:32.974045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:33.106798 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:33.106772 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc"] Jun 09 00:26:33.109770 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:33.109738 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6d1ed5c6_495e_4ad4_bbfc_aef4b993f4a2.slice/crio-510f3e65537f8555132b07a950c14c23aa31c0bc91ec210f380313195ec0c7f6 WatchSource:0}: Error finding container 510f3e65537f8555132b07a950c14c23aa31c0bc91ec210f380313195ec0c7f6: Status 404 returned error can't find the container with id 510f3e65537f8555132b07a950c14c23aa31c0bc91ec210f380313195ec0c7f6 Jun 09 00:26:33.364604 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:33.364569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:33.364711 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:26:33.364696 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 00:26:33.364749 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:26:33.364745 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert podName:b9c3d83e-99eb-405b-b80b-8c8c6843c214 nodeName:}" failed. No retries permitted until 2026-06-09 00:26:34.364730398 +0000 UTC m=+406.397827139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert") pod "kserve-controller-manager-69fc866d76-hmb2q" (UID: "b9c3d83e-99eb-405b-b80b-8c8c6843c214") : secret "kserve-webhook-server-cert" not found Jun 09 00:26:33.922920 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:33.922889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" event={"ID":"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2","Type":"ContainerStarted","Data":"510f3e65537f8555132b07a950c14c23aa31c0bc91ec210f380313195ec0c7f6"} Jun 09 00:26:34.373144 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:34.373110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:34.375334 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:34.375311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c3d83e-99eb-405b-b80b-8c8c6843c214-cert\") pod \"kserve-controller-manager-69fc866d76-hmb2q\" (UID: \"b9c3d83e-99eb-405b-b80b-8c8c6843c214\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:34.455728 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:34.455702 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:34.583406 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:34.583386 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hmb2q"] Jun 09 00:26:34.585906 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:34.585871 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c3d83e_99eb_405b_b80b_8c8c6843c214.slice/crio-cc687c66d666d8ad37614388decbdd5911c932a786e1addddcb68cba1b94af92 WatchSource:0}: Error finding container cc687c66d666d8ad37614388decbdd5911c932a786e1addddcb68cba1b94af92: Status 404 returned error can't find the container with id cc687c66d666d8ad37614388decbdd5911c932a786e1addddcb68cba1b94af92 Jun 09 00:26:34.929060 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:34.929002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" event={"ID":"b9c3d83e-99eb-405b-b80b-8c8c6843c214","Type":"ContainerStarted","Data":"cc687c66d666d8ad37614388decbdd5911c932a786e1addddcb68cba1b94af92"} Jun 09 00:26:37.946425 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:37.946387 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" event={"ID":"6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2","Type":"ContainerStarted","Data":"4809aceced3c9da368c8ea83362d7205e3dd3f7f5f70e1792f16c2d4504a5d09"} Jun 09 00:26:37.946781 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:37.946482 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:26:37.961952 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:37.961695 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" podStartSLOduration=2.182492286 podStartE2EDuration="5.961676665s" totalImagesPullingTime="3.779184379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:37.961005669 +0000 UTC m=+409.994102431" watchObservedRunningTime="2026-06-09 00:26:37.961676665 +0000 UTC m=+409.994773431" Jun 09 00:26:38.952333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:38.952290 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" event={"ID":"b9c3d83e-99eb-405b-b80b-8c8c6843c214","Type":"ContainerStarted","Data":"0abb71a017c6dcc69d40c2cb640efc1a1527ae92685d09c18deabbd0eefa7689"} Jun 09 00:26:38.952776 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:38.952460 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:26:39.007444 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.007398 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" podStartSLOduration=3.38107605 podStartE2EDuration="7.007383543s" totalImagesPullingTime="3.626307493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:39.006713243 +0000 UTC m=+411.039810006" watchObservedRunningTime="2026-06-09 00:26:39.007383543 +0000 UTC m=+411.040480304" Jun 09 00:26:39.708809 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.708773 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv"] Jun 09 00:26:39.742476 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.742451 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv"] Jun 09 00:26:39.742618 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.742548 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.745345 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.745323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:26:39.745834 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.745813 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:26:39.746003 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.745981 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:26:39.815341 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.815316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djpkv\" (UniqueName: \"kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.815476 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.815380 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.815476 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.815404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.915890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.915867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.915989 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.915895 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.915989 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.915929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djpkv\" (UniqueName: \"kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.916238 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.916220 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.916287 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.916270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:39.931142 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:39.931119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djpkv\" (UniqueName: \"kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:40.052574 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.052520 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:40.245145 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.244973 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv"] Jun 09 00:26:40.247300 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:40.247274 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48081e10_02b0_46cb_b1e7_77f47728e9c6.slice/crio-12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518 WatchSource:0}: Error finding container 12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518: Status 404 returned error can't find the container with id 12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518 Jun 09 00:26:40.912841 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.912811 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-b4cg8" Jun 09 00:26:40.959368 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.959336 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-sfd9r" Jun 09 00:26:40.961849 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.961821 2557 generic.go:356] "Generic (PLEG): container finished" podID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerID="716ab3f510d4be187c28d40eb3d09264a72cde9d9fc9a4dcb5949de3ab12fbd6" exitCode=0 Jun 09 00:26:40.961971 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.961929 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerDied","Data":"716ab3f510d4be187c28d40eb3d09264a72cde9d9fc9a4dcb5949de3ab12fbd6"} Jun 09 00:26:40.962044 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:40.961976 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerStarted","Data":"12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518"} Jun 09 00:26:41.091791 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.091760 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d"] Jun 09 00:26:41.110458 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.110433 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d"] Jun 09 00:26:41.110611 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.110526 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.112890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.112862 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 00:26:41.113175 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.112865 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 00:26:41.113175 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.112946 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-zmtl8\"" Jun 09 00:26:41.227782 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.227719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d932a0d5-2d04-4e83-989a-0f87111a7e91-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.227782 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.227761 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxpk\" (UniqueName: \"kubernetes.io/projected/d932a0d5-2d04-4e83-989a-0f87111a7e91-kube-api-access-wdxpk\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.329072 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.329039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxpk\" (UniqueName: \"kubernetes.io/projected/d932a0d5-2d04-4e83-989a-0f87111a7e91-kube-api-access-wdxpk\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.329185 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.329138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d932a0d5-2d04-4e83-989a-0f87111a7e91-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.331597 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.331580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d932a0d5-2d04-4e83-989a-0f87111a7e91-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.336776 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.336755 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxpk\" (UniqueName: \"kubernetes.io/projected/d932a0d5-2d04-4e83-989a-0f87111a7e91-kube-api-access-wdxpk\") pod \"servicemesh-operator3-57f65f65fb-dsp4d\" (UID: \"d932a0d5-2d04-4e83-989a-0f87111a7e91\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.420414 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.420390 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:41.577665 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.577638 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d"] Jun 09 00:26:41.580128 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:41.580098 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd932a0d5_2d04_4e83_989a_0f87111a7e91.slice/crio-fe5d7020ab70209603141b319c2b1942b06db3cd383ef4877b8aac3c1e548fbc WatchSource:0}: Error finding container fe5d7020ab70209603141b319c2b1942b06db3cd383ef4877b8aac3c1e548fbc: Status 404 returned error can't find the container with id fe5d7020ab70209603141b319c2b1942b06db3cd383ef4877b8aac3c1e548fbc Jun 09 00:26:41.968441 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:41.968410 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" event={"ID":"d932a0d5-2d04-4e83-989a-0f87111a7e91","Type":"ContainerStarted","Data":"fe5d7020ab70209603141b319c2b1942b06db3cd383ef4877b8aac3c1e548fbc"} Jun 09 00:26:42.975605 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:42.975568 2557 generic.go:356] "Generic (PLEG): container finished" podID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerID="23ee7c00955e93fab0108e6e5d852d038ef6f6a2a670b0210e47d2f3e2b9dff5" exitCode=0 Jun 09 00:26:42.976069 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:42.975659 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerDied","Data":"23ee7c00955e93fab0108e6e5d852d038ef6f6a2a670b0210e47d2f3e2b9dff5"} Jun 09 00:26:43.982726 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:43.982685 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerStarted","Data":"cff05cb0bde1343d6aa17034d69921ab7bf194bf0b4fd4fc1a47f4861fa3353d"} Jun 09 00:26:43.998588 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:43.998542 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" podStartSLOduration=3.432105054 podStartE2EDuration="4.998527072s" totalImagesPullingTime="1.566422018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:43.997093958 +0000 UTC m=+416.030190720" watchObservedRunningTime="2026-06-09 00:26:43.998527072 +0000 UTC m=+416.031623833" Jun 09 00:26:44.989571 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:44.989534 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" event={"ID":"d932a0d5-2d04-4e83-989a-0f87111a7e91","Type":"ContainerStarted","Data":"f798a505f718f3b75c8d92339693b94a5f46376430b85fce3b0a59a0a64324f0"} Jun 09 00:26:44.990046 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:44.989602 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:44.991774 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:44.991746 2557 generic.go:356] "Generic (PLEG): container finished" podID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerID="cff05cb0bde1343d6aa17034d69921ab7bf194bf0b4fd4fc1a47f4861fa3353d" exitCode=0 Jun 09 00:26:44.991871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:44.991780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerDied","Data":"cff05cb0bde1343d6aa17034d69921ab7bf194bf0b4fd4fc1a47f4861fa3353d"} Jun 09 00:26:45.009666 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:45.009628 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" podStartSLOduration=1.5452806639999999 podStartE2EDuration="4.009612834s" totalImagesPullingTime="2.46433217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:45.009298968 +0000 UTC m=+417.042395760" watchObservedRunningTime="2026-06-09 00:26:45.009612834 +0000 UTC m=+417.042709595" Jun 09 00:26:46.123296 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.123273 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:46.271187 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.271118 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle\") pod \"48081e10-02b0-46cb-b1e7-77f47728e9c6\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " Jun 09 00:26:46.271187 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.271175 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djpkv\" (UniqueName: \"kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv\") pod \"48081e10-02b0-46cb-b1e7-77f47728e9c6\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " Jun 09 00:26:46.271341 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.271226 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util\") pod \"48081e10-02b0-46cb-b1e7-77f47728e9c6\" (UID: \"48081e10-02b0-46cb-b1e7-77f47728e9c6\") " Jun 09 00:26:46.272077 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.272049 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle" (OuterVolumeSpecName: "bundle") pod "48081e10-02b0-46cb-b1e7-77f47728e9c6" (UID: "48081e10-02b0-46cb-b1e7-77f47728e9c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:26:46.273249 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.273222 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv" (OuterVolumeSpecName: "kube-api-access-djpkv") pod "48081e10-02b0-46cb-b1e7-77f47728e9c6" (UID: "48081e10-02b0-46cb-b1e7-77f47728e9c6"). InnerVolumeSpecName "kube-api-access-djpkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:26:46.275811 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.275781 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util" (OuterVolumeSpecName: "util") pod "48081e10-02b0-46cb-b1e7-77f47728e9c6" (UID: "48081e10-02b0-46cb-b1e7-77f47728e9c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:26:46.372358 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.372335 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djpkv\" (UniqueName: \"kubernetes.io/projected/48081e10-02b0-46cb-b1e7-77f47728e9c6-kube-api-access-djpkv\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:46.372358 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.372355 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-util\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:46.372487 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:46.372365 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48081e10-02b0-46cb-b1e7-77f47728e9c6-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:26:47.002856 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:47.002819 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" event={"ID":"48081e10-02b0-46cb-b1e7-77f47728e9c6","Type":"ContainerDied","Data":"12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518"} Jun 09 00:26:47.003049 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:47.002872 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9scwv" Jun 09 00:26:47.003049 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:47.002874 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12867cec36ee4fb0a6beea295cb371e67f54fbaa5cb4c90b7e4e9d3473bd3518" Jun 09 00:26:53.752140 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752104 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-l8gqm"] Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752518 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="extract" Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752534 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="extract" Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752560 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="pull" Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752569 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="pull" Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752587 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="util" Jun 09 00:26:53.752631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752597 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="util" Jun 09 00:26:53.752823 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.752669 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="48081e10-02b0-46cb-b1e7-77f47728e9c6" containerName="extract" Jun 09 00:26:53.756151 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.756127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.758202 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.758179 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q9ql9\"" Jun 09 00:26:53.758314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.758179 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 00:26:53.761880 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.761857 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-l8gqm"] Jun 09 00:26:53.825731 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.825707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74550ebb-4fb3-4a58-852a-b8e0b9644c93-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.825813 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.825763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgmh\" (UniqueName: \"kubernetes.io/projected/74550ebb-4fb3-4a58-852a-b8e0b9644c93-kube-api-access-vbgmh\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.926450 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.926425 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgmh\" (UniqueName: \"kubernetes.io/projected/74550ebb-4fb3-4a58-852a-b8e0b9644c93-kube-api-access-vbgmh\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.926520 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.926463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74550ebb-4fb3-4a58-852a-b8e0b9644c93-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.927126 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.927110 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74550ebb-4fb3-4a58-852a-b8e0b9644c93-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:53.933505 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:53.933487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgmh\" (UniqueName: \"kubernetes.io/projected/74550ebb-4fb3-4a58-852a-b8e0b9644c93-kube-api-access-vbgmh\") pod \"dashboard-redirect-64c7bc99c9-l8gqm\" (UID: \"74550ebb-4fb3-4a58-852a-b8e0b9644c93\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:54.067767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:54.067707 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" Jun 09 00:26:54.185591 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:54.185559 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-l8gqm"] Jun 09 00:26:54.187524 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:26:54.187490 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74550ebb_4fb3_4a58_852a_b8e0b9644c93.slice/crio-5852bee0556a2e4ef08d87d8d730386dcd2e6429bbd55eae3e0b502c45ed36af WatchSource:0}: Error finding container 5852bee0556a2e4ef08d87d8d730386dcd2e6429bbd55eae3e0b502c45ed36af: Status 404 returned error can't find the container with id 5852bee0556a2e4ef08d87d8d730386dcd2e6429bbd55eae3e0b502c45ed36af Jun 09 00:26:55.041908 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:55.041838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" event={"ID":"74550ebb-4fb3-4a58-852a-b8e0b9644c93","Type":"ContainerStarted","Data":"5852bee0556a2e4ef08d87d8d730386dcd2e6429bbd55eae3e0b502c45ed36af"} Jun 09 00:26:55.998643 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:55.998619 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4d" Jun 09 00:26:56.048826 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:56.048799 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" event={"ID":"74550ebb-4fb3-4a58-852a-b8e0b9644c93","Type":"ContainerStarted","Data":"818f9cd0ea8bf80153672005f0c15cbf9101b4e86094792116070488d84b49df"} Jun 09 00:26:56.062706 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:26:56.062661 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64c7bc99c9-l8gqm" podStartSLOduration=1.290679367 podStartE2EDuration="3.062647843s" totalImagesPullingTime="1.771968476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:56.061433366 +0000 UTC m=+428.094530128" watchObservedRunningTime="2026-06-09 00:26:56.062647843 +0000 UTC m=+428.095744642" Jun 09 00:27:08.953919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:08.953838 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2zlcc" Jun 09 00:27:09.962155 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:09.962124 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hmb2q" Jun 09 00:27:11.225632 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.225598 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk"] Jun 09 00:27:11.232952 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.232923 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.236444 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.236424 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 00:27:11.236582 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.236427 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 00:27:11.236582 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.236427 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 00:27:11.236772 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.236749 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 00:27:11.236849 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.236779 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q4bq7\"" Jun 09 00:27:11.244695 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.244675 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk"] Jun 09 00:27:11.350255 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350229 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350298 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhfbz\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-kube-api-access-vhfbz\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350357 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350489 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.350489 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.350447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25d8103b-7973-49b6-98a9-f78d98df329f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451265 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451239 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25d8103b-7973-49b6-98a9-f78d98df329f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhfbz\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-kube-api-access-vhfbz\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.451620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.451462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.452127 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.452099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.453816 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.453787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.453905 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.453856 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.453945 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.453912 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25d8103b-7973-49b6-98a9-f78d98df329f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.454015 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.453999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25d8103b-7973-49b6-98a9-f78d98df329f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.458337 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.458312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.458576 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.458558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhfbz\" (UniqueName: \"kubernetes.io/projected/25d8103b-7973-49b6-98a9-f78d98df329f-kube-api-access-vhfbz\") pod \"istiod-openshift-gateway-75c67f8887-9zcpk\" (UID: \"25d8103b-7973-49b6-98a9-f78d98df329f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.542138 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.542085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:11.672539 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:11.672514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk"] Jun 09 00:27:11.675047 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:27:11.674998 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d8103b_7973_49b6_98a9_f78d98df329f.slice/crio-3a82f7de29a71613d34580475b53ab129bbfea9bf17950a31c6302ddb5876b38 WatchSource:0}: Error finding container 3a82f7de29a71613d34580475b53ab129bbfea9bf17950a31c6302ddb5876b38: Status 404 returned error can't find the container with id 3a82f7de29a71613d34580475b53ab129bbfea9bf17950a31c6302ddb5876b38 Jun 09 00:27:12.120587 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:12.120545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" event={"ID":"25d8103b-7973-49b6-98a9-f78d98df329f","Type":"ContainerStarted","Data":"3a82f7de29a71613d34580475b53ab129bbfea9bf17950a31c6302ddb5876b38"} Jun 09 00:27:13.810815 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:13.810773 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:27:13.811116 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:13.810850 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:27:14.131721 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:14.131686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" event={"ID":"25d8103b-7973-49b6-98a9-f78d98df329f","Type":"ContainerStarted","Data":"ac4f8c3c4ab73e885925ab391c7306148767f6c1628e406d13df5de147ba7e9b"} Jun 09 00:27:14.131903 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:14.131828 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:27:14.133558 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:14.133536 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-9zcpk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 00:27:14.133686 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:14.133593 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" podUID="25d8103b-7973-49b6-98a9-f78d98df329f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:27:14.150992 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:14.150950 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" podStartSLOduration=1.017421188 podStartE2EDuration="3.150937378s" totalImagesPullingTime="2.13351619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:27:14.14926898 +0000 UTC m=+446.182365742" watchObservedRunningTime="2026-06-09 00:27:14.150937378 +0000 UTC m=+446.184034139" Jun 09 00:27:15.136970 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:15.136940 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-9zcpk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 00:27:15.137451 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:15.136999 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" podUID="25d8103b-7973-49b6-98a9-f78d98df329f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:27:18.137558 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:27:18.137531 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9zcpk" Jun 09 00:28:12.732056 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.732014 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn"] Jun 09 00:28:12.735193 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.735174 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.737470 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.737445 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 00:28:12.737586 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.737452 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bhwc\"" Jun 09 00:28:12.737586 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.737450 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 00:28:12.737586 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.737450 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:28:12.738147 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.738133 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:28:12.742370 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.742182 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn"] Jun 09 00:28:12.790401 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.790376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.790490 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.790437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.790490 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.790468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8r6x\" (UniqueName: \"kubernetes.io/projected/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-kube-api-access-w8r6x\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.891633 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.891608 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.891720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.891642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8r6x\" (UniqueName: \"kubernetes.io/projected/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-kube-api-access-w8r6x\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.891720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.891677 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.891833 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:28:12.891813 2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 00:28:12.891906 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:28:12.891894 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert podName:3a5cfe9e-2f9a-4c33-a418-9d1444191bbb nodeName:}" failed. No retries permitted until 2026-06-09 00:28:13.391876309 +0000 UTC m=+505.424973063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2zgzn" (UID: "3a5cfe9e-2f9a-4c33-a418-9d1444191bbb") : secret "plugin-serving-cert" not found Jun 09 00:28:12.892397 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.892381 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:12.917929 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:12.917904 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8r6x\" (UniqueName: \"kubernetes.io/projected/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-kube-api-access-w8r6x\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:13.396386 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.396361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:13.398690 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.398668 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5cfe9e-2f9a-4c33-a418-9d1444191bbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2zgzn\" (UID: \"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:13.472822 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.472798 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77986bbc94-jr4cd"] Jun 09 00:28:13.476105 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.476089 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.478912 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.478892 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 00:28:13.479965 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479910 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:28:13.479965 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479910 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:28:13.479965 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479952 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ltrfd\"" Jun 09 00:28:13.480254 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479968 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 00:28:13.480254 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479999 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 00:28:13.480254 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479913 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 00:28:13.480254 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.479913 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 00:28:13.485886 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.485867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 00:28:13.494344 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.494326 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77986bbc94-jr4cd"] Jun 09 00:28:13.598774 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-oauth-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.598890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-trusted-ca-bundle\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.598890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-oauth-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.599009 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-service-ca\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.599009 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vk9\" (UniqueName: \"kubernetes.io/projected/dd6bb196-8b04-48ad-9532-983d6988e005-kube-api-access-75vk9\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.599009 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.599009 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.598987 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-console-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.644914 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.644896 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" Jun 09 00:28:13.699715 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-service-ca\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.699871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699729 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vk9\" (UniqueName: \"kubernetes.io/projected/dd6bb196-8b04-48ad-9532-983d6988e005-kube-api-access-75vk9\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.699871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.699871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-console-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.699871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-oauth-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.699871 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-trusted-ca-bundle\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.700136 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.699898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-oauth-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.700551 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.700523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-service-ca\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.700678 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.700650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-console-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.700799 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.700738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-trusted-ca-bundle\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.700799 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.700771 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd6bb196-8b04-48ad-9532-983d6988e005-oauth-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.702391 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.702365 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-oauth-config\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.702475 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.702428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd6bb196-8b04-48ad-9532-983d6988e005-console-serving-cert\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.709916 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.709892 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vk9\" (UniqueName: \"kubernetes.io/projected/dd6bb196-8b04-48ad-9532-983d6988e005-kube-api-access-75vk9\") pod \"console-77986bbc94-jr4cd\" (UID: \"dd6bb196-8b04-48ad-9532-983d6988e005\") " pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.785320 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.785284 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:13.792290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.792268 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn"] Jun 09 00:28:13.795534 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:28:13.795509 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a5cfe9e_2f9a_4c33_a418_9d1444191bbb.slice/crio-126efd0c1d4ebe52b9d3791086db9375330862d67102da156d506e0b2d057aa6 WatchSource:0}: Error finding container 126efd0c1d4ebe52b9d3791086db9375330862d67102da156d506e0b2d057aa6: Status 404 returned error can't find the container with id 126efd0c1d4ebe52b9d3791086db9375330862d67102da156d506e0b2d057aa6 Jun 09 00:28:13.911157 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:13.911099 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77986bbc94-jr4cd"] Jun 09 00:28:13.913129 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:28:13.913095 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6bb196_8b04_48ad_9532_983d6988e005.slice/crio-9ff30a818f460785bb1cc49f5ed67fe9c4d216f2b4f20f15a58a7db6cf694542 WatchSource:0}: Error finding container 9ff30a818f460785bb1cc49f5ed67fe9c4d216f2b4f20f15a58a7db6cf694542: Status 404 returned error can't find the container with id 9ff30a818f460785bb1cc49f5ed67fe9c4d216f2b4f20f15a58a7db6cf694542 Jun 09 00:28:14.420146 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:14.420117 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" event={"ID":"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb","Type":"ContainerStarted","Data":"126efd0c1d4ebe52b9d3791086db9375330862d67102da156d506e0b2d057aa6"} Jun 09 00:28:14.420146 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:14.420149 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77986bbc94-jr4cd" event={"ID":"dd6bb196-8b04-48ad-9532-983d6988e005","Type":"ContainerStarted","Data":"6b9890324e11037506ef3e7d7bc7d8c784031c8d081238346a299f76666b0acb"} Jun 09 00:28:14.420335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:14.420173 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77986bbc94-jr4cd" event={"ID":"dd6bb196-8b04-48ad-9532-983d6988e005","Type":"ContainerStarted","Data":"9ff30a818f460785bb1cc49f5ed67fe9c4d216f2b4f20f15a58a7db6cf694542"} Jun 09 00:28:14.437138 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:14.437084 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77986bbc94-jr4cd" podStartSLOduration=1.437065952 podStartE2EDuration="1.437065952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:14.436713964 +0000 UTC m=+506.469810751" watchObservedRunningTime="2026-06-09 00:28:14.437065952 +0000 UTC m=+506.470162707" Jun 09 00:28:23.281016 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.280981 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs"] Jun 09 00:28:23.293096 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.293071 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:23.296765 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.296738 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g9fbb\"" Jun 09 00:28:23.298738 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.298711 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs"] Jun 09 00:28:23.390953 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.390911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szdnd\" (UniqueName: \"kubernetes.io/projected/a85b4cdc-6161-48b8-9dbd-cb13e1d020da-kube-api-access-szdnd\") pod \"limitador-operator-controller-manager-859d7b78bd-68dqs\" (UID: \"a85b4cdc-6161-48b8-9dbd-cb13e1d020da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:23.491713 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.491675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szdnd\" (UniqueName: \"kubernetes.io/projected/a85b4cdc-6161-48b8-9dbd-cb13e1d020da-kube-api-access-szdnd\") pod \"limitador-operator-controller-manager-859d7b78bd-68dqs\" (UID: \"a85b4cdc-6161-48b8-9dbd-cb13e1d020da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:23.511662 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.511631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szdnd\" (UniqueName: \"kubernetes.io/projected/a85b4cdc-6161-48b8-9dbd-cb13e1d020da-kube-api-access-szdnd\") pod \"limitador-operator-controller-manager-859d7b78bd-68dqs\" (UID: \"a85b4cdc-6161-48b8-9dbd-cb13e1d020da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:23.606426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.606392 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:23.786211 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.786179 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:23.786388 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.786252 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:23.791583 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:23.791561 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:24.479954 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:24.479912 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77986bbc94-jr4cd" Jun 09 00:28:37.297746 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:37.297721 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs"] Jun 09 00:28:37.299395 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:28:37.299361 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85b4cdc_6161_48b8_9dbd_cb13e1d020da.slice/crio-fdb117713fc51a0780d5fbffadd213815e6984700e6049e3f1b250e96115c562 WatchSource:0}: Error finding container fdb117713fc51a0780d5fbffadd213815e6984700e6049e3f1b250e96115c562: Status 404 returned error can't find the container with id fdb117713fc51a0780d5fbffadd213815e6984700e6049e3f1b250e96115c562 Jun 09 00:28:37.547438 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:37.547369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" event={"ID":"a85b4cdc-6161-48b8-9dbd-cb13e1d020da","Type":"ContainerStarted","Data":"fdb117713fc51a0780d5fbffadd213815e6984700e6049e3f1b250e96115c562"} Jun 09 00:28:38.552699 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:38.552668 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" event={"ID":"3a5cfe9e-2f9a-4c33-a418-9d1444191bbb","Type":"ContainerStarted","Data":"3cc6ef637a378ab1524ef8ccf671f9882481f73cd87cf257b5da5ae97a41adcb"} Jun 09 00:28:38.570457 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:38.570406 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2zgzn" podStartSLOduration=2.777887265 podStartE2EDuration="26.570391236s" totalImagesPullingTime="23.792503971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:38.568832885 +0000 UTC m=+530.601929641" watchObservedRunningTime="2026-06-09 00:28:38.570391236 +0000 UTC m=+530.603487998" Jun 09 00:28:41.567647 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:41.567568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" event={"ID":"a85b4cdc-6161-48b8-9dbd-cb13e1d020da","Type":"ContainerStarted","Data":"028129dd164807fc0d68b9d701336be3fc658f759860af39a315d969f252b17c"} Jun 09 00:28:41.567987 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:41.567730 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:28:41.584305 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:41.584264 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" podStartSLOduration=14.573403085 podStartE2EDuration="18.584249798s" totalImagesPullingTime="4.010846713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:41.583608626 +0000 UTC m=+533.616705387" watchObservedRunningTime="2026-06-09 00:28:41.584249798 +0000 UTC m=+533.617346616" Jun 09 00:28:52.575694 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:28:52.575663 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68dqs" Jun 09 00:29:40.497525 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.497494 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79"] Jun 09 00:29:40.500314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.500297 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.502571 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.502541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:29:40.503319 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.503302 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:29:40.503426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.503341 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:29:40.510097 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.510074 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79"] Jun 09 00:29:40.682082 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.682058 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.682190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.682090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxg8\" (UniqueName: \"kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.682190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.682156 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.782872 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.782816 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.782872 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.782846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxg8\" (UniqueName: \"kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.782992 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.782881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.783258 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.783240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.783304 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.783252 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.791485 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.791468 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxg8\" (UniqueName: \"kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.810896 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.810880 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:40.939484 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:40.939460 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79"] Jun 09 00:29:40.941416 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:29:40.941388 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03122bf_85df_4f2c_89a7_80b3ba265d3a.slice/crio-66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088 WatchSource:0}: Error finding container 66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088: Status 404 returned error can't find the container with id 66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088 Jun 09 00:29:41.853823 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:41.853791 2557 generic.go:356] "Generic (PLEG): container finished" podID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerID="38c4bf4e015ed17d09e2555128f0da5799a79960a4898e4194ac62693257abbd" exitCode=0 Jun 09 00:29:41.854172 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:41.853875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" event={"ID":"e03122bf-85df-4f2c-89a7-80b3ba265d3a","Type":"ContainerDied","Data":"38c4bf4e015ed17d09e2555128f0da5799a79960a4898e4194ac62693257abbd"} Jun 09 00:29:41.854172 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:41.853921 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" event={"ID":"e03122bf-85df-4f2c-89a7-80b3ba265d3a","Type":"ContainerStarted","Data":"66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088"} Jun 09 00:29:42.861154 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:42.861119 2557 generic.go:356] "Generic (PLEG): container finished" podID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerID="a7cb602d5b9a3cd27ba16bd5a5f3a0930882c1ad4b1b5e3bcd569b88cd1ed2bb" exitCode=0 Jun 09 00:29:42.861560 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:42.861210 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" event={"ID":"e03122bf-85df-4f2c-89a7-80b3ba265d3a","Type":"ContainerDied","Data":"a7cb602d5b9a3cd27ba16bd5a5f3a0930882c1ad4b1b5e3bcd569b88cd1ed2bb"} Jun 09 00:29:43.868539 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:43.868508 2557 generic.go:356] "Generic (PLEG): container finished" podID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerID="d37d3bb1cb23af2cd6486fe4ba357a2755e03d8259bd83baf20bac04c1d4bc32" exitCode=0 Jun 09 00:29:43.868976 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:43.868545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" event={"ID":"e03122bf-85df-4f2c-89a7-80b3ba265d3a","Type":"ContainerDied","Data":"d37d3bb1cb23af2cd6486fe4ba357a2755e03d8259bd83baf20bac04c1d4bc32"} Jun 09 00:29:45.001876 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.001851 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:45.013094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.013066 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zxg8\" (UniqueName: \"kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8\") pod \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " Jun 09 00:29:45.013198 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.013117 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util\") pod \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " Jun 09 00:29:45.013198 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.013158 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle\") pod \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\" (UID: \"e03122bf-85df-4f2c-89a7-80b3ba265d3a\") " Jun 09 00:29:45.013675 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.013653 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle" (OuterVolumeSpecName: "bundle") pod "e03122bf-85df-4f2c-89a7-80b3ba265d3a" (UID: "e03122bf-85df-4f2c-89a7-80b3ba265d3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:29:45.015063 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.015043 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8" (OuterVolumeSpecName: "kube-api-access-8zxg8") pod "e03122bf-85df-4f2c-89a7-80b3ba265d3a" (UID: "e03122bf-85df-4f2c-89a7-80b3ba265d3a"). InnerVolumeSpecName "kube-api-access-8zxg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:29:45.019863 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.019838 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util" (OuterVolumeSpecName: "util") pod "e03122bf-85df-4f2c-89a7-80b3ba265d3a" (UID: "e03122bf-85df-4f2c-89a7-80b3ba265d3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:29:45.114465 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.114442 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zxg8\" (UniqueName: \"kubernetes.io/projected/e03122bf-85df-4f2c-89a7-80b3ba265d3a-kube-api-access-8zxg8\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:29:45.114465 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.114461 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-util\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:29:45.114632 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.114471 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e03122bf-85df-4f2c-89a7-80b3ba265d3a-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:29:45.880122 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.880084 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" event={"ID":"e03122bf-85df-4f2c-89a7-80b3ba265d3a","Type":"ContainerDied","Data":"66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088"} Jun 09 00:29:45.880122 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.880115 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kxz79" Jun 09 00:29:45.880369 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:45.880152 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66dafc3af4737d8fdf4b93c560b6195756e05fc69ec085901b523d061e81d088" Jun 09 00:29:48.392163 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:48.392138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:29:48.392621 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:29:48.392220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:30:38.958385 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958357 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958831 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="util" Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958851 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="util" Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958865 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="extract" Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958875 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="extract" Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958899 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="pull" Jun 09 00:30:38.958977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.958908 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="pull" Jun 09 00:30:38.959360 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.959002 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e03122bf-85df-4f2c-89a7-80b3ba265d3a" containerName="extract" Jun 09 00:30:38.961968 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.961949 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:38.964732 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.964712 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 00:30:38.964818 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.964752 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sxhdq\"" Jun 09 00:30:38.965339 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.965326 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 00:30:38.980183 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:38.980161 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:39.095273 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.095247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhprx\" (UniqueName: \"kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.095397 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.095292 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.135013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.134988 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:30:39.138427 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.138410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.149635 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.149614 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:30:39.196666 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.196638 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.196760 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.196685 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhprx\" (UniqueName: \"kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.196838 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.196819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.196878 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.196855 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qct9l\" (UniqueName: \"kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.199326 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.199300 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.205150 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.205119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhprx\" (UniqueName: \"kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx\") pod \"maas-controller-8dbfb77ff-mgz7x\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.271705 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.271657 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:39.297873 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.297853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qct9l\" (UniqueName: \"kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.297974 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.297914 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.300013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.299985 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.314142 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.314122 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qct9l\" (UniqueName: \"kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l\") pod \"maas-controller-669887cd7b-srngz\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.400078 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.400048 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:39.401226 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:30:39.401199 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ee2b54_4f97_4c3d_a37f_9030583f6efe.slice/crio-8cd0aa1af7c0646efc10d2b863331a9e183df724df0b4812839c560d18fed4b3 WatchSource:0}: Error finding container 8cd0aa1af7c0646efc10d2b863331a9e183df724df0b4812839c560d18fed4b3: Status 404 returned error can't find the container with id 8cd0aa1af7c0646efc10d2b863331a9e183df724df0b4812839c560d18fed4b3 Jun 09 00:30:39.402390 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.402373 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:30:39.449652 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.449618 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:39.576178 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:39.576146 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:30:39.578787 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:30:39.578757 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50620182_eb6b_4492_8145_8b29ced27a32.slice/crio-20b2fda6061b006aa10da416cf9d37defa19e35f27f26e73b8730456b3b2bf19 WatchSource:0}: Error finding container 20b2fda6061b006aa10da416cf9d37defa19e35f27f26e73b8730456b3b2bf19: Status 404 returned error can't find the container with id 20b2fda6061b006aa10da416cf9d37defa19e35f27f26e73b8730456b3b2bf19 Jun 09 00:30:40.153068 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:40.153015 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-srngz" event={"ID":"50620182-eb6b-4492-8145-8b29ced27a32","Type":"ContainerStarted","Data":"20b2fda6061b006aa10da416cf9d37defa19e35f27f26e73b8730456b3b2bf19"} Jun 09 00:30:40.155521 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:40.155458 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" event={"ID":"a0ee2b54-4f97-4c3d-a37f-9030583f6efe","Type":"ContainerStarted","Data":"8cd0aa1af7c0646efc10d2b863331a9e183df724df0b4812839c560d18fed4b3"} Jun 09 00:30:43.173905 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.173869 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-srngz" event={"ID":"50620182-eb6b-4492-8145-8b29ced27a32","Type":"ContainerStarted","Data":"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612"} Jun 09 00:30:43.174416 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.173993 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:43.175549 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.175525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" event={"ID":"a0ee2b54-4f97-4c3d-a37f-9030583f6efe","Type":"ContainerStarted","Data":"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f"} Jun 09 00:30:43.175664 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.175583 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:43.204379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.204332 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669887cd7b-srngz" podStartSLOduration=1.657860677 podStartE2EDuration="4.204319203s" totalImagesPullingTime="2.546458526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:30:43.202984901 +0000 UTC m=+655.236081653" watchObservedRunningTime="2026-06-09 00:30:43.204319203 +0000 UTC m=+655.237415965" Jun 09 00:30:43.242135 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:43.242089 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" podStartSLOduration=2.507711447 podStartE2EDuration="5.242072781s" totalImagesPullingTime="2.734361334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:30:43.2410693 +0000 UTC m=+655.274166062" watchObservedRunningTime="2026-06-09 00:30:43.242072781 +0000 UTC m=+655.275169545" Jun 09 00:30:54.185745 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.185714 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:54.186196 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.186116 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:30:54.240677 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.240647 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:54.240863 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.240840 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" podUID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" containerName="manager" containerID="cri-o://e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f" gracePeriod=30 Jun 09 00:30:54.478730 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.478708 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:54.627609 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.627574 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhprx\" (UniqueName: \"kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx\") pod \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " Jun 09 00:30:54.627763 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.627667 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert\") pod \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\" (UID: \"a0ee2b54-4f97-4c3d-a37f-9030583f6efe\") " Jun 09 00:30:54.629670 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.629638 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a0ee2b54-4f97-4c3d-a37f-9030583f6efe" (UID: "a0ee2b54-4f97-4c3d-a37f-9030583f6efe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:30:54.629776 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.629709 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx" (OuterVolumeSpecName: "kube-api-access-fhprx") pod "a0ee2b54-4f97-4c3d-a37f-9030583f6efe" (UID: "a0ee2b54-4f97-4c3d-a37f-9030583f6efe"). InnerVolumeSpecName "kube-api-access-fhprx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:30:54.728799 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.728745 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-webhook-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:30:54.728799 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:54.728765 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhprx\" (UniqueName: \"kubernetes.io/projected/a0ee2b54-4f97-4c3d-a37f-9030583f6efe-kube-api-access-fhprx\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:30:55.236192 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.236158 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" containerID="e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f" exitCode=0 Jun 09 00:30:55.236581 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.236205 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" Jun 09 00:30:55.236581 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.236248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" event={"ID":"a0ee2b54-4f97-4c3d-a37f-9030583f6efe","Type":"ContainerDied","Data":"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f"} Jun 09 00:30:55.236581 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.236305 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8dbfb77ff-mgz7x" event={"ID":"a0ee2b54-4f97-4c3d-a37f-9030583f6efe","Type":"ContainerDied","Data":"8cd0aa1af7c0646efc10d2b863331a9e183df724df0b4812839c560d18fed4b3"} Jun 09 00:30:55.236581 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.236329 2557 scope.go:117] "RemoveContainer" containerID="e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f" Jun 09 00:30:55.245627 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.245472 2557 scope.go:117] "RemoveContainer" containerID="e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f" Jun 09 00:30:55.245730 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:30:55.245710 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f\": container with ID starting with e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f not found: ID does not exist" containerID="e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f" Jun 09 00:30:55.245768 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.245737 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f"} err="failed to get container status \"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f\": rpc error: code = NotFound desc = could not find container \"e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f\": container with ID starting with e31f56ae45033d1f57dc0140a584167bdf00bb07effeb9f69ddaf8cc99dd524f not found: ID does not exist" Jun 09 00:30:55.256808 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.256781 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:55.259919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:55.259898 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8dbfb77ff-mgz7x"] Jun 09 00:30:56.419796 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:30:56.419763 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" path="/var/lib/kubelet/pods/a0ee2b54-4f97-4c3d-a37f-9030583f6efe/volumes" Jun 09 00:31:13.423985 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.423949 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-7955c99579-8rghj"] Jun 09 00:31:13.424455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.424300 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" containerName="manager" Jun 09 00:31:13.424455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.424313 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" containerName="manager" Jun 09 00:31:13.424455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.424384 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0ee2b54-4f97-4c3d-a37f-9030583f6efe" containerName="manager" Jun 09 00:31:13.427436 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.427416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:13.429784 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.429764 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 00:31:13.430455 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.430431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 00:31:13.430553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.430469 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 00:31:13.430553 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.430495 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-75g5x\"" Jun 09 00:31:13.441683 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.441664 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7955c99579-8rghj"] Jun 09 00:31:13.463510 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.463490 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfkjt\" (UniqueName: \"kubernetes.io/projected/02dd9232-f50c-446d-a221-498bea8581e4-kube-api-access-xfkjt\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:13.463603 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.463533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:13.564500 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.564473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:13.564589 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.564532 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfkjt\" (UniqueName: \"kubernetes.io/projected/02dd9232-f50c-446d-a221-498bea8581e4-kube-api-access-xfkjt\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:13.564634 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:31:13.564611 2557 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 00:31:13.564691 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:31:13.564681 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls podName:02dd9232-f50c-446d-a221-498bea8581e4 nodeName:}" failed. No retries permitted until 2026-06-09 00:31:14.064661721 +0000 UTC m=+686.097758464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls") pod "maas-api-7955c99579-8rghj" (UID: "02dd9232-f50c-446d-a221-498bea8581e4") : secret "maas-api-serving-cert" not found Jun 09 00:31:13.574895 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:13.574873 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfkjt\" (UniqueName: \"kubernetes.io/projected/02dd9232-f50c-446d-a221-498bea8581e4-kube-api-access-xfkjt\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:14.067514 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:14.067483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:14.069795 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:14.069772 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02dd9232-f50c-446d-a221-498bea8581e4-maas-api-tls\") pod \"maas-api-7955c99579-8rghj\" (UID: \"02dd9232-f50c-446d-a221-498bea8581e4\") " pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:14.337059 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:14.336955 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:14.469502 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:14.469465 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7955c99579-8rghj"] Jun 09 00:31:14.471280 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:31:14.471253 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02dd9232_f50c_446d_a221_498bea8581e4.slice/crio-7650ece8a61a36187fbcdda20744ee74dbc434e1b5a723690d699b6cb59455de WatchSource:0}: Error finding container 7650ece8a61a36187fbcdda20744ee74dbc434e1b5a723690d699b6cb59455de: Status 404 returned error can't find the container with id 7650ece8a61a36187fbcdda20744ee74dbc434e1b5a723690d699b6cb59455de Jun 09 00:31:15.349206 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:15.349169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" event={"ID":"02dd9232-f50c-446d-a221-498bea8581e4","Type":"ContainerStarted","Data":"7650ece8a61a36187fbcdda20744ee74dbc434e1b5a723690d699b6cb59455de"} Jun 09 00:31:16.362060 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:16.361997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" event={"ID":"02dd9232-f50c-446d-a221-498bea8581e4","Type":"ContainerStarted","Data":"f74020d1b9ca3f9c77dc703762350d80863761cd2823234dc4ed4efdb4ef5226"} Jun 09 00:31:16.362425 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:16.362142 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:31:16.378107 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:16.378063 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" podStartSLOduration=1.8317169290000002 podStartE2EDuration="3.378050686s" totalImagesPullingTime="1.546333757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:31:16.376613328 +0000 UTC m=+688.409710087" watchObservedRunningTime="2026-06-09 00:31:16.378050686 +0000 UTC m=+688.411147447" Jun 09 00:31:22.372391 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:31:22.372362 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-7955c99579-8rghj" Jun 09 00:32:22.237190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.237158 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9"] Jun 09 00:32:22.240539 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.240522 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.242838 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.242814 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 00:32:22.243507 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.243490 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 00:32:22.243582 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.243567 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dpj9m\"" Jun 09 00:32:22.243645 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.243623 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 00:32:22.250825 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.250755 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9"] Jun 09 00:32:22.367189 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.367286 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.367286 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.367286 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plb7l\" (UniqueName: \"kubernetes.io/projected/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kube-api-access-plb7l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.367428 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.367428 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.367372 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468339 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468312 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468462 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468348 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468527 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468586 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468586 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468694 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plb7l\" (UniqueName: \"kubernetes.io/projected/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kube-api-access-plb7l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468764 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468737 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468918 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.468981 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.468931 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.470653 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.470634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.471003 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.470986 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.477771 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.477750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plb7l\" (UniqueName: \"kubernetes.io/projected/3a1f37fd-4e89-4e1a-a060-9ad62978c9a1-kube-api-access-plb7l\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9\" (UID: \"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.553342 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.553276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:22.680902 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:22.680879 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9"] Jun 09 00:32:22.682558 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:32:22.682530 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1f37fd_4e89_4e1a_a060_9ad62978c9a1.slice/crio-6b8f783ed2493fb81e0b9a5de49da70a2dbd2db34f0b9f71a43cada666500cc3 WatchSource:0}: Error finding container 6b8f783ed2493fb81e0b9a5de49da70a2dbd2db34f0b9f71a43cada666500cc3: Status 404 returned error can't find the container with id 6b8f783ed2493fb81e0b9a5de49da70a2dbd2db34f0b9f71a43cada666500cc3 Jun 09 00:32:23.686634 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:23.686597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" event={"ID":"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1","Type":"ContainerStarted","Data":"6b8f783ed2493fb81e0b9a5de49da70a2dbd2db34f0b9f71a43cada666500cc3"} Jun 09 00:32:26.705063 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:26.705012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" event={"ID":"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1","Type":"ContainerStarted","Data":"707e3fe4940b34ada4ebdcd5e9a420a49a602758996530e8108322d238efd64a"} Jun 09 00:32:28.716572 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:28.716541 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1f37fd-4e89-4e1a-a060-9ad62978c9a1" containerID="707e3fe4940b34ada4ebdcd5e9a420a49a602758996530e8108322d238efd64a" exitCode=0 Jun 09 00:32:28.716901 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:28.716580 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" event={"ID":"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1","Type":"ContainerDied","Data":"707e3fe4940b34ada4ebdcd5e9a420a49a602758996530e8108322d238efd64a"} Jun 09 00:32:30.728536 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:30.728505 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" event={"ID":"3a1f37fd-4e89-4e1a-a060-9ad62978c9a1","Type":"ContainerStarted","Data":"783b1ee56e2154d6eec78cb7a28eae436178257591ed4a388a80c95e28c5e49a"} Jun 09 00:32:30.749772 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:30.749719 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" podStartSLOduration=2.329385463 podStartE2EDuration="8.749705754s" totalImagesPullingTime="5.01909696s" totalInitContainerRuntime="1.401223331s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:32:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:32:30.747303074 +0000 UTC m=+762.780399828" watchObservedRunningTime="2026-06-09 00:32:30.749705754 +0000 UTC m=+762.782802516" Jun 09 00:32:32.553557 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:32.553513 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:32.554001 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:32.553626 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:32.566631 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:32.566609 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:32.749661 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:32.749637 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9" Jun 09 00:32:33.910301 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:33.909134 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t"] Jun 09 00:32:33.915757 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:33.915723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:33.915907 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:33.915733 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t"] Jun 09 00:32:33.918126 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:33.917910 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 00:32:34.064572 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.064692 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.064692 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.064692 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h99bq\" (UniqueName: \"kubernetes.io/projected/19317e9b-90a7-4418-a6af-afe3283df2fd-kube-api-access-h99bq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.064807 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064697 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.064807 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.064733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19317e9b-90a7-4418-a6af-afe3283df2fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165636 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165636 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165802 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165802 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h99bq\" (UniqueName: \"kubernetes.io/projected/19317e9b-90a7-4418-a6af-afe3283df2fd-kube-api-access-h99bq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165802 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165787 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165947 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19317e9b-90a7-4418-a6af-afe3283df2fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.165997 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.165955 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.166074 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.166058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.166126 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.166105 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.167875 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.167847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19317e9b-90a7-4418-a6af-afe3283df2fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.168183 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.168164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19317e9b-90a7-4418-a6af-afe3283df2fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.173590 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.173573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h99bq\" (UniqueName: \"kubernetes.io/projected/19317e9b-90a7-4418-a6af-afe3283df2fd-kube-api-access-h99bq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t\" (UID: \"19317e9b-90a7-4418-a6af-afe3283df2fd\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.227191 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.227167 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:34.358318 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.358292 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t"] Jun 09 00:32:34.360002 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:32:34.359972 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19317e9b_90a7_4418_a6af_afe3283df2fd.slice/crio-1245e4db501cbb1784d9eea82dc1eadd0697537a5afe056bd8bb1f7bf73e18bd WatchSource:0}: Error finding container 1245e4db501cbb1784d9eea82dc1eadd0697537a5afe056bd8bb1f7bf73e18bd: Status 404 returned error can't find the container with id 1245e4db501cbb1784d9eea82dc1eadd0697537a5afe056bd8bb1f7bf73e18bd Jun 09 00:32:34.749904 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.749867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" event={"ID":"19317e9b-90a7-4418-a6af-afe3283df2fd","Type":"ContainerStarted","Data":"4ad2a6a35847b2ecba848f2e80efb24dad29f2e8fa144ef3c098a270a6a3081d"} Jun 09 00:32:34.750097 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:34.749918 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" event={"ID":"19317e9b-90a7-4418-a6af-afe3283df2fd","Type":"ContainerStarted","Data":"1245e4db501cbb1784d9eea82dc1eadd0697537a5afe056bd8bb1f7bf73e18bd"} Jun 09 00:32:35.756683 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:35.756655 2557 generic.go:356] "Generic (PLEG): container finished" podID="19317e9b-90a7-4418-a6af-afe3283df2fd" containerID="4ad2a6a35847b2ecba848f2e80efb24dad29f2e8fa144ef3c098a270a6a3081d" exitCode=0 Jun 09 00:32:35.756998 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:35.756743 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" event={"ID":"19317e9b-90a7-4418-a6af-afe3283df2fd","Type":"ContainerDied","Data":"4ad2a6a35847b2ecba848f2e80efb24dad29f2e8fa144ef3c098a270a6a3081d"} Jun 09 00:32:36.765057 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:36.765003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" event={"ID":"19317e9b-90a7-4418-a6af-afe3283df2fd","Type":"ContainerStarted","Data":"59143579789ba82bafa92d2c15b64cbd9c39fa83f48f8ed4939792004d6cb6bb"} Jun 09 00:32:36.782644 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:36.782598 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" podStartSLOduration=2.363318833 podStartE2EDuration="3.782584212s" totalImagesPullingTime="171.161858ms" totalInitContainerRuntime="1.248103521s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:32:36.781250631 +0000 UTC m=+768.814347393" watchObservedRunningTime="2026-06-09 00:32:36.782584212 +0000 UTC m=+768.815680973" Jun 09 00:32:44.227294 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:44.227260 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:44.227674 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:44.227328 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:44.239876 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:44.239858 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:44.826977 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:44.826950 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t" Jun 09 00:32:55.827192 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.827162 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf"] Jun 09 00:32:55.845408 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.845384 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf"] Jun 09 00:32:55.845552 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.845479 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.847841 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.847815 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 00:32:55.916284 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.916415 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916297 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.916415 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.916415 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.916544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0f04bf-972e-4986-8c99-3de1bde70655-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:55.916544 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:55.916451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhk2q\" (UniqueName: \"kubernetes.io/projected/fe0f04bf-972e-4986-8c99-3de1bde70655-kube-api-access-rhk2q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.016919 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.016887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.016924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.016948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.016986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0f04bf-972e-4986-8c99-3de1bde70655-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.017002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhk2q\" (UniqueName: \"kubernetes.io/projected/fe0f04bf-972e-4986-8c99-3de1bde70655-kube-api-access-rhk2q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017094 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.017051 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017376 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.017330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017433 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.017408 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.017494 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.017433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.019124 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.019097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0f04bf-972e-4986-8c99-3de1bde70655-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.019388 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.019372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0f04bf-972e-4986-8c99-3de1bde70655-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.023710 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.023686 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhk2q\" (UniqueName: \"kubernetes.io/projected/fe0f04bf-972e-4986-8c99-3de1bde70655-kube-api-access-rhk2q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf\" (UID: \"fe0f04bf-972e-4986-8c99-3de1bde70655\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.161125 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.161099 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:32:56.294633 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.294613 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf"] Jun 09 00:32:56.296600 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:32:56.296577 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0f04bf_972e_4986_8c99_3de1bde70655.slice/crio-7fdba6a8ff27353f7892795305f575bfaab3da620a4de9d9da6b78d4b784b7a6 WatchSource:0}: Error finding container 7fdba6a8ff27353f7892795305f575bfaab3da620a4de9d9da6b78d4b784b7a6: Status 404 returned error can't find the container with id 7fdba6a8ff27353f7892795305f575bfaab3da620a4de9d9da6b78d4b784b7a6 Jun 09 00:32:56.878341 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.878304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" event={"ID":"fe0f04bf-972e-4986-8c99-3de1bde70655","Type":"ContainerStarted","Data":"63bcbf8adfc130b55e2bd9a4dd5b0c0c23c7e16a3c2531e40f56a708af2ea558"} Jun 09 00:32:56.878720 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:56.878364 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" event={"ID":"fe0f04bf-972e-4986-8c99-3de1bde70655","Type":"ContainerStarted","Data":"7fdba6a8ff27353f7892795305f575bfaab3da620a4de9d9da6b78d4b784b7a6"} Jun 09 00:32:57.884468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:57.884400 2557 generic.go:356] "Generic (PLEG): container finished" podID="fe0f04bf-972e-4986-8c99-3de1bde70655" containerID="63bcbf8adfc130b55e2bd9a4dd5b0c0c23c7e16a3c2531e40f56a708af2ea558" exitCode=0 Jun 09 00:32:57.884841 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:57.884489 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" event={"ID":"fe0f04bf-972e-4986-8c99-3de1bde70655","Type":"ContainerDied","Data":"63bcbf8adfc130b55e2bd9a4dd5b0c0c23c7e16a3c2531e40f56a708af2ea558"} Jun 09 00:32:58.891115 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:58.891078 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" event={"ID":"fe0f04bf-972e-4986-8c99-3de1bde70655","Type":"ContainerStarted","Data":"89f3b67bb74cd2ad12205977f98e6cd604e225092d60da23689463ca72e7bb98"} Jun 09 00:32:58.911716 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:32:58.911669 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" podStartSLOduration=2.463903176 podStartE2EDuration="3.911651748s" totalImagesPullingTime="195.823728ms" totalInitContainerRuntime="1.251924844s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:32:58.909010413 +0000 UTC m=+790.942107175" watchObservedRunningTime="2026-06-09 00:32:58.911651748 +0000 UTC m=+790.944748509" Jun 09 00:33:06.161692 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:06.161652 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:33:06.162087 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:06.161726 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:33:06.174066 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:06.174043 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:33:06.942332 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:06.942304 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf" Jun 09 00:33:11.427391 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.427343 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t"] Jun 09 00:33:11.431447 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.431425 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.433728 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.433699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 00:33:11.440011 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.439984 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t"] Jun 09 00:33:11.525756 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ec6b91-2686-44a5-b332-180a8b0c30db-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.525908 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vbhq\" (UniqueName: \"kubernetes.io/projected/a0ec6b91-2686-44a5-b332-180a8b0c30db-kube-api-access-5vbhq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.525908 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.525996 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.525996 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525961 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.525996 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.525979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627058 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ec6b91-2686-44a5-b332-180a8b0c30db-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627192 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vbhq\" (UniqueName: \"kubernetes.io/projected/a0ec6b91-2686-44a5-b332-180a8b0c30db-kube-api-access-5vbhq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627192 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627321 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627321 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627321 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627552 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627620 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.627677 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.627631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.629429 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.629410 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0ec6b91-2686-44a5-b332-180a8b0c30db-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.629604 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.629585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ec6b91-2686-44a5-b332-180a8b0c30db-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.634322 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.634304 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vbhq\" (UniqueName: \"kubernetes.io/projected/a0ec6b91-2686-44a5-b332-180a8b0c30db-kube-api-access-5vbhq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t\" (UID: \"a0ec6b91-2686-44a5-b332-180a8b0c30db\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.743119 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.743057 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:11.877476 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.877454 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t"] Jun 09 00:33:11.879015 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:33:11.878985 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ec6b91_2686_44a5_b332_180a8b0c30db.slice/crio-eb66bd4788cf9a88d3f7050725be90eaa697fb324ec8a485c9a76c633b3f838b WatchSource:0}: Error finding container eb66bd4788cf9a88d3f7050725be90eaa697fb324ec8a485c9a76c633b3f838b: Status 404 returned error can't find the container with id eb66bd4788cf9a88d3f7050725be90eaa697fb324ec8a485c9a76c633b3f838b Jun 09 00:33:11.958004 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.957965 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" event={"ID":"a0ec6b91-2686-44a5-b332-180a8b0c30db","Type":"ContainerStarted","Data":"ad03093ecaa6b977232e6808749de51158e25b549d4614fe26fa2ed9f5653bd9"} Jun 09 00:33:11.958128 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:11.958044 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" event={"ID":"a0ec6b91-2686-44a5-b332-180a8b0c30db","Type":"ContainerStarted","Data":"eb66bd4788cf9a88d3f7050725be90eaa697fb324ec8a485c9a76c633b3f838b"} Jun 09 00:33:13.969659 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:13.969631 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0ec6b91-2686-44a5-b332-180a8b0c30db" containerID="ad03093ecaa6b977232e6808749de51158e25b549d4614fe26fa2ed9f5653bd9" exitCode=0 Jun 09 00:33:13.970043 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:13.969706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" event={"ID":"a0ec6b91-2686-44a5-b332-180a8b0c30db","Type":"ContainerDied","Data":"ad03093ecaa6b977232e6808749de51158e25b549d4614fe26fa2ed9f5653bd9"} Jun 09 00:33:14.976920 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:14.976885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" event={"ID":"a0ec6b91-2686-44a5-b332-180a8b0c30db","Type":"ContainerStarted","Data":"88fcf14e0281994e4f091e5dfa3255a4f24e04ba6a959c961dd5002ede6d45e3"} Jun 09 00:33:14.994537 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:14.994484 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" podStartSLOduration=2.398505742 podStartE2EDuration="3.994470129s" totalImagesPullingTime="178.659208ms" totalInitContainerRuntime="1.417305179s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:33:14.992991663 +0000 UTC m=+807.026088426" watchObservedRunningTime="2026-06-09 00:33:14.994470129 +0000 UTC m=+807.027566890" Jun 09 00:33:21.744108 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:21.744072 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:21.744523 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:21.744133 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:21.756891 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:21.756870 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:33:22.026380 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:33:22.026309 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t" Jun 09 00:34:48.430272 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:34:48.430241 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:34:48.432069 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:34:48.432034 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:36:49.141743 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.141708 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:36:49.142257 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.141897 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-669887cd7b-srngz" podUID="50620182-eb6b-4492-8145-8b29ced27a32" containerName="manager" containerID="cri-o://9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612" gracePeriod=30 Jun 09 00:36:49.397382 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.397331 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:36:49.462951 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.462923 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qct9l\" (UniqueName: \"kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l\") pod \"50620182-eb6b-4492-8145-8b29ced27a32\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " Jun 09 00:36:49.463102 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.462974 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert\") pod \"50620182-eb6b-4492-8145-8b29ced27a32\" (UID: \"50620182-eb6b-4492-8145-8b29ced27a32\") " Jun 09 00:36:49.464916 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.464885 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l" (OuterVolumeSpecName: "kube-api-access-qct9l") pod "50620182-eb6b-4492-8145-8b29ced27a32" (UID: "50620182-eb6b-4492-8145-8b29ced27a32"). InnerVolumeSpecName "kube-api-access-qct9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:36:49.464916 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.464899 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "50620182-eb6b-4492-8145-8b29ced27a32" (UID: "50620182-eb6b-4492-8145-8b29ced27a32"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:36:49.564314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.564291 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qct9l\" (UniqueName: \"kubernetes.io/projected/50620182-eb6b-4492-8145-8b29ced27a32-kube-api-access-qct9l\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:36:49.564314 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:49.564312 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50620182-eb6b-4492-8145-8b29ced27a32-webhook-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\"" Jun 09 00:36:50.087854 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.087824 2557 generic.go:356] "Generic (PLEG): container finished" podID="50620182-eb6b-4492-8145-8b29ced27a32" containerID="9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612" exitCode=0 Jun 09 00:36:50.087990 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.087867 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-srngz" Jun 09 00:36:50.087990 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.087884 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-srngz" event={"ID":"50620182-eb6b-4492-8145-8b29ced27a32","Type":"ContainerDied","Data":"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612"} Jun 09 00:36:50.087990 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.087927 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-srngz" event={"ID":"50620182-eb6b-4492-8145-8b29ced27a32","Type":"ContainerDied","Data":"20b2fda6061b006aa10da416cf9d37defa19e35f27f26e73b8730456b3b2bf19"} Jun 09 00:36:50.087990 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.087949 2557 scope.go:117] "RemoveContainer" containerID="9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612" Jun 09 00:36:50.097763 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.097746 2557 scope.go:117] "RemoveContainer" containerID="9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612" Jun 09 00:36:50.097997 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:36:50.097979 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612\": container with ID starting with 9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612 not found: ID does not exist" containerID="9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612" Jun 09 00:36:50.098066 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.098006 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612"} err="failed to get container status \"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612\": rpc error: code = NotFound desc = could not find container \"9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612\": container with ID starting with 9a9c370bb833015269bcb31e7d29308bdf3fb2c2d065e0e01acec7180211a612 not found: ID does not exist" Jun 09 00:36:50.107915 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.107890 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:36:50.113694 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.113673 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-669887cd7b-srngz"] Jun 09 00:36:50.420565 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.420541 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50620182-eb6b-4492-8145-8b29ced27a32" path="/var/lib/kubelet/pods/50620182-eb6b-4492-8145-8b29ced27a32/volumes" Jun 09 00:36:50.883662 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.883627 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669887cd7b-gtjnc"] Jun 09 00:36:50.884059 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.884039 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50620182-eb6b-4492-8145-8b29ced27a32" containerName="manager" Jun 09 00:36:50.884146 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.884062 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="50620182-eb6b-4492-8145-8b29ced27a32" containerName="manager" Jun 09 00:36:50.884206 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.884172 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="50620182-eb6b-4492-8145-8b29ced27a32" containerName="manager" Jun 09 00:36:50.888462 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.888443 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:50.891526 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.891484 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 00:36:50.891773 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.891751 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sxhdq\"" Jun 09 00:36:50.891880 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.891805 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 00:36:50.894400 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.894377 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669887cd7b-gtjnc"] Jun 09 00:36:50.972561 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.972540 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfvr\" (UniqueName: \"kubernetes.io/projected/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-kube-api-access-dpfvr\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:50.972664 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:50.972591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-webhook-cert\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.073571 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.073547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfvr\" (UniqueName: \"kubernetes.io/projected/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-kube-api-access-dpfvr\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.073671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.073597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-webhook-cert\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.075926 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.075908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-webhook-cert\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.081063 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.081044 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfvr\" (UniqueName: \"kubernetes.io/projected/ac4e698f-87b1-4e72-b3bf-c4c2919c7af6-kube-api-access-dpfvr\") pod \"maas-controller-669887cd7b-gtjnc\" (UID: \"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6\") " pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.199638 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.199576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:36:51.323726 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.323698 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669887cd7b-gtjnc"] Jun 09 00:36:51.325860 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:36:51.325836 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4e698f_87b1_4e72_b3bf_c4c2919c7af6.slice/crio-0f07ac119ee657fea161e3c71985cfd48706cded4ffbf0ae1416f50216217dd4 WatchSource:0}: Error finding container 0f07ac119ee657fea161e3c71985cfd48706cded4ffbf0ae1416f50216217dd4: Status 404 returned error can't find the container with id 0f07ac119ee657fea161e3c71985cfd48706cded4ffbf0ae1416f50216217dd4 Jun 09 00:36:51.327569 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:51.327552 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:36:52.102953 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:52.102922 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-gtjnc" event={"ID":"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6","Type":"ContainerStarted","Data":"eea29bb917298db66f30b046b1a6e23bb883323ab562a76216e438bf09d2cd2e"} Jun 09 00:36:52.103379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:52.102969 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669887cd7b-gtjnc" event={"ID":"ac4e698f-87b1-4e72-b3bf-c4c2919c7af6","Type":"ContainerStarted","Data":"0f07ac119ee657fea161e3c71985cfd48706cded4ffbf0ae1416f50216217dd4"} Jun 09 00:36:52.103379 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:36:52.103063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:37:03.114466 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:37:03.114437 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669887cd7b-gtjnc" Jun 09 00:37:03.132470 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:37:03.132424 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669887cd7b-gtjnc" podStartSLOduration=12.688814194 podStartE2EDuration="13.132407557s" totalImagesPullingTime="443.593363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:36:52.117435792 +0000 UTC m=+1024.150532554" watchObservedRunningTime="2026-06-09 00:37:03.132407557 +0000 UTC m=+1035.165504319" Jun 09 00:39:48.460943 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:39:48.460914 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:39:48.467468 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:39:48.467447 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:44:48.490440 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:44:48.490402 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:44:48.498157 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:44:48.498135 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:49:48.520477 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:49:48.520451 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:49:48.528875 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:49:48.528853 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:54:48.562339 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:54:48.562312 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:54:48.567514 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:54:48.567495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:57:48.625721 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.625685 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f"] Jun 09 00:57:48.631711 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.631622 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.638395 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.638354 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f"] Jun 09 00:57:48.731071 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.731043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8l2h\" (UniqueName: \"kubernetes.io/projected/20b7364a-0abb-4ee3-b42b-8462df18adf7-kube-api-access-f8l2h\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.731212 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.731175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20b7364a-0abb-4ee3-b42b-8462df18adf7-maas-api-tls\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.832410 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.832383 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20b7364a-0abb-4ee3-b42b-8462df18adf7-maas-api-tls\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.832563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.832415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8l2h\" (UniqueName: \"kubernetes.io/projected/20b7364a-0abb-4ee3-b42b-8462df18adf7-kube-api-access-f8l2h\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.834900 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.834868 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20b7364a-0abb-4ee3-b42b-8462df18adf7-maas-api-tls\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.840748 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.840722 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8l2h\" (UniqueName: \"kubernetes.io/projected/20b7364a-0abb-4ee3-b42b-8462df18adf7-kube-api-access-f8l2h\") pod \"maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f\" (UID: \"20b7364a-0abb-4ee3-b42b-8462df18adf7\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:48.946504 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:48.946440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:49.090794 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:49.090769 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f"] Jun 09 00:57:49.092771 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:57:49.092746 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b7364a_0abb_4ee3_b42b_8462df18adf7.slice/crio-921812c86a6400e9035b2734aa15dbca3efaf2b7f3ebaa631cd619a4cb034516 WatchSource:0}: Error finding container 921812c86a6400e9035b2734aa15dbca3efaf2b7f3ebaa631cd619a4cb034516: Status 404 returned error can't find the container with id 921812c86a6400e9035b2734aa15dbca3efaf2b7f3ebaa631cd619a4cb034516 Jun 09 00:57:49.094477 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:49.094456 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:57:49.645367 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:49.645334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerStarted","Data":"921812c86a6400e9035b2734aa15dbca3efaf2b7f3ebaa631cd619a4cb034516"} Jun 09 00:57:50.652170 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:50.652140 2557 generic.go:356] "Generic (PLEG): container finished" podID="20b7364a-0abb-4ee3-b42b-8462df18adf7" containerID="f6260894da7e6cde0044b8bcf6d67f47dec14fa4d1c968f5f350ec4e86004882" exitCode=1 Jun 09 00:57:50.652539 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:50.652228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerDied","Data":"f6260894da7e6cde0044b8bcf6d67f47dec14fa4d1c968f5f350ec4e86004882"} Jun 09 00:57:50.652539 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:50.652351 2557 scope.go:117] "RemoveContainer" containerID="f6260894da7e6cde0044b8bcf6d67f47dec14fa4d1c968f5f350ec4e86004882" Jun 09 00:57:51.658917 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:51.658843 2557 generic.go:356] "Generic (PLEG): container finished" podID="20b7364a-0abb-4ee3-b42b-8462df18adf7" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" exitCode=1 Jun 09 00:57:51.659263 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:51.658936 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerDied","Data":"8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d"} Jun 09 00:57:51.659263 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:51.658992 2557 scope.go:117] "RemoveContainer" containerID="f6260894da7e6cde0044b8bcf6d67f47dec14fa4d1c968f5f350ec4e86004882" Jun 09 00:57:51.659263 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:51.659130 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:57:51.659403 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:57:51.659325 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:57:52.665799 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:52.665772 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:57:52.666171 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:57:52.665940 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:57:53.947171 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:53.947143 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:53.947531 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:53.947446 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:57:53.947608 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:57:53.947590 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:57:58.946638 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:58.946611 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:57:58.947219 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:57:58.946966 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:57:58.947219 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:57:58.947179 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:01.165688 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.165639 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29"] Jun 09 00:58:01.168978 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.168949 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.180322 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.180297 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29"] Jun 09 00:58:01.329931 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.329859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4df84e5d-29d4-4f36-98b7-443f57843d01-maas-api-tls\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.330093 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.329987 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trh5t\" (UniqueName: \"kubernetes.io/projected/4df84e5d-29d4-4f36-98b7-443f57843d01-kube-api-access-trh5t\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.430735 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.430703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trh5t\" (UniqueName: \"kubernetes.io/projected/4df84e5d-29d4-4f36-98b7-443f57843d01-kube-api-access-trh5t\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.430861 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.430741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4df84e5d-29d4-4f36-98b7-443f57843d01-maas-api-tls\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.433162 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.433140 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4df84e5d-29d4-4f36-98b7-443f57843d01-maas-api-tls\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.437605 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.437586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trh5t\" (UniqueName: \"kubernetes.io/projected/4df84e5d-29d4-4f36-98b7-443f57843d01-kube-api-access-trh5t\") pod \"maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29\" (UID: \"4df84e5d-29d4-4f36-98b7-443f57843d01\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.482889 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.482864 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:01.628966 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.628932 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29"] Jun 09 00:58:01.630647 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:58:01.630613 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df84e5d_29d4_4f36_98b7_443f57843d01.slice/crio-3c63965e1cf4b8cf140b51736f5427f9e59b8323fbae534a1d29af8525e3085a WatchSource:0}: Error finding container 3c63965e1cf4b8cf140b51736f5427f9e59b8323fbae534a1d29af8525e3085a: Status 404 returned error can't find the container with id 3c63965e1cf4b8cf140b51736f5427f9e59b8323fbae534a1d29af8525e3085a Jun 09 00:58:01.713626 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:01.713588 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerStarted","Data":"3c63965e1cf4b8cf140b51736f5427f9e59b8323fbae534a1d29af8525e3085a"} Jun 09 00:58:02.720392 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:02.720361 2557 generic.go:356] "Generic (PLEG): container finished" podID="4df84e5d-29d4-4f36-98b7-443f57843d01" containerID="63b3140223c5a6b00c8647fe37bb682fe3d059c9c711ab87408290e4d04f0da5" exitCode=1 Jun 09 00:58:02.720752 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:02.720445 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerDied","Data":"63b3140223c5a6b00c8647fe37bb682fe3d059c9c711ab87408290e4d04f0da5"} Jun 09 00:58:02.720752 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:02.720616 2557 scope.go:117] "RemoveContainer" containerID="63b3140223c5a6b00c8647fe37bb682fe3d059c9c711ab87408290e4d04f0da5" Jun 09 00:58:03.728036 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:03.728004 2557 generic.go:356] "Generic (PLEG): container finished" podID="4df84e5d-29d4-4f36-98b7-443f57843d01" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" exitCode=1 Jun 09 00:58:03.728426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:03.728059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerDied","Data":"f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4"} Jun 09 00:58:03.728426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:03.728129 2557 scope.go:117] "RemoveContainer" containerID="63b3140223c5a6b00c8647fe37bb682fe3d059c9c711ab87408290e4d04f0da5" Jun 09 00:58:03.728426 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:03.728335 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:03.728581 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:03.728520 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:04.735577 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:04.735503 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:04.735991 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:04.735760 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:06.483520 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:06.483490 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:06.483863 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:06.483789 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:06.483963 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:06.483942 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:11.486051 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:11.486000 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:11.487204 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:11.487177 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:11.487478 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:11.487452 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:13.414271 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:13.414244 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:58:13.785909 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:13.785878 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerStarted","Data":"06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb"} Jun 09 00:58:13.786175 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:13.786147 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:58:13.801516 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:13.801475 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podStartSLOduration=24.620137911 podStartE2EDuration="25.801463476s" totalImagesPullingTime="1.181325565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:57:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:13.800701728 +0000 UTC m=+2305.833798490" watchObservedRunningTime="2026-06-09 00:58:13.801463476 +0000 UTC m=+2305.834560237" Jun 09 00:58:14.792478 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:14.792439 2557 generic.go:356] "Generic (PLEG): container finished" podID="20b7364a-0abb-4ee3-b42b-8462df18adf7" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" exitCode=1 Jun 09 00:58:14.792872 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:14.792478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerDied","Data":"06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb"} Jun 09 00:58:14.792872 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:14.792531 2557 scope.go:117] "RemoveContainer" containerID="8fa8a0e196c38ba8f1a81c04dbe66c3a8bcf887c8754353b11c3cd3dfb8b7b5d" Jun 09 00:58:14.792872 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:14.792691 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:14.792996 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:14.792881 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:15.798790 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:15.798761 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:15.799241 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:15.798971 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:18.946737 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:18.946702 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:58:18.947210 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:18.947147 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:18.947367 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:18.947344 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:22.414564 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:22.414538 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:22.838353 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:22.838329 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerStarted","Data":"340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9"} Jun 09 00:58:22.838593 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:22.838574 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:22.855502 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:22.855459 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podStartSLOduration=21.009550677 podStartE2EDuration="21.855446444s" totalImagesPullingTime="845.895767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:58:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:22.854541497 +0000 UTC m=+2314.887638260" watchObservedRunningTime="2026-06-09 00:58:22.855446444 +0000 UTC m=+2314.888543206" Jun 09 00:58:23.845179 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:23.845146 2557 generic.go:356] "Generic (PLEG): container finished" podID="4df84e5d-29d4-4f36-98b7-443f57843d01" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" exitCode=1 Jun 09 00:58:23.845563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:23.845227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerDied","Data":"340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9"} Jun 09 00:58:23.845563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:23.845287 2557 scope.go:117] "RemoveContainer" containerID="f02b35a16ed06817b8a4ccd699a7c6b3a7e516dba303c1a3ac30375615b349e4" Jun 09 00:58:23.845563 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:23.845380 2557 scope.go:117] "RemoveContainer" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" Jun 09 00:58:23.845563 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:23.845553 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:24.852215 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:24.852188 2557 scope.go:117] "RemoveContainer" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" Jun 09 00:58:24.852573 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:24.852359 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:25.101042 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.100996 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64c7bc99c9-l8gqm_74550ebb-4fb3-4a58-852a-b8e0b9644c93/nginx/0.log" Jun 09 00:58:25.208718 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.208662 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hmb2q_b9c3d83e-99eb-405b-b80b-8c8c6843c214/manager/0.log" Jun 09 00:58:25.322999 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.322976 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2zlcc_6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2/manager/0.log" Jun 09 00:58:25.438450 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.438432 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669887cd7b-gtjnc_ac4e698f-87b1-4e72-b3bf-c4c2919c7af6/manager/0.log" Jun 09 00:58:25.582209 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.582162 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b4cg8_530c7e52-2172-4001-9508-39b8fe5d4a82/server/0.log" Jun 09 00:58:25.700118 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.700100 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-sfd9r_ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836/manager/0.log" Jun 09 00:58:25.836986 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.836936 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-45sjc_17a3e53a-198e-479b-acc4-43702f32b59b/copy-manifests/0.log" Jun 09 00:58:25.843464 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:25.843445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-45sjc_17a3e53a-198e-479b-acc4-43702f32b59b/manager/0.log" Jun 09 00:58:27.745209 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:27.745142 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2zgzn_3a5cfe9e-2f9a-4c33-a418-9d1444191bbb/kuadrant-console-plugin/0.log" Jun 09 00:58:28.215084 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:28.215054 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68dqs_a85b4cdc-6161-48b8-9dbd-cb13e1d020da/manager/0.log" Jun 09 00:58:28.677127 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:28.677097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9zcpk_25d8103b-7973-49b6-98a9-f78d98df329f/discovery/0.log" Jun 09 00:58:28.897447 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:28.897425 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cb979fbc-s5dkn_f7c83cae-d340-4cec-9d70-0862b63ff099/kube-auth-proxy/0.log" Jun 09 00:58:29.478842 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.478817 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9_3a1f37fd-4e89-4e1a-a060-9ad62978c9a1/storage-initializer/0.log" Jun 09 00:58:29.486805 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.486785 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rh8l9_3a1f37fd-4e89-4e1a-a060-9ad62978c9a1/main/0.log" Jun 09 00:58:29.713328 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.713306 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t_19317e9b-90a7-4418-a6af-afe3283df2fd/storage-initializer/0.log" Jun 09 00:58:29.720181 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.720161 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-2968t_19317e9b-90a7-4418-a6af-afe3283df2fd/main/0.log" Jun 09 00:58:29.831868 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.831818 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf_fe0f04bf-972e-4986-8c99-3de1bde70655/storage-initializer/0.log" Jun 09 00:58:29.838671 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.838655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5wmmf_fe0f04bf-972e-4986-8c99-3de1bde70655/main/0.log" Jun 09 00:58:29.951666 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.951644 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t_a0ec6b91-2686-44a5-b332-180a8b0c30db/storage-initializer/0.log" Jun 09 00:58:29.959755 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:29.959738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4sp4t_a0ec6b91-2686-44a5-b332-180a8b0c30db/main/0.log" Jun 09 00:58:31.414600 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:31.414575 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:31.414951 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:31.414735 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:31.483320 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:31.483297 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:31.483578 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:31.483564 2557 scope.go:117] "RemoveContainer" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" Jun 09 00:58:31.483716 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:31.483697 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:36.928015 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:36.927983 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5854h_a6b5c674-712e-4301-9527-ea6b6bb97348/global-pull-secret-syncer/0.log" Jun 09 00:58:37.081991 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:37.081960 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gtv8r_d6e602c6-0d6c-4b36-a4d3-74f4e5cdbf14/konnectivity-agent/0.log" Jun 09 00:58:37.180141 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:37.180060 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-64.ec2.internal_464bdd4c02355b35b4e35ac2feecd187/haproxy/0.log" Jun 09 00:58:39.785240 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:39.785211 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-dsp4d_d932a0d5-2d04-4e83-989a-0f87111a7e91/sail-operator/0.log" Jun 09 00:58:42.651013 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:42.650986 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2zgzn_3a5cfe9e-2f9a-4c33-a418-9d1444191bbb/kuadrant-console-plugin/0.log" Jun 09 00:58:42.872040 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:42.872001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68dqs_a85b4cdc-6161-48b8-9dbd-cb13e1d020da/manager/0.log" Jun 09 00:58:43.415047 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:43.415002 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:43.956033 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:43.955990 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerStarted","Data":"ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6"} Jun 09 00:58:43.956348 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:43.956199 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:58:44.513335 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.513310 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7j7h4_48e1705d-da49-42e6-8feb-7654e7329553/node-exporter/0.log" Jun 09 00:58:44.533891 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.533871 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7j7h4_48e1705d-da49-42e6-8feb-7654e7329553/kube-rbac-proxy/0.log" Jun 09 00:58:44.555766 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.555744 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7j7h4_48e1705d-da49-42e6-8feb-7654e7329553/init-textfile/0.log" Jun 09 00:58:44.963036 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.962999 2557 generic.go:356] "Generic (PLEG): container finished" podID="20b7364a-0abb-4ee3-b42b-8462df18adf7" containerID="ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6" exitCode=1 Jun 09 00:58:44.963398 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.963083 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" event={"ID":"20b7364a-0abb-4ee3-b42b-8462df18adf7","Type":"ContainerDied","Data":"ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6"} Jun 09 00:58:44.963398 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.963134 2557 scope.go:117] "RemoveContainer" containerID="06b19a17731152b7cba69b1c4180c27ccaa0715ce37c24284f04ba2d996155cb" Jun 09 00:58:44.963398 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:44.963313 2557 scope.go:117] "RemoveContainer" containerID="ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6" Jun 09 00:58:44.963551 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:44.963508 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:45.970588 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:45.970561 2557 scope.go:117] "RemoveContainer" containerID="ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6" Jun 09 00:58:45.970973 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:45.970731 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:46.414861 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:46.414829 2557 scope.go:117] "RemoveContainer" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" Jun 09 00:58:46.982944 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:46.982868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerStarted","Data":"cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09"} Jun 09 00:58:46.983367 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:46.983100 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:47.536584 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:47.536562 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77986bbc94-jr4cd_dd6bb196-8b04-48ad-9532-983d6988e005/console/0.log" Jun 09 00:58:47.990008 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:47.989980 2557 generic.go:356] "Generic (PLEG): container finished" podID="4df84e5d-29d4-4f36-98b7-443f57843d01" containerID="cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09" exitCode=1 Jun 09 00:58:47.990460 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:47.990059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" event={"ID":"4df84e5d-29d4-4f36-98b7-443f57843d01","Type":"ContainerDied","Data":"cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09"} Jun 09 00:58:47.990460 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:47.990116 2557 scope.go:117] "RemoveContainer" containerID="340bb100e0a40c38a7ceb897fe73d591a3371a3a1ecc04b285d09d24cfe68fe9" Jun 09 00:58:47.990460 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:47.990312 2557 scope.go:117] "RemoveContainer" containerID="cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09" Jun 09 00:58:47.990625 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:47.990531 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:48.658548 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.658515 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz"] Jun 09 00:58:48.661818 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.661797 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.663959 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.663943 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc7xn\"/\"kube-root-ca.crt\"" Jun 09 00:58:48.664051 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.663986 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc7xn\"/\"openshift-service-ca.crt\"" Jun 09 00:58:48.664585 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.664570 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mc7xn\"/\"default-dockercfg-x5l9b\"" Jun 09 00:58:48.668885 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.668800 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz"] Jun 09 00:58:48.829188 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.829159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-proc\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.829290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.829199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-sys\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.829290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.829229 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-lib-modules\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.829366 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.829286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbxwz\" (UniqueName: \"kubernetes.io/projected/739d7994-43d0-4ebf-9d76-aa84fbab429d-kube-api-access-sbxwz\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.829366 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.829308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-podres\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930647 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-proc\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930647 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-sys\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930657 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-lib-modules\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-proc\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-sys\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930752 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-lib-modules\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930767 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930740 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxwz\" (UniqueName: \"kubernetes.io/projected/739d7994-43d0-4ebf-9d76-aa84fbab429d-kube-api-access-sbxwz\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930940 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-podres\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.930940 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.930871 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739d7994-43d0-4ebf-9d76-aa84fbab429d-podres\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.938892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.938865 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbxwz\" (UniqueName: \"kubernetes.io/projected/739d7994-43d0-4ebf-9d76-aa84fbab429d-kube-api-access-sbxwz\") pod \"perf-node-gather-daemonset-rh5sz\" (UID: \"739d7994-43d0-4ebf-9d76-aa84fbab429d\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.946729 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.946707 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" Jun 09 00:58:48.947011 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.946999 2557 scope.go:117] "RemoveContainer" containerID="ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6" Jun 09 00:58:48.947187 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:48.947170 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:58:48.973328 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.973311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:48.999014 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:48.998995 2557 scope.go:117] "RemoveContainer" containerID="cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09" Jun 09 00:58:48.999402 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:48.999185 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:49.104219 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:49.104187 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz"] Jun 09 00:58:49.105624 ip-10-0-143-64 kubenswrapper[2557]: W0609 00:58:49.105597 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod739d7994_43d0_4ebf_9d76_aa84fbab429d.slice/crio-74fc9fbc601590e80b7c9c0edfc4afe91287dc7893ee918952845a5c2a3c1103 WatchSource:0}: Error finding container 74fc9fbc601590e80b7c9c0edfc4afe91287dc7893ee918952845a5c2a3c1103: Status 404 returned error can't find the container with id 74fc9fbc601590e80b7c9c0edfc4afe91287dc7893ee918952845a5c2a3c1103 Jun 09 00:58:49.533243 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:49.533217 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46p6k_b8c5627a-fd6d-460d-8a79-be70d444d52b/dns/0.log" Jun 09 00:58:49.553464 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:49.553447 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46p6k_b8c5627a-fd6d-460d-8a79-be70d444d52b/kube-rbac-proxy/0.log" Jun 09 00:58:49.656644 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:49.656623 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6gnf4_38611a13-6d81-46c4-acf8-a0aeacff9be9/dns-node-resolver/0.log" Jun 09 00:58:50.005161 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:50.005133 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" event={"ID":"739d7994-43d0-4ebf-9d76-aa84fbab429d","Type":"ContainerStarted","Data":"903c59e88c80649b7da06fd0b2285185e5e6bfa736bdc09221490c2175f68d5d"} Jun 09 00:58:50.005509 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:50.005184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" event={"ID":"739d7994-43d0-4ebf-9d76-aa84fbab429d","Type":"ContainerStarted","Data":"74fc9fbc601590e80b7c9c0edfc4afe91287dc7893ee918952845a5c2a3c1103"} Jun 09 00:58:50.005509 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:50.005286 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:50.020813 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:50.020771 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" podStartSLOduration=2.020756973 podStartE2EDuration="2.020756973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:50.019303462 +0000 UTC m=+2342.052400224" watchObservedRunningTime="2026-06-09 00:58:50.020756973 +0000 UTC m=+2342.053853734" Jun 09 00:58:50.265319 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:50.265237 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nsw6_f4ddab19-0527-4ca4-ba15-00e20df9e14a/node-ca/0.log" Jun 09 00:58:51.209188 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:51.209123 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9zcpk_25d8103b-7973-49b6-98a9-f78d98df329f/discovery/0.log" Jun 09 00:58:51.253837 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:51.253815 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cb979fbc-s5dkn_f7c83cae-d340-4cec-9d70-0862b63ff099/kube-auth-proxy/0.log" Jun 09 00:58:51.484144 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:51.484077 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" Jun 09 00:58:51.484413 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:51.484401 2557 scope.go:117] "RemoveContainer" containerID="cb2e7006e483f3abb6172f3e13d2be5fb7f7a73d6d31a18144202c68008cbc09" Jun 09 00:58:51.484560 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:58:51.484542 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29_redhat-ai-gateway-infra(4df84e5d-29d4-4f36-98b7-443f57843d01)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-c658b559-5f7bf8d656-5fw29" podUID="4df84e5d-29d4-4f36-98b7-443f57843d01" Jun 09 00:58:51.905014 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:51.904968 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgzfk_bd2eff74-5a71-4257-98fe-372e69274d94/serve-healthcheck-canary/0.log" Jun 09 00:58:52.439575 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:52.439517 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7snmp_553f3c5f-1187-4a71-9943-26484a044a3e/insights-operator/0.log" Jun 09 00:58:52.440890 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:52.440869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7snmp_553f3c5f-1187-4a71-9943-26484a044a3e/insights-operator/1.log" Jun 09 00:58:52.576537 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:52.576518 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzg9l_27294eb4-0292-48cd-a373-b8056ce6c157/kube-rbac-proxy/0.log" Jun 09 00:58:52.595057 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:52.594995 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzg9l_27294eb4-0292-48cd-a373-b8056ce6c157/exporter/0.log" Jun 09 00:58:52.613830 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:52.613811 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzg9l_27294eb4-0292-48cd-a373-b8056ce6c157/extractor/0.log" Jun 09 00:58:54.653045 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.653002 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64c7bc99c9-l8gqm_74550ebb-4fb3-4a58-852a-b8e0b9644c93/nginx/0.log" Jun 09 00:58:54.675825 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.675799 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hmb2q_b9c3d83e-99eb-405b-b80b-8c8c6843c214/manager/0.log" Jun 09 00:58:54.756789 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.756765 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2zlcc_6d1ed5c6-495e-4ad4-bbfc-aef4b993f4a2/manager/0.log" Jun 09 00:58:54.825180 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.825160 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669887cd7b-gtjnc_ac4e698f-87b1-4e72-b3bf-c4c2919c7af6/manager/0.log" Jun 09 00:58:54.843364 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.843343 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b4cg8_530c7e52-2172-4001-9508-39b8fe5d4a82/server/0.log" Jun 09 00:58:54.900750 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.900728 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-sfd9r_ee1fe3f7-e5d2-43a9-8383-cc20ebbe3836/manager/0.log" Jun 09 00:58:54.920892 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.920828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-45sjc_17a3e53a-198e-479b-acc4-43702f32b59b/manager/0.log" Jun 09 00:58:54.940358 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:54.940338 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-45sjc_17a3e53a-198e-479b-acc4-43702f32b59b/copy-manifests/0.log" Jun 09 00:58:56.027206 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:56.027182 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-rh5sz" Jun 09 00:58:56.636832 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:58:56.636807 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gjqkz_9bd4642a-9761-488b-977e-c7fe40142a85/openshift-lws-operator/0.log" Jun 09 00:59:00.872965 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:00.872936 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9zcpk_25d8103b-7973-49b6-98a9-f78d98df329f/discovery/0.log" Jun 09 00:59:00.913290 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:00.913269 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cb979fbc-s5dkn_f7c83cae-d340-4cec-9d70-0862b63ff099/kube-auth-proxy/0.log" Jun 09 00:59:01.414673 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:01.414649 2557 scope.go:117] "RemoveContainer" containerID="ae158c1ceceb73e1650e924cb94866091d62edda55177dfff5bc5e23fb6fe9b6" Jun 09 00:59:01.414855 ip-10-0-143-64 kubenswrapper[2557]: E0609 00:59:01.414834 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f_redhat-ai-gateway-infra(20b7364a-0abb-4ee3-b42b-8462df18adf7)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-9920d9f4-674f59d87d-bv27f" podUID="20b7364a-0abb-4ee3-b42b-8462df18adf7" Jun 09 00:59:02.121935 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:02.121907 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9zcpk_25d8103b-7973-49b6-98a9-f78d98df329f/discovery/0.log" Jun 09 00:59:02.156696 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:02.156671 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cb979fbc-s5dkn_f7c83cae-d340-4cec-9d70-0862b63ff099/kube-auth-proxy/0.log" Jun 09 00:59:03.726606 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.726578 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/kube-multus-additional-cni-plugins/0.log" Jun 09 00:59:03.744973 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.744946 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/egress-router-binary-copy/0.log" Jun 09 00:59:03.762849 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.762827 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/cni-plugins/0.log" Jun 09 00:59:03.780940 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.780918 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/bond-cni-plugin/0.log" Jun 09 00:59:03.800985 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.800962 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/routeoverride-cni/0.log" Jun 09 00:59:03.819913 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.819894 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/whereabouts-cni-bincopy/0.log" Jun 09 00:59:03.838370 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.838355 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rxcqj_853488b5-5daa-4681-b1c4-47a4f2572bcd/whereabouts-cni/0.log" Jun 09 00:59:03.881664 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.881647 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9zcpk_25d8103b-7973-49b6-98a9-f78d98df329f/discovery/0.log" Jun 09 00:59:03.901680 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.899111 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mcksm_b295cec4-98da-4da3-9241-f65da92ea4d4/kube-multus/0.log" Jun 09 00:59:03.903300 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:03.903278 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56cb979fbc-s5dkn_f7c83cae-d340-4cec-9d70-0862b63ff099/kube-auth-proxy/0.log" Jun 09 00:59:04.049190 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:04.049126 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxsfk_f5708cea-7f0f-4176-947d-721399db9e83/network-metrics-daemon/0.log" Jun 09 00:59:04.067571 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:04.067549 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxsfk_f5708cea-7f0f-4176-947d-721399db9e83/kube-rbac-proxy/0.log" Jun 09 00:59:05.024562 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.024529 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-controller/0.log" Jun 09 00:59:05.040614 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.040569 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/1.log" Jun 09 00:59:05.040614 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.040596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovn-acl-logging/0.log" Jun 09 00:59:05.060210 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.060180 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/kube-rbac-proxy-node/0.log" Jun 09 00:59:05.079333 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.079313 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 00:59:05.096285 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.096267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/northd/0.log" Jun 09 00:59:05.114343 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.114324 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/nbdb/0.log" Jun 09 00:59:05.134214 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.134189 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/sbdb/0.log" Jun 09 00:59:05.176626 ip-10-0-143-64 kubenswrapper[2557]: I0609 00:59:05.176608 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-96krg_43252a7c-f346-47c5-a53c-e0a0c54caed9/ovnkube-controller/0.log"