Jun 09 23:43:24.511018 ip-10-0-129-49 systemd[1]: Starting Kubernetes Kubelet... Jun 09 23:43:24.961553 ip-10-0-129-49 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 23:43:24.961553 ip-10-0-129-49 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 23:43:24.961553 ip-10-0-129-49 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 23:43:24.961553 ip-10-0-129-49 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 23:43:24.961553 ip-10-0-129-49 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 23:43:24.962692 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.962584 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 23:43:24.968353 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968337 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.968353 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968352 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968356 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968360 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968363 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968366 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968369 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968371 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968377 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968381 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968384 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968386 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968389 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968392 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968394 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968397 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968400 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968402 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968405 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968413 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.968418 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968416 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968419 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968422 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968425 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968428 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968431 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968434 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968436 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968439 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968441 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968444 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968447 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968449 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968452 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968454 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968457 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968460 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968462 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968465 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968467 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.968889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968470 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968472 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968475 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968478 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968480 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968483 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968485 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968488 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968492 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968494 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968497 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968499 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968502 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968504 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968507 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968510 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968513 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968516 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968518 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968521 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.969361 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968523 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968527 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968531 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968534 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968537 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968540 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968542 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968545 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968547 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968550 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968552 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968555 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968557 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968562 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968565 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968568 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968571 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968575 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968577 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.969865 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968580 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968583 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968586 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968589 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968591 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968594 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968597 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968602 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968605 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968608 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968621 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968625 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968627 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968630 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968633 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968635 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968638 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968641 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968644 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.968646 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.970319 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969359 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969366 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969369 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969373 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969375 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969380 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969384 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969387 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969390 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969393 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969396 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969399 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969402 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969405 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969407 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969410 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969413 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969415 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969418 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.970812 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969421 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969424 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969427 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969429 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969432 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969434 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969437 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969439 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969443 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969445 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969447 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969450 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969453 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969455 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969458 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969460 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969462 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969465 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969467 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969470 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.971376 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969472 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969476 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969480 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969483 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969485 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969488 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969492 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969494 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969497 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969500 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969503 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969505 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969509 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969511 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969514 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969516 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969519 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969521 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969524 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969526 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.971895 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969529 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969532 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969534 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969538 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969542 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969545 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969548 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969551 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969553 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969556 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969558 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969560 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969563 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969566 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969568 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969571 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969574 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969576 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969579 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969583 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.972401 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969586 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969589 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969591 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969594 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969598 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969600 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969603 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969605 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969608 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969625 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969628 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969631 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969634 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969636 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969639 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969642 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969645 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969647 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969650 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.972923 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.969652 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970008 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970013 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970016 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970019 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970022 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970024 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970027 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970030 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970032 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970035 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970041 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970044 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970047 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970049 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970052 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970055 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970058 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970060 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970063 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.973384 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970065 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970069 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970073 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970075 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970078 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970081 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970083 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970086 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970088 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970091 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970094 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970098 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970101 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970104 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970107 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970110 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970113 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970116 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970118 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.973876 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970121 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970124 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970126 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970130 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970133 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970137 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970140 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970143 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970148 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970151 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970154 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970157 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970159 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970162 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970165 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970168 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970171 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970173 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970176 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.974370 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970181 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970184 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970187 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970190 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970192 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970195 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970197 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970200 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970203 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970205 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970208 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970210 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970213 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970215 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970218 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970221 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970224 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970232 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970235 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.974862 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970237 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970240 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970243 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970246 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970248 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970251 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970253 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970256 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970258 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970261 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970264 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970266 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970269 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970271 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970274 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970276 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970279 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970281 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970284 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970286 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.975355 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970289 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970362 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970369 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970376 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970380 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970383 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970386 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970390 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970394 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970398 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970406 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970411 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970414 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970417 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970421 2576 flags.go:64] FLAG: --cgroup-root="" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970424 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970427 2576 flags.go:64] FLAG: --client-ca-file="" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970430 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970433 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970437 2576 flags.go:64] FLAG: --cluster-domain="" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970439 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970443 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970446 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970449 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 23:43:24.975863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970453 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970456 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970459 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970462 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970465 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970468 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970471 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970474 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970477 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970481 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970484 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970487 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970490 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970493 2576 flags.go:64] FLAG: --enable-server="true" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970495 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970500 2576 flags.go:64] FLAG: --event-burst="100" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970503 2576 flags.go:64] FLAG: --event-qps="50" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970506 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970513 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970517 2576 flags.go:64] FLAG: --eviction-hard="" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970521 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970524 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970527 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970530 2576 flags.go:64] FLAG: --eviction-soft="" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970533 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 23:43:24.976437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970536 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970539 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970542 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970545 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970547 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970551 2576 flags.go:64] FLAG: --feature-gates="" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970554 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970557 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970560 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970563 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970566 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970569 2576 flags.go:64] FLAG: --help="false" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970572 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-129-49.ec2.internal" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970575 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970578 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970581 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970585 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970588 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970591 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970594 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970596 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970599 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970602 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970605 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 23:43:24.977075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970608 2576 flags.go:64] FLAG: --kube-reserved="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970626 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970629 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970632 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970635 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970638 2576 flags.go:64] FLAG: --lock-file="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970641 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970644 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970647 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970652 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970655 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970658 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970661 2576 flags.go:64] FLAG: --logging-format="text" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970663 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970667 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970670 2576 flags.go:64] FLAG: --manifest-url="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970673 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970677 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970680 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970684 2576 flags.go:64] FLAG: --max-pods="110" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970687 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970690 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970693 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970696 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970698 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 23:43:24.977726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970701 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970704 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970711 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970714 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970717 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970720 2576 flags.go:64] FLAG: --pod-cidr="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970723 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970727 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970732 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970736 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970739 2576 flags.go:64] FLAG: --port="10250" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970742 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970745 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03550fa3fc31bd2ba" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970749 2576 flags.go:64] FLAG: --qos-reserved="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970752 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970755 2576 flags.go:64] FLAG: --register-node="true" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970758 2576 flags.go:64] FLAG: --register-with-taints="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970762 2576 flags.go:64] FLAG: --registry-burst="10" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970765 2576 flags.go:64] FLAG: --registry-qps="5" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970768 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970770 2576 flags.go:64] FLAG: --reserved-memory="" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970774 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970777 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970780 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970784 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 23:43:24.978369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970786 2576 flags.go:64] FLAG: --runonce="false" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970789 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970792 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970795 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970798 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970801 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970803 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970806 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970809 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970812 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970815 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970818 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970821 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970824 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970828 2576 flags.go:64] FLAG: --system-cgroups="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970832 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970839 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970842 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970844 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970848 2576 flags.go:64] FLAG: --tls-min-version="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970854 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970857 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970861 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970863 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970866 2576 flags.go:64] FLAG: --v="2" Jun 09 23:43:24.978998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970870 2576 flags.go:64] FLAG: --version="false" Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970874 2576 flags.go:64] FLAG: --vmodule="" Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970878 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.970881 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.970997 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971002 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971005 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971008 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971011 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971013 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971016 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971019 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971022 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971026 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971029 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971032 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971035 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971038 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971042 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.979599 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971044 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971047 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971050 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971054 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971059 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971061 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971065 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971068 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971070 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971078 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971081 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971084 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971087 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971089 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971092 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971094 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971097 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971100 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971103 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971105 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.980111 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971108 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971111 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971113 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971116 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971118 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971122 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971125 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971129 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971131 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971134 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971137 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971139 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971142 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971144 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971147 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971151 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971160 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971163 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971167 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.980596 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971170 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971173 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971176 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971187 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971190 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971192 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971195 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971198 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971200 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971203 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971205 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971208 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971211 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971214 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971216 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971219 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971221 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971224 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971226 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971229 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.981085 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971231 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971234 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971237 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971239 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971242 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971244 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971247 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971249 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971254 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971258 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971261 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971263 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971266 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971268 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971271 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971274 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971282 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971285 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971287 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.981568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971290 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971293 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971295 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971298 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971300 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.971303 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.972060 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.979066 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.979080 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.979931 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.979938 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980004 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980009 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980013 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980016 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.982061 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980019 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980022 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980025 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980028 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980030 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980033 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980036 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980038 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980041 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980044 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980046 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980049 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980051 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980054 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980057 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980062 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980066 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980069 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980072 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.982438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980075 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980079 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980082 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980085 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980089 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980092 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980095 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980099 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980101 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980104 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980107 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980110 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980112 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980116 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980118 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980121 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980124 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980126 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980129 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980136 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.982908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980139 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980141 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980144 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980147 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980150 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980153 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980155 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980158 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980169 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980172 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980174 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980177 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980180 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980183 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980186 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980188 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980191 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980193 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980197 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980200 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.983393 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980203 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980206 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980208 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980211 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980213 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980216 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980218 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980221 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980223 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980226 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980229 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980232 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980234 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980237 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980240 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980242 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980245 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980247 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980250 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980252 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.983951 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980255 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980263 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980266 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980269 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980272 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980274 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980277 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980280 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980283 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980285 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980289 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980291 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980295 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980298 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980302 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.984438 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980304 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.980309 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980461 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980466 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980470 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980473 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980476 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980479 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980481 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980484 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980487 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980489 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980492 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980495 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 23:43:24.984930 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980497 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980500 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980502 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980505 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980508 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980516 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980519 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980521 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980524 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980526 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980529 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980531 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980534 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980536 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980539 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980541 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980544 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980547 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980549 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980552 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 23:43:24.985422 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980554 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980557 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980559 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980562 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980564 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980566 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980569 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980571 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980574 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980577 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980579 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980581 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980590 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980592 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980595 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980598 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980602 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980606 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980631 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980634 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 23:43:24.985973 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980637 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980640 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980642 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980645 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980647 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980650 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980653 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980655 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980658 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980661 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980663 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980665 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980668 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980671 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980673 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980676 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980678 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980681 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980683 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980686 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 23:43:24.986568 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980688 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980691 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980694 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980697 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980701 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980704 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980706 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980709 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980712 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980715 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980718 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980726 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980730 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980732 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980735 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980738 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980741 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980744 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980746 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980749 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 23:43:24.987059 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980752 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980754 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980757 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980760 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980762 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980766 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:24.980769 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.980774 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.980868 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.983265 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.985015 2576 server.go:1019] "Starting client certificate rotation" Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.985145 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 23:43:24.987779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.985195 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 23:43:24.988290 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.988235 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 23:43:24.991823 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:24.991749 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 23:43:25.001938 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.001920 2576 log.go:25] "Validated CRI v1 runtime API" Jun 09 23:43:25.006142 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.006129 2576 log.go:25] "Validated CRI v1 image API" Jun 09 23:43:25.006897 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.006882 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 23:43:25.010095 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.010076 2576 fs.go:135] Filesystem UUIDs: map[218ddf29-f7f3-4c45-b9a5-757cdb0e376d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de0166c1-9171-4b5e-b943-1281f527d42d:/dev/nvme0n1p4] Jun 09 23:43:25.010145 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.010095 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 23:43:25.016715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.016580 2576 manager.go:216] Machine: {Timestamp:2026-06-09 23:43:25.014626763 +0000 UTC m=+0.373748126 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100232 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20fe05fe006cbece95ecdc1ef19f97 SystemUUID:ec20fe05-fe00-6cbe-ce95-ecdc1ef19f97 BootID:0c4561f8-4883-40b4-9131-b2d11c4103c6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:25:81:e2:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:25:81:e2:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:7b:58:50:69:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 23:43:25.016715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.016714 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 23:43:25.016821 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.016743 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 23:43:25.016821 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.016789 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 23:43:25.020675 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.020646 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 23:43:25.020806 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.020678 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 23:43:25.022016 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.022005 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 23:43:25.022054 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.022018 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 23:43:25.022054 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.022026 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 23:43:25.022802 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.022792 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 23:43:25.023695 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.023686 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 23:43:25.027487 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027476 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 23:43:25.027599 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027590 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 23:43:25.027655 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027632 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 09 23:43:25.027655 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027642 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 23:43:25.027655 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027654 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 23:43:25.027753 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027663 2576 kubelet.go:398] "Adding apiserver pod source" Jun 09 23:43:25.027753 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.027672 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 23:43:25.028035 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.028012 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 23:43:25.028091 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.028047 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 23:43:25.030877 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.030861 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 23:43:25.033093 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.033080 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 23:43:25.033153 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.033110 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 23:43:25.034470 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034453 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 23:43:25.034523 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034484 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 23:43:25.034523 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034497 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 23:43:25.034523 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034507 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034528 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034556 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034577 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034588 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034598 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 23:43:25.034630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034606 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 23:43:25.034780 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034641 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 23:43:25.034780 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.034650 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 23:43:25.036988 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.036973 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 23:43:25.036988 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.036987 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 23:43:25.038885 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.038651 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 23:43:25.039019 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.038511 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 23:43:25.039019 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.038934 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 23:43:25.040962 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.040946 2576 server.go:1268] "Started kubelet" Jun 09 23:43:25.041103 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.041035 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 23:43:25.041183 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.041053 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 23:43:25.041302 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.041280 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 23:43:25.041810 ip-10-0-129-49 systemd[1]: Started Kubernetes Kubelet. Jun 09 23:43:25.042296 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.042281 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 09 23:43:25.043250 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.043234 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 23:43:25.049777 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.049756 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 23:43:25.052783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.052765 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 23:43:25.052783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.052779 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 23:43:25.052918 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.052875 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.053581 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.053534 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 23:43:25.053581 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.053563 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 23:43:25.053711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.053598 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 23:43:25.053826 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.053777 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 09 23:43:25.053826 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.053812 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 09 23:43:25.055437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.055418 2576 factory.go:55] Registering systemd factory Jun 09 23:43:25.055437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.055439 2576 factory.go:223] Registration of the systemd container factory successfully Jun 09 23:43:25.055994 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.055979 2576 factory.go:153] Registering CRI-O factory Jun 09 23:43:25.056107 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.056082 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 23:43:25.056107 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.056090 2576 factory.go:223] Registration of the crio container factory successfully Jun 09 23:43:25.056254 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.056149 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 23:43:25.056254 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.056167 2576 factory.go:103] Registering Raw factory Jun 09 23:43:25.056254 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.056176 2576 manager.go:1196] Started watching for new ooms in manager Jun 09 23:43:25.056254 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.056182 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 23:43:25.056659 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.056644 2576 manager.go:349] Starting recovery of all containers Jun 09 23:43:25.057269 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.057236 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zsnz" Jun 09 23:43:25.057570 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.055952 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-49.ec2.internal.18b78e45172b1a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-49.ec2.internal,UID:ip-10-0-129-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-49.ec2.internal,},FirstTimestamp:2026-06-09 23:43:25.040908913 +0000 UTC m=+0.400030279,LastTimestamp:2026-06-09 23:43:25.040908913 +0000 UTC m=+0.400030279,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-49.ec2.internal,}" Jun 09 23:43:25.065744 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.065562 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zsnz" Jun 09 23:43:25.067422 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.067402 2576 manager.go:354] Recovery completed Jun 09 23:43:25.071951 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.071937 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.073949 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.073927 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.074020 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.073954 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.074020 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.073964 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.074431 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.074420 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 23:43:25.074431 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.074430 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 23:43:25.074547 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.074434 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.074547 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.074446 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 23:43:25.075125 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.075103 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.075202 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.075147 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.075202 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.075161 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.075344 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.075279 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-49.ec2.internal.18b78e45192323d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-49.ec2.internal,UID:ip-10-0-129-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-49.ec2.internal,},FirstTimestamp:2026-06-09 23:43:25.073941459 +0000 UTC m=+0.433062822,LastTimestamp:2026-06-09 23:43:25.073941459 +0000 UTC m=+0.433062822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-49.ec2.internal,}" Jun 09 23:43:25.076305 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.076291 2576 policy_none.go:49] "None policy: Start" Jun 09 23:43:25.076361 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.076308 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 23:43:25.076361 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.076319 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 23:43:25.077872 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.077862 2576 policy_none.go:47] "Start" Jun 09 23:43:25.117228 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117210 2576 manager.go:337] "Starting Device Plugin manager" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.117250 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117263 2576 server.go:87] "Starting device plugin registration server" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117523 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117535 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117609 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117697 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.117706 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.118347 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.118387 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.130582 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.131685 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.131716 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.131746 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.131776 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 23:43:25.138370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.133975 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:25.218275 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.218194 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.219159 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.219141 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.219240 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.219172 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.219240 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.219182 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.219240 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.219206 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.228304 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.228285 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.228398 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.228312 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-49.ec2.internal\": node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.232177 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.232157 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal"] Jun 09 23:43:25.232246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.232226 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.233004 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.232994 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.233053 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.233020 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.233053 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.233034 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.235319 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235307 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.235465 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.235499 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235480 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.235964 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235947 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.236025 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235973 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.236025 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235984 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.236025 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.235955 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.236121 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.236049 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.236121 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.236060 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.238091 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.238071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.238188 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.238099 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 23:43:25.238755 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.238740 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientMemory" Jun 09 23:43:25.238846 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.238766 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 23:43:25.238846 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.238779 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeHasSufficientPID" Jun 09 23:43:25.252669 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.252650 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.254711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.254695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385455ab1c70eb0efa9ea54b12a6ae04-config\") pod \"kube-apiserver-proxy-ip-10-0-129-49.ec2.internal\" (UID: \"385455ab1c70eb0efa9ea54b12a6ae04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.254770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.254719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.254770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.254735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.258201 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.258183 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-49.ec2.internal\" not found" node="ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.262399 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.262383 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-49.ec2.internal\" not found" node="ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.352749 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.352713 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.354920 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.354897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.354998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.354929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.354998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.354968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385455ab1c70eb0efa9ea54b12a6ae04-config\") pod \"kube-apiserver-proxy-ip-10-0-129-49.ec2.internal\" (UID: \"385455ab1c70eb0efa9ea54b12a6ae04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.355067 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.355002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.355067 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.355017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385455ab1c70eb0efa9ea54b12a6ae04-config\") pod \"kube-apiserver-proxy-ip-10-0-129-49.ec2.internal\" (UID: \"385455ab1c70eb0efa9ea54b12a6ae04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.355067 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.355010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc8d58c2dda6f4cbe2e979f0cd76c4c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal\" (UID: \"fc8d58c2dda6f4cbe2e979f0cd76c4c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.453127 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.453085 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.553804 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.553734 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.564053 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.564035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.568770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.568722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:25.654333 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.654296 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.754747 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.754714 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.855259 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.855222 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.865286 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.865268 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:25.955790 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:25.955755 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:25.984067 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.984040 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 23:43:25.984711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.984177 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 23:43:25.984711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:25.984214 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 23:43:26.056716 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:26.056688 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-49.ec2.internal\" not found" Jun 09 23:43:26.070459 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.070424 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 23:38:25 +0000 UTC" deadline="2028-01-02 07:46:21.192606078 +0000 UTC" Jun 09 23:43:26.070459 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.070457 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13712h2m55.122153856s" Jun 09 23:43:26.095276 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.095245 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:26.153152 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.153129 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" Jun 09 23:43:26.163883 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:26.163853 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385455ab1c70eb0efa9ea54b12a6ae04.slice/crio-70f580c2e3a81f2e8097aaebe89d5a833177d7fc9d6e5df47f4afc531c72abe1 WatchSource:0}: Error finding container 70f580c2e3a81f2e8097aaebe89d5a833177d7fc9d6e5df47f4afc531c72abe1: Status 404 returned error can't find the container with id 70f580c2e3a81f2e8097aaebe89d5a833177d7fc9d6e5df47f4afc531c72abe1 Jun 09 23:43:26.164547 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:26.164524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8d58c2dda6f4cbe2e979f0cd76c4c9.slice/crio-e2ecc29f5800e9472432f45f98d64249fb1d98d368e96c7cfa9600dfa955cf02 WatchSource:0}: Error finding container e2ecc29f5800e9472432f45f98d64249fb1d98d368e96c7cfa9600dfa955cf02: Status 404 returned error can't find the container with id e2ecc29f5800e9472432f45f98d64249fb1d98d368e96c7cfa9600dfa955cf02 Jun 09 23:43:26.165785 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.165767 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 23:43:26.168316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.168301 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" Jun 09 23:43:26.171369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.171351 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 23:43:26.176143 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.176124 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 23:43:26.360063 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:26.360023 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:27.028824 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.028790 2576 apiserver.go:52] "Watching apiserver" Jun 09 23:43:27.039369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.039209 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 23:43:27.039697 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.039660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-tg6jt","openshift-network-operator/iptables-alerter-j5qsp","openshift-ovn-kubernetes/ovnkube-node-np5kc","kube-system/global-pull-secret-syncer-4j6k5","kube-system/konnectivity-agent-x57mv","openshift-dns/node-resolver-fjmnv","openshift-image-registry/node-ca-8slhs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal","openshift-multus/multus-65mjc","openshift-multus/multus-additional-cni-plugins-t9x7j","openshift-network-diagnostics/network-check-target-n8xh2","kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs","openshift-cluster-node-tuning-operator/tuned-cfjkn"] Jun 09 23:43:27.042220 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.042189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.044243 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.044181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.044735 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.044712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.044833 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.044806 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 23:43:27.044979 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.044963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.044979 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.044978 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wxqzt\"" Jun 09 23:43:27.046453 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.046430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.046856 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.046838 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.046968 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.046838 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 23:43:27.047389 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.047368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2tv2n\"" Jun 09 23:43:27.047500 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.047485 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.048660 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.048639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.048764 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.048714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:27.048896 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.048837 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.049188 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.049025 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6gs9b\"" Jun 09 23:43:27.049188 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.049168 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 23:43:27.050344 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.050323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 23:43:27.050442 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.050368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 23:43:27.050442 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.050426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.050554 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.050514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 23:43:27.051397 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.051146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.053802 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.053211 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 23:43:27.053922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.053902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 23:43:27.053922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.053916 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-22t8t\"" Jun 09 23:43:27.054051 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.053936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 23:43:27.054105 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.054053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.056027 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.056012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.056637 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.056594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.056784 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.056719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nhxgb\"" Jun 09 23:43:27.056871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.056810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.058173 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.058148 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.058626 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.058589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.058770 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.058748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:27.059985 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.059965 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 23:43:27.060080 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.060038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.061198 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.061175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 23:43:27.061287 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.061252 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zrrpv\"" Jun 09 23:43:27.061790 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.061733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.062804 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.062895 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/556c0f7e-3955-4a32-b08e-7e04de7b4372-hosts-file\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.062895 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5kk\" (UniqueName: \"kubernetes.io/projected/556c0f7e-3955-4a32-b08e-7e04de7b4372-kube-api-access-jz5kk\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.062895 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063052 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-cnibin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063052 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-systemd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063052 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.062984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-multus\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063052 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-env-overrides\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-kubelet\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-etc-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-system-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-socket-dir-parent\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-registration-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.063540 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.063540 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-netns\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063540 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-script-lib\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063540 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.063752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skdn\" (UniqueName: \"kubernetes.io/projected/868d602a-3793-45a2-8d87-d50fa47547e0-kube-api-access-9skdn\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.063752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-kubelet-config\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.063752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-konnectivity-ca\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.063752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-netd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.063752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-os-release\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pfp\" (UniqueName: \"kubernetes.io/projected/77b207e4-a982-46ff-937e-53d11364acf5-kube-api-access-k5pfp\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-multus-certs\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd746\" (UniqueName: \"kubernetes.io/projected/18479d69-08da-4dfd-9cd0-fb4d907b4eea-kube-api-access-jd746\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.063990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-k8s-cni-cncf-io\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.063990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.063939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-netns\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-multus-daemon-config\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-sys-fs\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-systemd-units\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-log-socket\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovn-node-metrics-cert\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556c0f7e-3955-4a32-b08e-7e04de7b4372-tmp-dir\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.064280 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-bin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-bin\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-conf-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-node-log\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-config\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18479d69-08da-4dfd-9cd0-fb4d907b4eea-serviceca\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064443 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-socket-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4sv\" (UniqueName: \"kubernetes.io/projected/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-kube-api-access-6k4sv\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-etc-kubernetes\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-device-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-kubelet\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-slash\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.064720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-var-lib-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jbf6t\"" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-hostroot\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18479d69-08da-4dfd-9cd0-fb4d907b4eea-host\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-dbus\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-ovn\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.064983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-cni-binary-copy\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.065429 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.065014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-agent-certs\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.066203 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.066179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.067795 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.068876 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.069081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.069237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.069263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d6bdt\"" Jun 09 23:43:27.069760 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.069311 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:27.072333 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.072313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.074702 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.074683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 23:43:27.074785 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.074712 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vxd5m\"" Jun 09 23:43:27.074869 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.074849 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 23:43:27.082230 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.082203 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5w4x6" Jun 09 23:43:27.089201 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.089180 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5w4x6" Jun 09 23:43:27.136899 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.136819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" event={"ID":"fc8d58c2dda6f4cbe2e979f0cd76c4c9","Type":"ContainerStarted","Data":"e2ecc29f5800e9472432f45f98d64249fb1d98d368e96c7cfa9600dfa955cf02"} Jun 09 23:43:27.138171 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.138144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" event={"ID":"385455ab1c70eb0efa9ea54b12a6ae04","Type":"ContainerStarted","Data":"70f580c2e3a81f2e8097aaebe89d5a833177d7fc9d6e5df47f4afc531c72abe1"} Jun 09 23:43:27.155041 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.155015 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 23:43:27.165542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqm72\" (UniqueName: \"kubernetes.io/projected/455627c2-b5fd-4a95-8422-e80284d142ce-kube-api-access-dqm72\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.165542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-etc-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-system-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-socket-dir-parent\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-etc-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-registration-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysconfig\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-socket-dir-parent\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-tmp\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.165741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-system-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9d9\" (UniqueName: \"kubernetes.io/projected/6b817d8f-af6e-4dfc-9f92-967a550a7b02-kube-api-access-rh9d9\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-registration-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-os-release\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.165788 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-netns\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.165864 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:27.665828568 +0000 UTC m=+3.024949923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-netns\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-script-lib\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skdn\" (UniqueName: \"kubernetes.io/projected/868d602a-3793-45a2-8d87-d50fa47547e0-kube-api-access-9skdn\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-kubelet-config\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.165977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-konnectivity-ca\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-netd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-os-release\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-kubelet-config\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.166284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pfp\" (UniqueName: \"kubernetes.io/projected/77b207e4-a982-46ff-937e-53d11364acf5-kube-api-access-k5pfp\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-netd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40a65396-2d1f-496b-be08-b75b0530f72c-iptables-alerter-script\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-os-release\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-multus-certs\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd746\" (UniqueName: \"kubernetes.io/projected/18479d69-08da-4dfd-9cd0-fb4d907b4eea-kube-api-access-jd746\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-multus-certs\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-tuned\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-k8s-cni-cncf-io\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-k8s-cni-cncf-io\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-konnectivity-ca\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-conf\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-netns\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-multus-daemon-config\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-sys-fs\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-script-lib\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-run-netns\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-host\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-systemd-units\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.166906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-sys-fs\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-log-socket\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovn-node-metrics-cert\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-log-socket\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167023 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-systemd-units\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556c0f7e-3955-4a32-b08e-7e04de7b4372-tmp-dir\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-bin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-run\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-var-lib-kubelet\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-bin\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167153 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-bin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.167898 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-conf-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-cni-bin\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-node-log\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-config\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-conf-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-node-log\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18479d69-08da-4dfd-9cd0-fb4d907b4eea-serviceca\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-socket-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167330 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/556c0f7e-3955-4a32-b08e-7e04de7b4372-tmp-dir\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-multus-daemon-config\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-socket-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-kubernetes\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-systemd\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4sv\" (UniqueName: \"kubernetes.io/projected/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-kube-api-access-6k4sv\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-etc-kubernetes\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.168609 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18479d69-08da-4dfd-9cd0-fb4d907b4eea-serviceca\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.167796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovnkube-config\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-device-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-etc-kubernetes\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-device-dir\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qhl\" (UniqueName: \"kubernetes.io/projected/5ecb1451-a42f-4114-b21f-345c7226ab22-kube-api-access-j2qhl\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-modprobe-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-kubelet\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-slash\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-var-lib-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-kubelet\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-hostroot\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-slash\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-hostroot\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-var-lib-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18479d69-08da-4dfd-9cd0-fb4d907b4eea-host\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18479d69-08da-4dfd-9cd0-fb4d907b4eea-host\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.169460 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-dbus\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9mh8\" (UniqueName: \"kubernetes.io/projected/40a65396-2d1f-496b-be08-b75b0530f72c-kube-api-access-g9mh8\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868d602a-3793-45a2-8d87-d50fa47547e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-ovn\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-cni-binary-copy\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-agent-certs\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-system-cni-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-ovn\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-dbus\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/556c0f7e-3955-4a32-b08e-7e04de7b4372-hosts-file\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/556c0f7e-3955-4a32-b08e-7e04de7b4372-hosts-file\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.168976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-openvswitch\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5kk\" (UniqueName: \"kubernetes.io/projected/556c0f7e-3955-4a32-b08e-7e04de7b4372-kube-api-access-jz5kk\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-cnibin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-sys\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-lib-modules\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.170239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-systemd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b207e4-a982-46ff-937e-53d11364acf5-cni-binary-copy\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-multus\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-run-systemd\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a65396-2d1f-496b-be08-b75b0530f72c-host-slash\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-multus-cni-dir\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-cnibin\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-cnibin\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-cni-multus\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-env-overrides\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-host-run-ovn-kubernetes\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-kubelet\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77b207e4-a982-46ff-937e-53d11364acf5-host-var-lib-kubelet\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.170825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.169914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-env-overrides\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.171456 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.170855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-ovn-node-metrics-cert\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.171456 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.171399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e20bcd2-f0b6-4100-b093-5dfdd61ad04d-agent-certs\") pod \"konnectivity-agent-x57mv\" (UID: \"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d\") " pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.173662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.173544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skdn\" (UniqueName: \"kubernetes.io/projected/868d602a-3793-45a2-8d87-d50fa47547e0-kube-api-access-9skdn\") pod \"aws-ebs-csi-driver-node-sl7xs\" (UID: \"868d602a-3793-45a2-8d87-d50fa47547e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.174492 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.174419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd746\" (UniqueName: \"kubernetes.io/projected/18479d69-08da-4dfd-9cd0-fb4d907b4eea-kube-api-access-jd746\") pod \"node-ca-8slhs\" (UID: \"18479d69-08da-4dfd-9cd0-fb4d907b4eea\") " pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.176265 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.174757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pfp\" (UniqueName: \"kubernetes.io/projected/77b207e4-a982-46ff-937e-53d11364acf5-kube-api-access-k5pfp\") pod \"multus-65mjc\" (UID: \"77b207e4-a982-46ff-937e-53d11364acf5\") " pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.176340 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.176311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4sv\" (UniqueName: \"kubernetes.io/projected/f9d46f66-24ee-4b59-8b95-68cff3d0f6db-kube-api-access-6k4sv\") pod \"ovnkube-node-np5kc\" (UID: \"f9d46f66-24ee-4b59-8b95-68cff3d0f6db\") " pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.177761 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.176707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5kk\" (UniqueName: \"kubernetes.io/projected/556c0f7e-3955-4a32-b08e-7e04de7b4372-kube-api-access-jz5kk\") pod \"node-resolver-fjmnv\" (UID: \"556c0f7e-3955-4a32-b08e-7e04de7b4372\") " pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.270325 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270325 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqm72\" (UniqueName: \"kubernetes.io/projected/455627c2-b5fd-4a95-8422-e80284d142ce-kube-api-access-dqm72\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysconfig\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-tmp\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9d9\" (UniqueName: \"kubernetes.io/projected/6b817d8f-af6e-4dfc-9f92-967a550a7b02-kube-api-access-rh9d9\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-os-release\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysconfig\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40a65396-2d1f-496b-be08-b75b0530f72c-iptables-alerter-script\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.270505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-os-release\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-tuned\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-conf\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-host\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-run\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.270849 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-var-lib-kubelet\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-sysctl-conf\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-kubernetes\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270968 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.270984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-systemd\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qhl\" (UniqueName: \"kubernetes.io/projected/5ecb1451-a42f-4114-b21f-345c7226ab22-kube-api-access-j2qhl\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-modprobe-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.271072 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9mh8\" (UniqueName: \"kubernetes.io/projected/40a65396-2d1f-496b-be08-b75b0530f72c-kube-api-access-g9mh8\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-system-cni-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.271147 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:27.771125033 +0000 UTC m=+3.130246402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-system-cni-dir\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-sys\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-host\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271211 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-lib-modules\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-kubernetes\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-systemd\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a65396-2d1f-496b-be08-b75b0530f72c-host-slash\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a65396-2d1f-496b-be08-b75b0530f72c-host-slash\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-cnibin\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-modprobe-d\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-run\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/455627c2-b5fd-4a95-8422-e80284d142ce-cnibin\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40a65396-2d1f-496b-be08-b75b0530f72c-iptables-alerter-script\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-sys\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-var-lib-kubelet\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b817d8f-af6e-4dfc-9f92-967a550a7b02-lib-modules\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.271908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.272275 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.271935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/455627c2-b5fd-4a95-8422-e80284d142ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.272900 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.272879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-etc-tuned\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.273034 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.273016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b817d8f-af6e-4dfc-9f92-967a550a7b02-tmp\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.277245 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.277220 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:27.277346 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.277251 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:27.277346 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.277268 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:27.277471 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.277348 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:27.77732903 +0000 UTC m=+3.136450385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:27.279431 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.279354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqm72\" (UniqueName: \"kubernetes.io/projected/455627c2-b5fd-4a95-8422-e80284d142ce-kube-api-access-dqm72\") pod \"multus-additional-cni-plugins-t9x7j\" (UID: \"455627c2-b5fd-4a95-8422-e80284d142ce\") " pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.280025 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.279990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9d9\" (UniqueName: \"kubernetes.io/projected/6b817d8f-af6e-4dfc-9f92-967a550a7b02-kube-api-access-rh9d9\") pod \"tuned-cfjkn\" (UID: \"6b817d8f-af6e-4dfc-9f92-967a550a7b02\") " pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.280232 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.280213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9mh8\" (UniqueName: \"kubernetes.io/projected/40a65396-2d1f-496b-be08-b75b0530f72c-kube-api-access-g9mh8\") pod \"iptables-alerter-j5qsp\" (UID: \"40a65396-2d1f-496b-be08-b75b0530f72c\") " pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.280394 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.280378 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qhl\" (UniqueName: \"kubernetes.io/projected/5ecb1451-a42f-4114-b21f-345c7226ab22-kube-api-access-j2qhl\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.354477 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.354440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8slhs" Jun 09 23:43:27.361846 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.361821 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:27.362822 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.362803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" Jun 09 23:43:27.374676 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.374651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:27.379534 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.379512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:27.386232 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.386211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjmnv" Jun 09 23:43:27.393811 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.393788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65mjc" Jun 09 23:43:27.401375 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.401350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5qsp" Jun 09 23:43:27.409230 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.409212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" Jun 09 23:43:27.415813 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.415794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" Jun 09 23:43:27.673012 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.672977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:27.673199 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.673144 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:27.673257 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.673221 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:28.673204754 +0000 UTC m=+4.032326108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:27.773589 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.773550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:27.773770 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.773729 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:27.773824 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.773795 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:28.773780386 +0000 UTC m=+4.132901742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:27.874501 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:27.874465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:27.874696 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.874671 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:27.874696 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.874697 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:27.874803 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.874709 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:27.874803 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:27.874772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:28.874756654 +0000 UTC m=+4.233878026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:27.972316 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:27.972290 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a65396_2d1f_496b_be08_b75b0530f72c.slice/crio-d26a12892fe73749fe8c5127ddc48d6116b92e5e57817134803a9c194e13acf0 WatchSource:0}: Error finding container d26a12892fe73749fe8c5127ddc48d6116b92e5e57817134803a9c194e13acf0: Status 404 returned error can't find the container with id d26a12892fe73749fe8c5127ddc48d6116b92e5e57817134803a9c194e13acf0 Jun 09 23:43:27.992595 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:27.992564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868d602a_3793_45a2_8d87_d50fa47547e0.slice/crio-d15af28656389083f43b4ff600219bf60ded303121296aef8cf88be0612c5d20 WatchSource:0}: Error finding container d15af28656389083f43b4ff600219bf60ded303121296aef8cf88be0612c5d20: Status 404 returned error can't find the container with id d15af28656389083f43b4ff600219bf60ded303121296aef8cf88be0612c5d20 Jun 09 23:43:27.993122 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:27.993065 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455627c2_b5fd_4a95_8422_e80284d142ce.slice/crio-3e7cf4aa54d21e11250adf83b826a3da15f276c062563449cbf1af1f4e6c53fc WatchSource:0}: Error finding container 3e7cf4aa54d21e11250adf83b826a3da15f276c062563449cbf1af1f4e6c53fc: Status 404 returned error can't find the container with id 3e7cf4aa54d21e11250adf83b826a3da15f276c062563449cbf1af1f4e6c53fc Jun 09 23:43:27.997206 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:27.997186 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b207e4_a982_46ff_937e_53d11364acf5.slice/crio-e425b5a0136557e962d102278a0540a0b4ba64332ed9e2c4248b1bef77f6d455 WatchSource:0}: Error finding container e425b5a0136557e962d102278a0540a0b4ba64332ed9e2c4248b1bef77f6d455: Status 404 returned error can't find the container with id e425b5a0136557e962d102278a0540a0b4ba64332ed9e2c4248b1bef77f6d455 Jun 09 23:43:28.001851 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:28.001829 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d46f66_24ee_4b59_8b95_68cff3d0f6db.slice/crio-8c87e5d673dd215fb048b19e423107ae922a90c5c5ef740a0b3c8323ffe963f9 WatchSource:0}: Error finding container 8c87e5d673dd215fb048b19e423107ae922a90c5c5ef740a0b3c8323ffe963f9: Status 404 returned error can't find the container with id 8c87e5d673dd215fb048b19e423107ae922a90c5c5ef740a0b3c8323ffe963f9 Jun 09 23:43:28.003315 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:28.003298 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b817d8f_af6e_4dfc_9f92_967a550a7b02.slice/crio-60d0ed326aacbbde568671af0607d9074aa70b30098ecfdbd636152c336aa7fa WatchSource:0}: Error finding container 60d0ed326aacbbde568671af0607d9074aa70b30098ecfdbd636152c336aa7fa: Status 404 returned error can't find the container with id 60d0ed326aacbbde568671af0607d9074aa70b30098ecfdbd636152c336aa7fa Jun 09 23:43:28.004167 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:28.004069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e20bcd2_f0b6_4100_b093_5dfdd61ad04d.slice/crio-560d62f059b39ea98a0286590915940a65065e8847e91a1666c8360fccc6526c WatchSource:0}: Error finding container 560d62f059b39ea98a0286590915940a65065e8847e91a1666c8360fccc6526c: Status 404 returned error can't find the container with id 560d62f059b39ea98a0286590915940a65065e8847e91a1666c8360fccc6526c Jun 09 23:43:28.005604 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:28.005579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556c0f7e_3955_4a32_b08e_7e04de7b4372.slice/crio-51ffd3583b420874a84dd954f6b0c37d027c46f1732017f7fa7e21bf5851cf71 WatchSource:0}: Error finding container 51ffd3583b420874a84dd954f6b0c37d027c46f1732017f7fa7e21bf5851cf71: Status 404 returned error can't find the container with id 51ffd3583b420874a84dd954f6b0c37d027c46f1732017f7fa7e21bf5851cf71 Jun 09 23:43:28.006908 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:43:28.006881 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18479d69_08da_4dfd_9cd0_fb4d907b4eea.slice/crio-e39d76253ca998883166d993fdfd05d3c7de50d70321c8289279fb335162a737 WatchSource:0}: Error finding container e39d76253ca998883166d993fdfd05d3c7de50d70321c8289279fb335162a737: Status 404 returned error can't find the container with id e39d76253ca998883166d993fdfd05d3c7de50d70321c8289279fb335162a737 Jun 09 23:43:28.092253 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.092096 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 23:38:27 +0000 UTC" deadline="2028-02-26 06:33:00.974254046 +0000 UTC" Jun 09 23:43:28.092253 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.092252 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15030h49m32.882005472s" Jun 09 23:43:28.141021 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.140984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8slhs" event={"ID":"18479d69-08da-4dfd-9cd0-fb4d907b4eea","Type":"ContainerStarted","Data":"e39d76253ca998883166d993fdfd05d3c7de50d70321c8289279fb335162a737"} Jun 09 23:43:28.142106 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.142081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"8c87e5d673dd215fb048b19e423107ae922a90c5c5ef740a0b3c8323ffe963f9"} Jun 09 23:43:28.143118 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.143083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" event={"ID":"6b817d8f-af6e-4dfc-9f92-967a550a7b02","Type":"ContainerStarted","Data":"60d0ed326aacbbde568671af0607d9074aa70b30098ecfdbd636152c336aa7fa"} Jun 09 23:43:28.144142 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.144115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerStarted","Data":"3e7cf4aa54d21e11250adf83b826a3da15f276c062563449cbf1af1f4e6c53fc"} Jun 09 23:43:28.145192 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.145164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" event={"ID":"868d602a-3793-45a2-8d87-d50fa47547e0","Type":"ContainerStarted","Data":"d15af28656389083f43b4ff600219bf60ded303121296aef8cf88be0612c5d20"} Jun 09 23:43:28.149517 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.149490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" event={"ID":"385455ab1c70eb0efa9ea54b12a6ae04","Type":"ContainerStarted","Data":"59072a277741109e3c87fa4594ce1c2888ac35630d7969935f88a2fe253651ca"} Jun 09 23:43:28.150714 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.150691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjmnv" event={"ID":"556c0f7e-3955-4a32-b08e-7e04de7b4372","Type":"ContainerStarted","Data":"51ffd3583b420874a84dd954f6b0c37d027c46f1732017f7fa7e21bf5851cf71"} Jun 09 23:43:28.153440 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.152921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x57mv" event={"ID":"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d","Type":"ContainerStarted","Data":"560d62f059b39ea98a0286590915940a65065e8847e91a1666c8360fccc6526c"} Jun 09 23:43:28.154541 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.154518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65mjc" event={"ID":"77b207e4-a982-46ff-937e-53d11364acf5","Type":"ContainerStarted","Data":"e425b5a0136557e962d102278a0540a0b4ba64332ed9e2c4248b1bef77f6d455"} Jun 09 23:43:28.155871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.155850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5qsp" event={"ID":"40a65396-2d1f-496b-be08-b75b0530f72c","Type":"ContainerStarted","Data":"d26a12892fe73749fe8c5127ddc48d6116b92e5e57817134803a9c194e13acf0"} Jun 09 23:43:28.679923 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.679886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:28.680123 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.680028 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:28.680123 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.680090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:30.68007211 +0000 UTC m=+6.039193476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:28.780752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.780715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:28.780941 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.780901 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:28.780999 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.780980 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:30.780947602 +0000 UTC m=+6.140068968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:28.881782 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.881738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:28.881960 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.881905 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:28.881960 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.881926 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:28.881960 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.881938 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:28.882119 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:28.881997 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:30.881977302 +0000 UTC m=+6.241098674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:28.901348 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:28.901310 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 23:43:29.093219 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.092925 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 23:38:27 +0000 UTC" deadline="2028-01-21 04:12:55.71070865 +0000 UTC" Jun 09 23:43:29.093219 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.092980 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14164h29m26.617732154s" Jun 09 23:43:29.134755 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.134702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:29.134937 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:29.134831 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:29.135263 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.135237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:29.135452 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:29.135428 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:29.135557 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.135504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:29.135637 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:29.135603 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:29.173086 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.173053 2576 generic.go:356] "Generic (PLEG): container finished" podID="fc8d58c2dda6f4cbe2e979f0cd76c4c9" containerID="18f9fb1eb002d0ec7b980fc1d3c500dbccf0c7138d08995a265b5e390a4482b9" exitCode=0 Jun 09 23:43:29.173252 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.173197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" event={"ID":"fc8d58c2dda6f4cbe2e979f0cd76c4c9","Type":"ContainerDied","Data":"18f9fb1eb002d0ec7b980fc1d3c500dbccf0c7138d08995a265b5e390a4482b9"} Jun 09 23:43:29.189679 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:29.189608 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-49.ec2.internal" podStartSLOduration=3.189587361 podStartE2EDuration="3.189587361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:28.163296334 +0000 UTC m=+3.522417701" watchObservedRunningTime="2026-06-09 23:43:29.189587361 +0000 UTC m=+4.548708736" Jun 09 23:43:30.183430 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:30.182758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" event={"ID":"fc8d58c2dda6f4cbe2e979f0cd76c4c9","Type":"ContainerStarted","Data":"af8cd8eafd94125acf084f6f5be5b1edb92980e7d5cf8f1ad394ebae5741c252"} Jun 09 23:43:30.198519 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:30.198122 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-49.ec2.internal" podStartSLOduration=4.19809918 podStartE2EDuration="4.19809918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:30.197487022 +0000 UTC m=+5.556608399" watchObservedRunningTime="2026-06-09 23:43:30.19809918 +0000 UTC m=+5.557220552" Jun 09 23:43:30.697320 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:30.697270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:30.697490 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.697462 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:30.697545 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.697528 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:34.697507206 +0000 UTC m=+10.056628574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:30.798145 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:30.798110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:30.798321 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.798257 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:30.798321 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.798316 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:34.798298621 +0000 UTC m=+10.157419971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:30.899221 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:30.899187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:30.899379 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.899368 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:30.899452 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.899387 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:30.899452 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.899401 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:30.899549 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:30.899468 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:34.899449647 +0000 UTC m=+10.258571018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:31.132852 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:31.132819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:31.133037 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:31.132958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:31.133352 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:31.133327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:31.133465 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:31.133443 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:31.133599 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:31.133578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:31.133707 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:31.133687 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:33.136704 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:33.136559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:33.136704 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:33.136679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:33.136704 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:33.136691 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:33.137289 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:33.136757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:33.137289 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:33.136816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:33.137289 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:33.136886 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:34.733860 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:34.733821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:34.734313 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.733987 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:34.734313 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.734070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:42.734049442 +0000 UTC m=+18.093170813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:34.834722 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:34.834684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:34.834911 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.834886 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:34.835000 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.834985 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:42.834944468 +0000 UTC m=+18.194065837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:34.936000 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:34.935938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:34.936194 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.936135 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:34.936194 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.936161 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:34.936194 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.936174 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:34.936346 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:34.936232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:42.936213509 +0000 UTC m=+18.295334880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:35.133640 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:35.133579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:35.133880 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:35.133695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:35.133880 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:35.133781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:35.133880 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:35.133781 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:35.133880 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:35.133774 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:35.134068 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:35.133891 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:37.132279 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:37.132242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:37.132279 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:37.132268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:37.132735 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:37.132268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:37.132735 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:37.132384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:37.132735 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:37.132495 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:37.132735 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:37.132575 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:39.132070 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:39.132036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:39.132597 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:39.132047 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:39.132597 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:39.132174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:39.132597 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:39.132176 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:39.132597 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:39.132263 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:39.132597 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:39.132347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:41.132255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:41.132222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:41.132667 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:41.132312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:41.132667 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:41.132332 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:41.132667 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:41.132432 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:41.132667 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:41.132222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:41.132667 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:41.132547 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:42.791630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:42.791583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:42.792141 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.791739 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:42.792141 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.791806 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:58.791791577 +0000 UTC m=+34.150912927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:42.892894 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:42.892852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:42.893082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.893027 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:42.893147 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.893109 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:58.893089009 +0000 UTC m=+34.252210365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:42.993659 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:42.993600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:42.993825 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.993783 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:42.993825 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.993811 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:42.993825 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.993824 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:42.993933 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:42.993892 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:43:58.993875067 +0000 UTC m=+34.352996436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:43.132242 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:43.132206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:43.132430 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:43.132206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:43.132430 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:43.132344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:43.132430 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:43.132409 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:43.132600 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:43.132206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:43.132600 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:43.132531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:45.133732 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:45.133635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:45.133732 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:45.133684 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:45.134263 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:45.133765 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:45.134263 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:45.133815 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:45.134263 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:45.133839 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:45.134263 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:45.133930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:47.132481 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.132279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:47.133023 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.132279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:47.133023 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:47.132532 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:47.133023 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:47.132627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:47.133023 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.132318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:47.133023 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:47.132735 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:47.217491 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.217456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8slhs" event={"ID":"18479d69-08da-4dfd-9cd0-fb4d907b4eea","Type":"ContainerStarted","Data":"3f30b8969e91793d306c7ca74b2a21b19158bdfda2af97e051c9cae8e66bcd33"} Jun 09 23:43:47.219482 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.219455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"d9f658ed4635b1e6bc55ed8b101a995385037d382ab78b81ffb4e763aebb7a53"} Jun 09 23:43:47.219608 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.219527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"7614ef51035ecf80503a1db8fab9d3cd19de853129561305bf3d9f259a93ac50"} Jun 09 23:43:47.221101 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.221068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" event={"ID":"6b817d8f-af6e-4dfc-9f92-967a550a7b02","Type":"ContainerStarted","Data":"df19a2a38274003fe6af728d6c8d6bbb38ec625979dcdfc8ec957a44f7145999"} Jun 09 23:43:47.222791 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.222768 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="8bac63867737e985ecfa0d3916f350690bf5316d01845d3ae225f4883d0e6361" exitCode=0 Jun 09 23:43:47.222897 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.222842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"8bac63867737e985ecfa0d3916f350690bf5316d01845d3ae225f4883d0e6361"} Jun 09 23:43:47.224509 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.224428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" event={"ID":"868d602a-3793-45a2-8d87-d50fa47547e0","Type":"ContainerStarted","Data":"ebbfcbe345e611e233e8ba7952d728f56de0ff14a414ff648df758e9383c3a69"} Jun 09 23:43:47.226159 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.225967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjmnv" event={"ID":"556c0f7e-3955-4a32-b08e-7e04de7b4372","Type":"ContainerStarted","Data":"50b4b998dfb040b5ae6628b24f4d446b35ea27974ddc9b635cc9043010cb38f7"} Jun 09 23:43:47.228480 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.228454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x57mv" event={"ID":"5e20bcd2-f0b6-4100-b093-5dfdd61ad04d","Type":"ContainerStarted","Data":"0f4f4c70f41b7b0d3f69860ccbb944d7c86748e99dd708a27d7d490ca5d540d9"} Jun 09 23:43:47.231226 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.231205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65mjc" event={"ID":"77b207e4-a982-46ff-937e-53d11364acf5","Type":"ContainerStarted","Data":"c72c8c199aaaaedf73459abc32ad574324d106642cb93a3f37a0133505c00b4f"} Jun 09 23:43:47.233676 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.233639 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8slhs" podStartSLOduration=3.904726288 podStartE2EDuration="22.233625459s" totalImagesPullingTime="18.328899171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:47.233464392 +0000 UTC m=+22.592585766" watchObservedRunningTime="2026-06-09 23:43:47.233625459 +0000 UTC m=+22.592746824" Jun 09 23:43:47.281702 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.281464 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fjmnv" podStartSLOduration=3.9525405190000003 podStartE2EDuration="22.281447838s" totalImagesPullingTime="18.328907319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:47.280862047 +0000 UTC m=+22.639983420" watchObservedRunningTime="2026-06-09 23:43:47.281447838 +0000 UTC m=+22.640569210" Jun 09 23:43:47.304749 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.304696 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cfjkn" podStartSLOduration=3.988884109 podStartE2EDuration="22.304679199s" totalImagesPullingTime="18.31579509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:47.304209301 +0000 UTC m=+22.663330667" watchObservedRunningTime="2026-06-09 23:43:47.304679199 +0000 UTC m=+22.663800571" Jun 09 23:43:47.319792 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.319740 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x57mv" podStartSLOduration=4.00503385 podStartE2EDuration="22.319724256s" totalImagesPullingTime="18.314690406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:47.319395901 +0000 UTC m=+22.678517274" watchObservedRunningTime="2026-06-09 23:43:47.319724256 +0000 UTC m=+22.678845628" Jun 09 23:43:47.775627 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:47.775584 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 23:43:48.133241 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.133133 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T23:43:47.775605043Z","UUID":"b45c79ac-a463-4191-ab2a-ebc35941b6a0","Handler":null,"Name":"","Endpoint":""} Jun 09 23:43:48.134971 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.134938 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 23:43:48.135087 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.134979 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 23:43:48.238877 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.238800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:43:48.239636 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.239553 2576 generic.go:356] "Generic (PLEG): container finished" podID="f9d46f66-24ee-4b59-8b95-68cff3d0f6db" containerID="d9f658ed4635b1e6bc55ed8b101a995385037d382ab78b81ffb4e763aebb7a53" exitCode=1 Jun 09 23:43:48.239887 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.239803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerDied","Data":"d9f658ed4635b1e6bc55ed8b101a995385037d382ab78b81ffb4e763aebb7a53"} Jun 09 23:43:48.239994 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.239929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"1fe56afcd0ffb80b74e3088dfd3a6d098c9aa535d77e44b2672f67cee0d0a754"} Jun 09 23:43:48.239994 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.239987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"b6acfdd864a8297e934add20b7371f22bcb82a989c399ac03a2d52634dc09013"} Jun 09 23:43:48.240111 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.240034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"48c89ac15f50e90e01d5d6a01c4aab7bdc1616a5e53afd5eec4b17e0d33186e5"} Jun 09 23:43:48.240111 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.240081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"987fd6b499d5ed2334334599fc3d3dce14c2c934a1b03847997de8accf2986c0"} Jun 09 23:43:48.241909 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.241883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" event={"ID":"868d602a-3793-45a2-8d87-d50fa47547e0","Type":"ContainerStarted","Data":"8d30c7251d981f7ec737235090eb0cbc3af14d47f6d29fe4e683418735a67c33"} Jun 09 23:43:48.243820 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.243723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5qsp" event={"ID":"40a65396-2d1f-496b-be08-b75b0530f72c","Type":"ContainerStarted","Data":"9ff1ffc21abce988dc856a50e8b365dd40593751a67e24c3cf01a404fae77461"} Jun 09 23:43:48.259073 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.259022 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-65mjc" podStartSLOduration=4.655019277 podStartE2EDuration="23.259005775s" totalImagesPullingTime="18.603986498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:47.344210902 +0000 UTC m=+22.703332274" watchObservedRunningTime="2026-06-09 23:43:48.259005775 +0000 UTC m=+23.618127148" Jun 09 23:43:48.259576 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.259544 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j5qsp" podStartSLOduration=4.907557167 podStartE2EDuration="23.259535838s" totalImagesPullingTime="18.351978671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:48.258579996 +0000 UTC m=+23.617701369" watchObservedRunningTime="2026-06-09 23:43:48.259535838 +0000 UTC m=+23.618657212" Jun 09 23:43:48.579593 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.579515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:48.580244 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:48.580225 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:49.132014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.131980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:49.132199 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.131980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:49.132199 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:49.132119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:49.132199 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.132169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:49.132349 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:49.132257 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:49.132349 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:49.132314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:49.247657 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.247532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" event={"ID":"868d602a-3793-45a2-8d87-d50fa47547e0","Type":"ContainerStarted","Data":"4f47864ae45d8bec6665a425e25175138830c647a342528934d817f042e27e84"} Jun 09 23:43:49.248109 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.247731 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:49.248309 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.248288 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x57mv" Jun 09 23:43:49.265066 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:49.265003 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl7xs" podStartSLOduration=3.794783779 podStartE2EDuration="24.264988575s" totalImagesPullingTime="20.470204796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:49.264731963 +0000 UTC m=+24.623853339" watchObservedRunningTime="2026-06-09 23:43:49.264988575 +0000 UTC m=+24.624109948" Jun 09 23:43:51.133096 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:51.132895 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:51.133531 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:51.132894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:51.133531 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:51.133181 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:51.133531 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:51.133276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:51.133531 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:51.132896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:51.133531 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:51.133417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:52.256673 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:52.256647 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:43:52.257213 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:52.256982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"786cb5c84dbd313bc88f5e402352c85ee47ba776aef19426fc61c7fdcb2ee8b5"} Jun 09 23:43:52.258772 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:52.258744 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="744daaf79beacae025b40f3581745fd7ec47172538beff02f9f392023f0df6e0" exitCode=0 Jun 09 23:43:52.258882 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:52.258782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"744daaf79beacae025b40f3581745fd7ec47172538beff02f9f392023f0df6e0"} Jun 09 23:43:53.132858 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:53.132825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:53.133050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:53.132835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:53.133050 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:53.132925 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:53.133050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:53.133025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:53.133212 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:53.133097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:53.133212 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:53.132992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:53.262477 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:53.262438 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="0fc2e06c611c4c1f11c2eca00a8a34def145693fac52b0772a3cb79d1e1c38d8" exitCode=0 Jun 09 23:43:53.262924 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:53.262485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"0fc2e06c611c4c1f11c2eca00a8a34def145693fac52b0772a3cb79d1e1c38d8"} Jun 09 23:43:54.267695 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.267458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:43:54.268148 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.268009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"7686f44501ea0fe4428f4dc7f370d9187b07c5e75cfe792e2d657ec108a5cd09"} Jun 09 23:43:54.268329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.268309 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:54.268471 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.268452 2576 scope.go:117] "RemoveContainer" containerID="d9f658ed4635b1e6bc55ed8b101a995385037d382ab78b81ffb4e763aebb7a53" Jun 09 23:43:54.270631 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.270596 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="1d1c90ab8b38cbbfe1644cdb341b07c5a3e93d4293e34d13c8126597adc5e943" exitCode=0 Jun 09 23:43:54.270729 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.270649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"1d1c90ab8b38cbbfe1644cdb341b07c5a3e93d4293e34d13c8126597adc5e943"} Jun 09 23:43:54.283859 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:54.283841 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:55.136187 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.136155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:55.136352 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.136163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:55.136352 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.136273 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:55.136459 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.136372 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:55.136459 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.136163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:55.136543 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.136474 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:55.279649 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.279598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:43:55.280145 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.280017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" event={"ID":"f9d46f66-24ee-4b59-8b95-68cff3d0f6db","Type":"ContainerStarted","Data":"0f04e0d17162ef9584c9c608a0d3086a4b8e6393d1519b571bfd8adb044c37d2"} Jun 09 23:43:55.280455 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.280435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:55.280531 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.280518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:55.298988 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.298960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:43:55.307551 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.307494 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" podStartSLOduration=11.369211852 podStartE2EDuration="30.307473521s" totalImagesPullingTime="18.938261669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:43:55.305323974 +0000 UTC m=+30.664445359" watchObservedRunningTime="2026-06-09 23:43:55.307473521 +0000 UTC m=+30.666594897" Jun 09 23:43:55.713284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.713243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n8xh2"] Jun 09 23:43:55.713447 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.713352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:55.713504 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.713447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:55.716377 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.716084 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4j6k5"] Jun 09 23:43:55.716377 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.716193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:55.716377 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.716327 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:55.717308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.716798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tg6jt"] Jun 09 23:43:55.717308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:55.716900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:55.717308 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:55.717005 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:57.132761 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:57.132723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:57.132761 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:57.132758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:57.133294 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:57.132723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:57.133294 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:57.132876 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:57.133294 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:57.132967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:57.133294 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:57.133049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:58.809441 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:58.809411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:58.809986 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:58.809546 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:58.809986 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:58.809606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret podName:389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46 nodeName:}" failed. No retries permitted until 2026-06-09 23:44:30.809592899 +0000 UTC m=+66.168714250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret") pod "global-pull-secret-syncer-4j6k5" (UID: "389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46") : object "kube-system"/"original-pull-secret" not registered Jun 09 23:43:58.909950 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:58.909929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:58.910095 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:58.910078 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:58.910146 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:58.910137 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:44:30.910122333 +0000 UTC m=+66.269243688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 23:43:59.011048 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.010972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:59.011189 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.011100 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 23:43:59.011189 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.011112 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 23:43:59.011189 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.011121 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fttft for pod openshift-network-diagnostics/network-check-target-n8xh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:59.011189 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.011168 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft podName:f930a001-66e9-4c1d-828e-1035beac6148 nodeName:}" failed. No retries permitted until 2026-06-09 23:44:31.011153527 +0000 UTC m=+66.370274878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fttft" (UniqueName: "kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft") pod "network-check-target-n8xh2" (UID: "f930a001-66e9-4c1d-828e-1035beac6148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 23:43:59.132396 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.132360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:43:59.132578 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.132373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:43:59.132578 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.132477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:43:59.132578 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.132458 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4j6k5" podUID="389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46" Jun 09 23:43:59.132728 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.132585 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:43:59.132728 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:43:59.132661 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8xh2" podUID="f930a001-66e9-4c1d-828e-1035beac6148" Jun 09 23:43:59.291594 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.291503 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="820e0d72a0b4dfec329c82956a3bee6761f36f8f77876ab9f1ec92f41a0efcfd" exitCode=0 Jun 09 23:43:59.291594 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:43:59.291550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"820e0d72a0b4dfec329c82956a3bee6761f36f8f77876ab9f1ec92f41a0efcfd"} Jun 09 23:44:00.296135 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.296103 2576 generic.go:356] "Generic (PLEG): container finished" podID="455627c2-b5fd-4a95-8422-e80284d142ce" containerID="37e0d6b07c86bc6073c6eb8f3d9bdc8a3aeba399e7737e0740ee575bfe414be8" exitCode=0 Jun 09 23:44:00.296602 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.296146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerDied","Data":"37e0d6b07c86bc6073c6eb8f3d9bdc8a3aeba399e7737e0740ee575bfe414be8"} Jun 09 23:44:00.421354 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.421325 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-49.ec2.internal" event="NodeReady" Jun 09 23:44:00.421510 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.421492 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 23:44:00.459305 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.459270 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-27fdp"] Jun 09 23:44:00.479877 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.479841 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gfb"] Jun 09 23:44:00.480030 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.479959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.482544 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.482515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 23:44:00.482544 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.482536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qxc8z\"" Jun 09 23:44:00.482748 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.482540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 23:44:00.498043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.498016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27fdp"] Jun 09 23:44:00.498043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.498048 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gfb"] Jun 09 23:44:00.498206 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.498124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.500512 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.500474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 23:44:00.500512 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.500494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 23:44:00.500788 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.500735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 23:44:00.500878 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.500810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wjkmd\"" Jun 09 23:44:00.623260 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5tf\" (UniqueName: \"kubernetes.io/projected/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-kube-api-access-pn5tf\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.623449 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdb8\" (UniqueName: \"kubernetes.io/projected/4441aeec-d2a7-4713-b2f7-a16df9adeea7-kube-api-access-7zdb8\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.623449 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-config-volume\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.623449 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4441aeec-d2a7-4713-b2f7-a16df9adeea7-cert\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.623449 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.623449 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.623404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-tmp-dir\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.724610 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4441aeec-d2a7-4713-b2f7-a16df9adeea7-cert\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.724610 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.724610 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-tmp-dir\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.724845 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:00.724715 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:00.724845 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5tf\" (UniqueName: \"kubernetes.io/projected/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-kube-api-access-pn5tf\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.724845 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:00.724798 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:01.224778503 +0000 UTC m=+36.583899870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:00.724845 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdb8\" (UniqueName: \"kubernetes.io/projected/4441aeec-d2a7-4713-b2f7-a16df9adeea7-kube-api-access-7zdb8\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.725014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-config-volume\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.725014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.724897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-tmp-dir\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.725366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.725348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-config-volume\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.728538 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.728517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4441aeec-d2a7-4713-b2f7-a16df9adeea7-cert\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.732772 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.732753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdb8\" (UniqueName: \"kubernetes.io/projected/4441aeec-d2a7-4713-b2f7-a16df9adeea7-kube-api-access-7zdb8\") pod \"ingress-canary-n2gfb\" (UID: \"4441aeec-d2a7-4713-b2f7-a16df9adeea7\") " pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:00.732911 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.732893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5tf\" (UniqueName: \"kubernetes.io/projected/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-kube-api-access-pn5tf\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:00.806089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:00.806053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2gfb" Jun 09 23:44:01.014270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.014018 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gfb"] Jun 09 23:44:01.018120 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:44:01.018095 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4441aeec_d2a7_4713_b2f7_a16df9adeea7.slice/crio-1fb769867de9df026d49edf7f3f678001a911378bb33aaedc513f3447ee4ea2f WatchSource:0}: Error finding container 1fb769867de9df026d49edf7f3f678001a911378bb33aaedc513f3447ee4ea2f: Status 404 returned error can't find the container with id 1fb769867de9df026d49edf7f3f678001a911378bb33aaedc513f3447ee4ea2f Jun 09 23:44:01.132757 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.132722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:44:01.132903 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.132721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:44:01.132963 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.132729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:44:01.135752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.135728 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 23:44:01.136885 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.136865 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 23:44:01.136885 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.136879 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fndrf\"" Jun 09 23:44:01.137051 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.136895 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hm2lq\"" Jun 09 23:44:01.137051 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.136900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 23:44:01.137051 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.136990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 23:44:01.230927 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.230889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:01.231322 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:01.231295 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:01.231512 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:01.231498 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:02.231475412 +0000 UTC m=+37.590596782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:01.302348 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.302259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" event={"ID":"455627c2-b5fd-4a95-8422-e80284d142ce","Type":"ContainerStarted","Data":"14e0b66f6254845441f8b2c50e1d8b4e714a6e2c99070f32cc4a43b7042df3e7"} Jun 09 23:44:01.303393 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.303372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2gfb" event={"ID":"4441aeec-d2a7-4713-b2f7-a16df9adeea7","Type":"ContainerStarted","Data":"1fb769867de9df026d49edf7f3f678001a911378bb33aaedc513f3447ee4ea2f"} Jun 09 23:44:01.328867 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:01.328812 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9x7j" podStartSLOduration=8.047242595 podStartE2EDuration="36.328799006s" totalImagesPullingTime="28.281556411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:44:01.327164876 +0000 UTC m=+36.686286250" watchObservedRunningTime="2026-06-09 23:44:01.328799006 +0000 UTC m=+36.687920378" Jun 09 23:44:02.237837 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:02.237803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:02.238009 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:02.237915 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:02.238009 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:02.237967 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:04.237953058 +0000 UTC m=+39.597074413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:04.253113 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:04.252929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:04.253491 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:04.253044 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:04.253491 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:04.253185 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:08.253171818 +0000 UTC m=+43.612293169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:04.311120 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:04.311088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2gfb" event={"ID":"4441aeec-d2a7-4713-b2f7-a16df9adeea7","Type":"ContainerStarted","Data":"c4a46aac589502245adf7945fbc7dc61f61979a68679181bcc564273a6c31bbf"} Jun 09 23:44:04.326014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:04.325967 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n2gfb" podStartSLOduration=1.769931418 podStartE2EDuration="4.325951841s" totalImagesPullingTime="2.556020423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:44:04.325383237 +0000 UTC m=+39.684504611" watchObservedRunningTime="2026-06-09 23:44:04.325951841 +0000 UTC m=+39.685073214" Jun 09 23:44:08.281815 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:08.281776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:08.282304 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:08.281958 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:08.282304 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:08.282051 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:16.28202951 +0000 UTC m=+51.641150929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:16.340498 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:16.340463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:16.341024 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:16.340601 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:16.341024 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:16.340690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:44:32.340674496 +0000 UTC m=+67.699795848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:27.294417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:27.294389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-np5kc" Jun 09 23:44:30.836517 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:30.836476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:44:30.839882 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:30.839861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 23:44:30.850717 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:30.850698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46-original-pull-secret\") pod \"global-pull-secret-syncer-4j6k5\" (UID: \"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46\") " pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:44:30.937169 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:30.937135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:44:30.939722 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:30.939701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 23:44:30.947786 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:30.947766 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 23:44:30.947865 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:30.947860 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:45:34.94783837 +0000 UTC m=+130.306959721 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : secret "metrics-daemon-secret" not found Jun 09 23:44:31.037731 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.037693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:44:31.040702 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.040685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 23:44:31.050972 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.050955 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 23:44:31.061284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.061264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fttft\" (UniqueName: \"kubernetes.io/projected/f930a001-66e9-4c1d-828e-1035beac6148-kube-api-access-fttft\") pod \"network-check-target-n8xh2\" (UID: \"f930a001-66e9-4c1d-828e-1035beac6148\") " pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:44:31.142951 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.142876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4j6k5" Jun 09 23:44:31.151669 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.151648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fndrf\"" Jun 09 23:44:31.159786 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.159753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:44:31.274192 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.274163 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4j6k5"] Jun 09 23:44:31.291366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.291343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n8xh2"] Jun 09 23:44:31.294742 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:44:31.294718 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf930a001_66e9_4c1d_828e_1035beac6148.slice/crio-2c64edd1194fad5f52bba550435b0c53ead09fe39fffbbc902c4753c6b5905e0 WatchSource:0}: Error finding container 2c64edd1194fad5f52bba550435b0c53ead09fe39fffbbc902c4753c6b5905e0: Status 404 returned error can't find the container with id 2c64edd1194fad5f52bba550435b0c53ead09fe39fffbbc902c4753c6b5905e0 Jun 09 23:44:31.375253 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.375215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n8xh2" event={"ID":"f930a001-66e9-4c1d-828e-1035beac6148","Type":"ContainerStarted","Data":"2c64edd1194fad5f52bba550435b0c53ead09fe39fffbbc902c4753c6b5905e0"} Jun 09 23:44:31.376315 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:31.376294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4j6k5" event={"ID":"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46","Type":"ContainerStarted","Data":"867b56f585540c2f9f0ae81c3ff8800f1d51ae94466a9e4f9c1d0218b8a6addd"} Jun 09 23:44:32.346824 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:32.346782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:44:32.347326 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:32.346920 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:44:32.347326 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:44:32.347004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:45:04.346979429 +0000 UTC m=+99.706100793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:44:36.391323 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:36.391281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n8xh2" event={"ID":"f930a001-66e9-4c1d-828e-1035beac6148","Type":"ContainerStarted","Data":"222c1e9c5c684f3dbe60616e31b564d20609d2089a330fd0c6b191eee67bf02a"} Jun 09 23:44:36.391830 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:36.391403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:44:36.392871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:36.392848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4j6k5" event={"ID":"389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46","Type":"ContainerStarted","Data":"d7e2a08f1a391ced1d1e981a5d5f5a20d460c6844dbe81f4ef71130fe7d3da3e"} Jun 09 23:44:36.406070 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:36.406016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n8xh2" podStartSLOduration=67.232000772 podStartE2EDuration="1m11.406002083s" totalImagesPullingTime="4.174001311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:44:36.405686475 +0000 UTC m=+71.764807848" watchObservedRunningTime="2026-06-09 23:44:36.406002083 +0000 UTC m=+71.765123602" Jun 09 23:44:36.420818 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:36.420775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4j6k5" podStartSLOduration=67.225665916 podStartE2EDuration="1m11.420761699s" totalImagesPullingTime="4.195095783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:44:36.420371553 +0000 UTC m=+71.779492926" watchObservedRunningTime="2026-06-09 23:44:36.420761699 +0000 UTC m=+71.779883086" Jun 09 23:44:38.690513 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.690399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f"] Jun 09 23:44:38.694409 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.694388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.696892 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.696869 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-chlcl\"" Jun 09 23:44:38.698073 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.698054 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 23:44:38.698278 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.698257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 23:44:38.698347 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.698335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 23:44:38.699319 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.699301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 23:44:38.702224 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.702202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f"] Jun 09 23:44:38.795281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.795246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbpmk\" (UniqueName: \"kubernetes.io/projected/6d3e7dba-82a8-435e-b595-90c0d637f9db-kube-api-access-cbpmk\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.795281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.795281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d3e7dba-82a8-435e-b595-90c0d637f9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.896756 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.896723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d3e7dba-82a8-435e-b595-90c0d637f9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.896938 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.896907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbpmk\" (UniqueName: \"kubernetes.io/projected/6d3e7dba-82a8-435e-b595-90c0d637f9db-kube-api-access-cbpmk\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.900526 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.900475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d3e7dba-82a8-435e-b595-90c0d637f9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:38.904856 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:38.904837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbpmk\" (UniqueName: \"kubernetes.io/projected/6d3e7dba-82a8-435e-b595-90c0d637f9db-kube-api-access-cbpmk\") pod \"managed-serviceaccount-addon-agent-5988846b6d-jnm9f\" (UID: \"6d3e7dba-82a8-435e-b595-90c0d637f9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:39.015270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:39.015172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" Jun 09 23:44:39.138878 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:39.138852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f"] Jun 09 23:44:39.142223 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:44:39.142194 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d3e7dba_82a8_435e_b595_90c0d637f9db.slice/crio-6f933e4b5bed64a80402d828a248ab2d2940335289ac9fecccafb3dc299b3f9d WatchSource:0}: Error finding container 6f933e4b5bed64a80402d828a248ab2d2940335289ac9fecccafb3dc299b3f9d: Status 404 returned error can't find the container with id 6f933e4b5bed64a80402d828a248ab2d2940335289ac9fecccafb3dc299b3f9d Jun 09 23:44:39.400869 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:39.400834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" event={"ID":"6d3e7dba-82a8-435e-b595-90c0d637f9db","Type":"ContainerStarted","Data":"6f933e4b5bed64a80402d828a248ab2d2940335289ac9fecccafb3dc299b3f9d"} Jun 09 23:44:42.409732 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:42.409696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" event={"ID":"6d3e7dba-82a8-435e-b595-90c0d637f9db","Type":"ContainerStarted","Data":"f81f869921cf30bf85c5684936060097bc519e07090343d9d123fa04c73f03ce"} Jun 09 23:44:42.424947 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:44:42.424906 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" podStartSLOduration=1.340109026 podStartE2EDuration="4.424891064s" totalImagesPullingTime="3.084782038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:44:42.424233876 +0000 UTC m=+77.783355251" watchObservedRunningTime="2026-06-09 23:44:42.424891064 +0000 UTC m=+77.784012437" Jun 09 23:45:04.368434 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:45:04.368384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:45:04.368962 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:45:04.368522 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:45:04.368962 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:45:04.368597 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:46:08.368581492 +0000 UTC m=+163.727702846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:45:07.398137 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:45:07.398101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n8xh2" Jun 09 23:45:34.977158 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:45:34.977104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:45:34.977662 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:45:34.977259 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 23:45:34.977662 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:45:34.977337 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs podName:5ecb1451-a42f-4114-b21f-345c7226ab22 nodeName:}" failed. No retries permitted until 2026-06-09 23:47:36.977320317 +0000 UTC m=+252.336441672 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs") pod "network-metrics-daemon-tg6jt" (UID: "5ecb1451-a42f-4114-b21f-345c7226ab22") : secret "metrics-daemon-secret" not found Jun 09 23:46:03.489857 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:03.489810 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-27fdp" podUID="b30d5046-5b10-4a27-9e62-cd8ad139e8bb" Jun 09 23:46:03.600909 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:03.600875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27fdp" Jun 09 23:46:04.153956 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:04.153915 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tg6jt" podUID="5ecb1451-a42f-4114-b21f-345c7226ab22" Jun 09 23:46:08.408894 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:08.408794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:46:08.409256 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:08.408946 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 23:46:08.409256 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:08.409010 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls podName:b30d5046-5b10-4a27-9e62-cd8ad139e8bb nodeName:}" failed. No retries permitted until 2026-06-09 23:48:10.408994297 +0000 UTC m=+285.768115651 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls") pod "dns-default-27fdp" (UID: "b30d5046-5b10-4a27-9e62-cd8ad139e8bb") : secret "dns-default-metrics-tls" not found Jun 09 23:46:16.132638 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:16.132569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:46:42.696196 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:42.696114 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d3e7dba-82a8-435e-b595-90c0d637f9db" containerID="f81f869921cf30bf85c5684936060097bc519e07090343d9d123fa04c73f03ce" exitCode=255 Jun 09 23:46:42.696196 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:42.696172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" event={"ID":"6d3e7dba-82a8-435e-b595-90c0d637f9db","Type":"ContainerDied","Data":"f81f869921cf30bf85c5684936060097bc519e07090343d9d123fa04c73f03ce"} Jun 09 23:46:42.701672 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:42.701655 2576 scope.go:117] "RemoveContainer" containerID="f81f869921cf30bf85c5684936060097bc519e07090343d9d123fa04c73f03ce" Jun 09 23:46:43.700882 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:43.700849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5988846b6d-jnm9f" event={"ID":"6d3e7dba-82a8-435e-b595-90c0d637f9db","Type":"ContainerStarted","Data":"526ecf88a8c90ab1baa77cffbed5dd8d9e6401be57d659d5e0d0f5eced342973"} Jun 09 23:46:56.050748 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.050715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-29s68"] Jun 09 23:46:56.053642 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.053606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.054014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.053994 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56"] Jun 09 23:46:56.056373 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.056272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 23:46:56.056373 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.056317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dtnnk\"" Jun 09 23:46:56.056634 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.056601 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-vx5mq"] Jun 09 23:46:56.056830 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.056653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 23:46:56.056906 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.056689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.057715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.057695 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 23:46:56.057814 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.057734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 23:46:56.059436 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.059416 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5"] Jun 09 23:46:56.059585 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.059570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.062044 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.061694 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 23:46:56.062044 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.061911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 23:46:56.062044 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.061969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ktwx5\"" Jun 09 23:46:56.062044 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.061995 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 23:46:56.062254 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.062160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 23:46:56.062401 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.062384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 23:46:56.062499 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.062431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 23:46:56.062499 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.062461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.063240 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.063218 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 23:46:56.063519 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.063491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gvvqx\"" Jun 09 23:46:56.063581 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.063546 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 23:46:56.067734 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.067712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 23:46:56.067926 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.067905 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 23:46:56.068872 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.068853 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 23:46:56.070109 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.070091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mqgbv\"" Jun 09 23:46:56.070424 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.070140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 23:46:56.070808 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.070792 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 23:46:56.071969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.071929 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-29s68"] Jun 09 23:46:56.074407 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.073682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5"] Jun 09 23:46:56.074407 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.073921 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 23:46:56.075239 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.075221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-vx5mq"] Jun 09 23:46:56.083694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.083672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56"] Jun 09 23:46:56.142394 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8w68\" (UniqueName: \"kubernetes.io/projected/a2452fb8-db43-40c7-acba-17ccfe1c5366-kube-api-access-f8w68\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.142394 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2pl\" (UniqueName: \"kubernetes.io/projected/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-kube-api-access-9k2pl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-snapshots\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2452fb8-db43-40c7-acba-17ccfe1c5366-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a11c11a3-ae56-4526-9916-fff7f992d983-serving-cert\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkb7m\" (UniqueName: \"kubernetes.io/projected/a11c11a3-ae56-4526-9916-fff7f992d983-kube-api-access-nkb7m\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.142674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8101261-827c-4dde-adb0-b3541246482d-serving-cert\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-tmp\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-trusted-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-trusted-ca\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbmj\" (UniqueName: \"kubernetes.io/projected/a8101261-827c-4dde-adb0-b3541246482d-kube-api-access-wfbmj\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-config\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.142922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.142881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-service-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.146337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.146314 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g"] Jun 09 23:46:56.149177 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.149162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" Jun 09 23:46:56.153344 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.153322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:46:56.153483 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.153468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m5dvt\"" Jun 09 23:46:56.156038 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.156020 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-676f45dfff-vljc7"] Jun 09 23:46:56.156155 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.156140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.158705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.158687 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 23:46:56.158893 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.158756 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 23:46:56.158968 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.158912 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-whxxh\"" Jun 09 23:46:56.158968 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.158939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 23:46:56.159278 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.159260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g"] Jun 09 23:46:56.159376 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.159348 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.162747 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.162728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 23:46:56.162945 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.162922 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 23:46:56.163021 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.162944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 23:46:56.163021 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.162960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nbh8p\"" Jun 09 23:46:56.163021 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.163004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 23:46:56.163157 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.163008 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 23:46:56.163209 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.163179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 23:46:56.165585 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.165562 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 23:46:56.169182 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.169160 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:46:56.170066 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.170049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-676f45dfff-vljc7"] Jun 09 23:46:56.244050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-tmp\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-trusted-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8w68\" (UniqueName: \"kubernetes.io/projected/a2452fb8-db43-40c7-acba-17ccfe1c5366-kube-api-access-f8w68\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.244172 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbmj\" (UniqueName: \"kubernetes.io/projected/a8101261-827c-4dde-adb0-b3541246482d-kube-api-access-wfbmj\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhsh\" (UniqueName: \"kubernetes.io/projected/3fe806b3-e0cf-4af1-91db-853b22790b3c-kube-api-access-lkhsh\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.244246 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.244242 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls podName:a2452fb8-db43-40c7-acba-17ccfe1c5366 nodeName:}" failed. No retries permitted until 2026-06-09 23:46:56.744221657 +0000 UTC m=+212.103343011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rs4z5" (UID: "a2452fb8-db43-40c7-acba-17ccfe1c5366") : secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-config\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-service-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2452fb8-db43-40c7-acba-17ccfe1c5366-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb49m\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-tmp\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8101261-827c-4dde-adb0-b3541246482d-serving-cert\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.244711 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-trusted-ca\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-default-certificate\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-stats-auth\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvsb\" (UniqueName: \"kubernetes.io/projected/75367cae-81ac-4356-8f49-5d03c076ec85-kube-api-access-7bvsb\") pod \"network-check-source-dbd9cf844-5k98g\" (UID: \"75367cae-81ac-4356-8f49-5d03c076ec85\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2pl\" (UniqueName: \"kubernetes.io/projected/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-kube-api-access-9k2pl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.244956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-service-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-snapshots\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a11c11a3-ae56-4526-9916-fff7f992d983-serving-cert\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8101261-827c-4dde-adb0-b3541246482d-trusted-ca-bundle\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2452fb8-db43-40c7-acba-17ccfe1c5366-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.245346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkb7m\" (UniqueName: \"kubernetes.io/projected/a11c11a3-ae56-4526-9916-fff7f992d983-kube-api-access-nkb7m\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.245969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.245969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.245969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8101261-827c-4dde-adb0-b3541246482d-snapshots\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.245969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-trusted-ca\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.245969 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.245948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a11c11a3-ae56-4526-9916-fff7f992d983-config\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.247256 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.247233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a11c11a3-ae56-4526-9916-fff7f992d983-serving-cert\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.247380 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.247334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8101261-827c-4dde-adb0-b3541246482d-serving-cert\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.247380 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.247361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.255350 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.255327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbmj\" (UniqueName: \"kubernetes.io/projected/a8101261-827c-4dde-adb0-b3541246482d-kube-api-access-wfbmj\") pod \"insights-operator-896549976-vx5mq\" (UID: \"a8101261-827c-4dde-adb0-b3541246482d\") " pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.255601 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.255580 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2pl\" (UniqueName: \"kubernetes.io/projected/d674e199-e3d2-46ea-a8ed-1d0f52b867b4-kube-api-access-9k2pl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-rmd56\" (UID: \"d674e199-e3d2-46ea-a8ed-1d0f52b867b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.256485 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.256466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkb7m\" (UniqueName: \"kubernetes.io/projected/a11c11a3-ae56-4526-9916-fff7f992d983-kube-api-access-nkb7m\") pod \"console-operator-668fdbf85c-29s68\" (UID: \"a11c11a3-ae56-4526-9916-fff7f992d983\") " pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.256566 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.256504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8w68\" (UniqueName: \"kubernetes.io/projected/a2452fb8-db43-40c7-acba-17ccfe1c5366-kube-api-access-f8w68\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.345718 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhsh\" (UniqueName: \"kubernetes.io/projected/3fe806b3-e0cf-4af1-91db-853b22790b3c-kube-api-access-lkhsh\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb49m\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-default-certificate\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.345886 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 23:46:56.345908 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-stats-auth\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.345984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvsb\" (UniqueName: \"kubernetes.io/projected/75367cae-81ac-4356-8f49-5d03c076ec85-kube-api-access-7bvsb\") pod \"network-check-source-dbd9cf844-5k98g\" (UID: \"75367cae-81ac-4356-8f49-5d03c076ec85\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.346018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.345910 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f6bbf7-jwvmr: secret "image-registry-tls" not found Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.346046 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.346063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:56.846043707 +0000 UTC m=+212.205165077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : configmap references non-existent config key: service-ca.crt Jun 09 23:46:56.346403 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.346399 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls podName:e69bfad3-917c-4936-9624-d3de71b29dcc nodeName:}" failed. No retries permitted until 2026-06-09 23:46:56.846380337 +0000 UTC m=+212.205501689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls") pod "image-registry-6d7f6bbf7-jwvmr" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc") : secret "image-registry-tls" not found Jun 09 23:46:56.346825 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.346415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:56.846405677 +0000 UTC m=+212.205527028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : secret "router-metrics-certs-default" not found Jun 09 23:46:56.346825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.346480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.346825 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.346573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.347005 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.346981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.348323 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.348304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.348428 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.348410 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.348706 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.348689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-default-certificate\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.348769 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.348730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-stats-auth\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.360800 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.360779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.362869 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.362841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvsb\" (UniqueName: \"kubernetes.io/projected/75367cae-81ac-4356-8f49-5d03c076ec85-kube-api-access-7bvsb\") pod \"network-check-source-dbd9cf844-5k98g\" (UID: \"75367cae-81ac-4356-8f49-5d03c076ec85\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" Jun 09 23:46:56.363017 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.363001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhsh\" (UniqueName: \"kubernetes.io/projected/3fe806b3-e0cf-4af1-91db-853b22790b3c-kube-api-access-lkhsh\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.363132 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.363117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb49m\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.365394 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.365380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:46:56.377183 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.377166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" Jun 09 23:46:56.385028 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.385009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-vx5mq" Jun 09 23:46:56.461529 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.461268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" Jun 09 23:46:56.507909 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.507830 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-29s68"] Jun 09 23:46:56.530668 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.530634 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56"] Jun 09 23:46:56.551582 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.551559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-vx5mq"] Jun 09 23:46:56.554154 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:46:56.554128 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8101261_827c_4dde_adb0_b3541246482d.slice/crio-3327e87d5cbfcade4c8db52590dcedc37fa57e2abcd8e5062571201e734f31e0 WatchSource:0}: Error finding container 3327e87d5cbfcade4c8db52590dcedc37fa57e2abcd8e5062571201e734f31e0: Status 404 returned error can't find the container with id 3327e87d5cbfcade4c8db52590dcedc37fa57e2abcd8e5062571201e734f31e0 Jun 09 23:46:56.598455 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.598391 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g"] Jun 09 23:46:56.600861 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:46:56.600834 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75367cae_81ac_4356_8f49_5d03c076ec85.slice/crio-f3eee1201f27c1359277bb72f166e8b876dba9290813ac114348af53efbc3545 WatchSource:0}: Error finding container f3eee1201f27c1359277bb72f166e8b876dba9290813ac114348af53efbc3545: Status 404 returned error can't find the container with id f3eee1201f27c1359277bb72f166e8b876dba9290813ac114348af53efbc3545 Jun 09 23:46:56.740772 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.740730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-vx5mq" event={"ID":"a8101261-827c-4dde-adb0-b3541246482d","Type":"ContainerStarted","Data":"3327e87d5cbfcade4c8db52590dcedc37fa57e2abcd8e5062571201e734f31e0"} Jun 09 23:46:56.741790 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.741762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" event={"ID":"d674e199-e3d2-46ea-a8ed-1d0f52b867b4","Type":"ContainerStarted","Data":"da8b2ecb73408845a0a52d2f36495ecfe53718c58a161de39ef6d3f897ac475c"} Jun 09 23:46:56.742839 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.742810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" event={"ID":"a11c11a3-ae56-4526-9916-fff7f992d983","Type":"ContainerStarted","Data":"025c235877374406a62359edcf7f3bd49282d31a7597959e145a4f79a0af86d8"} Jun 09 23:46:56.744170 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.744149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" event={"ID":"75367cae-81ac-4356-8f49-5d03c076ec85","Type":"ContainerStarted","Data":"73d9ddec0c1265d0fd596c8ff781389cc54cf762fa47e35157e61df08926543f"} Jun 09 23:46:56.744264 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.744187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" event={"ID":"75367cae-81ac-4356-8f49-5d03c076ec85","Type":"ContainerStarted","Data":"f3eee1201f27c1359277bb72f166e8b876dba9290813ac114348af53efbc3545"} Jun 09 23:46:56.749902 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.749881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:56.750039 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.750024 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:56.750097 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.750087 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls podName:a2452fb8-db43-40c7-acba-17ccfe1c5366 nodeName:}" failed. No retries permitted until 2026-06-09 23:46:57.750072352 +0000 UTC m=+213.109193704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rs4z5" (UID: "a2452fb8-db43-40c7-acba-17ccfe1c5366") : secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:56.759301 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.759257 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5k98g" podStartSLOduration=0.759246228 podStartE2EDuration="759.246228ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:46:56.758164008 +0000 UTC m=+212.117285382" watchObservedRunningTime="2026-06-09 23:46:56.759246228 +0000 UTC m=+212.118367600" Jun 09 23:46:56.850329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.850239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:56.850329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.850319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:56.850350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850383 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850402 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f6bbf7-jwvmr: secret "image-registry-tls" not found Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850451 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls podName:e69bfad3-917c-4936-9624-d3de71b29dcc nodeName:}" failed. No retries permitted until 2026-06-09 23:46:57.85043628 +0000 UTC m=+213.209557631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls") pod "image-registry-6d7f6bbf7-jwvmr" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc") : secret "image-registry-tls" not found Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850459 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850506 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:57.850494098 +0000 UTC m=+213.209615448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : secret "router-metrics-certs-default" not found Jun 09 23:46:56.850550 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:56.850521 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:57.850513673 +0000 UTC m=+213.209635024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : configmap references non-existent config key: service-ca.crt Jun 09 23:46:57.759492 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:57.759450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:57.759988 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.759628 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:57.759988 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.759701 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls podName:a2452fb8-db43-40c7-acba-17ccfe1c5366 nodeName:}" failed. No retries permitted until 2026-06-09 23:46:59.759679871 +0000 UTC m=+215.118801231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rs4z5" (UID: "a2452fb8-db43-40c7-acba-17ccfe1c5366") : secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:57.860386 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:57.860331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:57.860386 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:57.860391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:57.860644 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860508 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 23:46:57.860644 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860574 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:59.860552197 +0000 UTC m=+215.219673565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : configmap references non-existent config key: service-ca.crt Jun 09 23:46:57.860644 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860600 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:46:59.860591024 +0000 UTC m=+215.219712375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : secret "router-metrics-certs-default" not found Jun 09 23:46:57.860644 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:57.860633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:57.860888 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860745 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 23:46:57.860888 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860757 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f6bbf7-jwvmr: secret "image-registry-tls" not found Jun 09 23:46:57.860888 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:57.860800 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls podName:e69bfad3-917c-4936-9624-d3de71b29dcc nodeName:}" failed. No retries permitted until 2026-06-09 23:46:59.860784574 +0000 UTC m=+215.219905928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls") pod "image-registry-6d7f6bbf7-jwvmr" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc") : secret "image-registry-tls" not found Jun 09 23:46:59.756526 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.756433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-vx5mq" event={"ID":"a8101261-827c-4dde-adb0-b3541246482d","Type":"ContainerStarted","Data":"5d46ddce53e33c3a0cf95fa67d4daf58307638af0318b9b32a62b1ff44072f32"} Jun 09 23:46:59.758014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.757982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" event={"ID":"d674e199-e3d2-46ea-a8ed-1d0f52b867b4","Type":"ContainerStarted","Data":"e7eca00e280b17ac91f3830fa95ca258631ed38f78c14139d469c5b141b8389b"} Jun 09 23:46:59.759554 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.759520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/0.log" Jun 09 23:46:59.759681 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.759561 2576 generic.go:356] "Generic (PLEG): container finished" podID="a11c11a3-ae56-4526-9916-fff7f992d983" containerID="4b4b527ce7a92529d344cae625ea76899dd574b2571f84ece16e272ae2b0bdd9" exitCode=255 Jun 09 23:46:59.759736 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.759654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" event={"ID":"a11c11a3-ae56-4526-9916-fff7f992d983","Type":"ContainerDied","Data":"4b4b527ce7a92529d344cae625ea76899dd574b2571f84ece16e272ae2b0bdd9"} Jun 09 23:46:59.759840 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.759821 2576 scope.go:117] "RemoveContainer" containerID="4b4b527ce7a92529d344cae625ea76899dd574b2571f84ece16e272ae2b0bdd9" Jun 09 23:46:59.772036 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.771990 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-vx5mq" podStartSLOduration=0.806777301 podStartE2EDuration="3.771976621s" totalImagesPullingTime="2.96519932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:46:59.770840964 +0000 UTC m=+215.129962339" watchObservedRunningTime="2026-06-09 23:46:59.771976621 +0000 UTC m=+215.131097971" Jun 09 23:46:59.777027 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.777002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:46:59.777162 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.777143 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:59.777222 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.777211 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls podName:a2452fb8-db43-40c7-acba-17ccfe1c5366 nodeName:}" failed. No retries permitted until 2026-06-09 23:47:03.777192384 +0000 UTC m=+219.136313738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rs4z5" (UID: "a2452fb8-db43-40c7-acba-17ccfe1c5366") : secret "cluster-monitoring-operator-tls" not found Jun 09 23:46:59.800146 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.800088 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" podStartSLOduration=0.811196777 podStartE2EDuration="3.800067684s" totalImagesPullingTime="2.988870907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:46:59.798762252 +0000 UTC m=+215.157883628" watchObservedRunningTime="2026-06-09 23:46:59.800067684 +0000 UTC m=+215.159189059" Jun 09 23:46:59.878276 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.878241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:59.878441 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.878302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:46:59.878441 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.878388 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 23:46:59.878579 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.878461 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:47:03.878441986 +0000 UTC m=+219.237563339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : secret "router-metrics-certs-default" not found Jun 09 23:46:59.878579 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:46:59.878542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:46:59.878729 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.878668 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 23:46:59.878729 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.878682 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f6bbf7-jwvmr: secret "image-registry-tls" not found Jun 09 23:46:59.878729 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.878722 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls podName:e69bfad3-917c-4936-9624-d3de71b29dcc nodeName:}" failed. No retries permitted until 2026-06-09 23:47:03.878707921 +0000 UTC m=+219.237829308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls") pod "image-registry-6d7f6bbf7-jwvmr" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc") : secret "image-registry-tls" not found Jun 09 23:46:59.879315 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:46:59.879017 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:47:03.879002026 +0000 UTC m=+219.238123391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : configmap references non-existent config key: service-ca.crt Jun 09 23:47:00.766446 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.766418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/1.log" Jun 09 23:47:00.767005 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.766988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/0.log" Jun 09 23:47:00.767139 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.767024 2576 generic.go:356] "Generic (PLEG): container finished" podID="a11c11a3-ae56-4526-9916-fff7f992d983" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" exitCode=255 Jun 09 23:47:00.767139 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.767058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" event={"ID":"a11c11a3-ae56-4526-9916-fff7f992d983","Type":"ContainerDied","Data":"ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6"} Jun 09 23:47:00.767139 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.767114 2576 scope.go:117] "RemoveContainer" containerID="4b4b527ce7a92529d344cae625ea76899dd574b2571f84ece16e272ae2b0bdd9" Jun 09 23:47:00.768249 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:00.767778 2576 scope.go:117] "RemoveContainer" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" Jun 09 23:47:00.768249 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:00.767973 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:01.772200 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:01.772175 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/1.log" Jun 09 23:47:01.772705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:01.772569 2576 scope.go:117] "RemoveContainer" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" Jun 09 23:47:01.772808 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:01.772786 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:02.649065 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:02.649034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjmnv_556c0f7e-3955-4a32-b08e-7e04de7b4372/dns-node-resolver/0.log" Jun 09 23:47:03.648516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:03.648488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8slhs_18479d69-08da-4dfd-9cd0-fb4d907b4eea/node-ca/0.log" Jun 09 23:47:03.812605 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:03.812558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:47:03.812801 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.812733 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 23:47:03.812801 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.812800 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls podName:a2452fb8-db43-40c7-acba-17ccfe1c5366 nodeName:}" failed. No retries permitted until 2026-06-09 23:47:11.812784243 +0000 UTC m=+227.171905595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rs4z5" (UID: "a2452fb8-db43-40c7-acba-17ccfe1c5366") : secret "cluster-monitoring-operator-tls" not found Jun 09 23:47:03.913875 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:03.913795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:03.913875 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:03.913833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:03.913884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.913959 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.913979 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.913990 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f6bbf7-jwvmr: secret "image-registry-tls" not found Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.914023 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls podName:e69bfad3-917c-4936-9624-d3de71b29dcc nodeName:}" failed. No retries permitted until 2026-06-09 23:47:11.914011049 +0000 UTC m=+227.273132399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls") pod "image-registry-6d7f6bbf7-jwvmr" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc") : secret "image-registry-tls" not found Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.914036 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:47:11.91402921 +0000 UTC m=+227.273150561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : configmap references non-existent config key: service-ca.crt Jun 09 23:47:03.914082 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:03.914047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs podName:3fe806b3-e0cf-4af1-91db-853b22790b3c nodeName:}" failed. No retries permitted until 2026-06-09 23:47:11.914041417 +0000 UTC m=+227.273162768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs") pod "router-default-676f45dfff-vljc7" (UID: "3fe806b3-e0cf-4af1-91db-853b22790b3c") : secret "router-metrics-certs-default" not found Jun 09 23:47:04.849388 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:04.849355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2gfb_4441aeec-d2a7-4713-b2f7-a16df9adeea7/serve-healthcheck-canary/0.log" Jun 09 23:47:06.365635 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:06.365573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:06.366012 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:06.365731 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:06.366105 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:06.366091 2576 scope.go:117] "RemoveContainer" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" Jun 09 23:47:06.366282 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:06.366261 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:11.886826 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.886785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:47:11.889150 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.889128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2452fb8-db43-40c7-acba-17ccfe1c5366-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rs4z5\" (UID: \"a2452fb8-db43-40c7-acba-17ccfe1c5366\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:47:11.987499 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.987459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:11.987720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.987517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:11.987720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.987585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:11.988284 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.988262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe806b3-e0cf-4af1-91db-853b22790b3c-service-ca-bundle\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:11.989037 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.989022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" Jun 09 23:47:11.990013 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.989988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"image-registry-6d7f6bbf7-jwvmr\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:11.990106 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:11.990090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fe806b3-e0cf-4af1-91db-853b22790b3c-metrics-certs\") pod \"router-default-676f45dfff-vljc7\" (UID: \"3fe806b3-e0cf-4af1-91db-853b22790b3c\") " pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:12.070566 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.070532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:12.075245 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.075227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:12.119017 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.118983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5"] Jun 09 23:47:12.122737 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:12.122703 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2452fb8_db43_40c7_acba_17ccfe1c5366.slice/crio-15efc7e32448437e0b7bf6fcec33ef07cc4b5df51d62be58b0914424c4f346f2 WatchSource:0}: Error finding container 15efc7e32448437e0b7bf6fcec33ef07cc4b5df51d62be58b0914424c4f346f2: Status 404 returned error can't find the container with id 15efc7e32448437e0b7bf6fcec33ef07cc4b5df51d62be58b0914424c4f346f2 Jun 09 23:47:12.211955 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.211924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:47:12.214897 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:12.214869 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69bfad3_917c_4936_9624_d3de71b29dcc.slice/crio-3ad10c0a7b1ebaae5465c5d09f9f4c71d897bb5e12978d52331f7b7490378216 WatchSource:0}: Error finding container 3ad10c0a7b1ebaae5465c5d09f9f4c71d897bb5e12978d52331f7b7490378216: Status 404 returned error can't find the container with id 3ad10c0a7b1ebaae5465c5d09f9f4c71d897bb5e12978d52331f7b7490378216 Jun 09 23:47:12.228518 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.228493 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-676f45dfff-vljc7"] Jun 09 23:47:12.234358 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:12.234329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe806b3_e0cf_4af1_91db_853b22790b3c.slice/crio-08c647192ae2b455209a4caeb4c38c1e93fea1c3368114017840c392b587834e WatchSource:0}: Error finding container 08c647192ae2b455209a4caeb4c38c1e93fea1c3368114017840c392b587834e: Status 404 returned error can't find the container with id 08c647192ae2b455209a4caeb4c38c1e93fea1c3368114017840c392b587834e Jun 09 23:47:12.808276 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.808228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" event={"ID":"e69bfad3-917c-4936-9624-d3de71b29dcc","Type":"ContainerStarted","Data":"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732"} Jun 09 23:47:12.808473 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.808299 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:12.808473 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.808320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" event={"ID":"e69bfad3-917c-4936-9624-d3de71b29dcc","Type":"ContainerStarted","Data":"3ad10c0a7b1ebaae5465c5d09f9f4c71d897bb5e12978d52331f7b7490378216"} Jun 09 23:47:12.810402 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.810274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-676f45dfff-vljc7" event={"ID":"3fe806b3-e0cf-4af1-91db-853b22790b3c","Type":"ContainerStarted","Data":"220cb9ededd93e9c63a84ca7196cf0b2fcbb40e56e2dbc897f3c49b7855339f6"} Jun 09 23:47:12.810402 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.810336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-676f45dfff-vljc7" event={"ID":"3fe806b3-e0cf-4af1-91db-853b22790b3c","Type":"ContainerStarted","Data":"08c647192ae2b455209a4caeb4c38c1e93fea1c3368114017840c392b587834e"} Jun 09 23:47:12.812307 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.812271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" event={"ID":"a2452fb8-db43-40c7-acba-17ccfe1c5366","Type":"ContainerStarted","Data":"15efc7e32448437e0b7bf6fcec33ef07cc4b5df51d62be58b0914424c4f346f2"} Jun 09 23:47:12.826445 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.826384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" podStartSLOduration=16.826360862 podStartE2EDuration="16.826360862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:12.825294219 +0000 UTC m=+228.184415593" watchObservedRunningTime="2026-06-09 23:47:12.826360862 +0000 UTC m=+228.185482238" Jun 09 23:47:12.841965 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:12.841919 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-676f45dfff-vljc7" podStartSLOduration=16.841907883 podStartE2EDuration="16.841907883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:12.840886996 +0000 UTC m=+228.200008368" watchObservedRunningTime="2026-06-09 23:47:12.841907883 +0000 UTC m=+228.201029256" Jun 09 23:47:13.075777 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:13.075697 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:13.078072 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:13.078051 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:13.816562 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:13.816534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:13.817912 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:13.817865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-676f45dfff-vljc7" Jun 09 23:47:14.820873 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:14.820837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" event={"ID":"a2452fb8-db43-40c7-acba-17ccfe1c5366","Type":"ContainerStarted","Data":"0fa769d98bd13f9c3416d89ecf4cffef30034f1ad8115134fe37dbcda97adff8"} Jun 09 23:47:14.836564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:14.836511 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rs4z5" podStartSLOduration=16.665467986 podStartE2EDuration="18.8364963s" totalImagesPullingTime="2.171028314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:14.836279242 +0000 UTC m=+230.195400616" watchObservedRunningTime="2026-06-09 23:47:14.8364963 +0000 UTC m=+230.195617672" Jun 09 23:47:19.132884 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.132851 2576 scope.go:117] "RemoveContainer" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" Jun 09 23:47:19.837772 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.837745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:47:19.838118 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.838104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/1.log" Jun 09 23:47:19.838183 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.838134 2576 generic.go:356] "Generic (PLEG): container finished" podID="a11c11a3-ae56-4526-9916-fff7f992d983" containerID="d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81" exitCode=255 Jun 09 23:47:19.838183 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.838178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" event={"ID":"a11c11a3-ae56-4526-9916-fff7f992d983","Type":"ContainerDied","Data":"d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81"} Jun 09 23:47:19.838254 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.838221 2576 scope.go:117] "RemoveContainer" containerID="ea00bd9b2fe55dbbec24f9c3d42c2cdeb61bd1c378f822b2390881ec5b4afad6" Jun 09 23:47:19.838549 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:19.838530 2576 scope.go:117] "RemoveContainer" containerID="d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81" Jun 09 23:47:19.838725 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:19.838707 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:20.842982 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:20.842952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:47:21.340069 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.340036 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5"] Jun 09 23:47:21.342960 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.342943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:21.346091 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.346067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kvjkd\"" Jun 09 23:47:21.346882 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.346868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 23:47:21.352041 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.352023 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f7t7x"] Jun 09 23:47:21.354086 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.354072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.364006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.363781 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5"] Jun 09 23:47:21.369580 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.369541 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 23:47:21.370001 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.369983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 23:47:21.370434 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.370416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz5km\"" Jun 09 23:47:21.393961 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.393934 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:47:21.395130 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.395108 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7t7x"] Jun 09 23:47:21.465588 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02807886-6aa1-41ca-844d-3dff80308db2-crio-socket\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.465588 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02807886-6aa1-41ca-844d-3dff80308db2-data-volume\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.465816 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02807886-6aa1-41ca-844d-3dff80308db2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.465816 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4ssb5\" (UID: \"6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:21.465816 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsccn\" (UniqueName: \"kubernetes.io/projected/02807886-6aa1-41ca-844d-3dff80308db2-kube-api-access-tsccn\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.465982 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.465814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02807886-6aa1-41ca-844d-3dff80308db2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.566951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsccn\" (UniqueName: \"kubernetes.io/projected/02807886-6aa1-41ca-844d-3dff80308db2-kube-api-access-tsccn\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.566988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02807886-6aa1-41ca-844d-3dff80308db2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02807886-6aa1-41ca-844d-3dff80308db2-crio-socket\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567043 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02807886-6aa1-41ca-844d-3dff80308db2-data-volume\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567358 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02807886-6aa1-41ca-844d-3dff80308db2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567358 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4ssb5\" (UID: \"6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:21.567358 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02807886-6aa1-41ca-844d-3dff80308db2-crio-socket\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567500 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02807886-6aa1-41ca-844d-3dff80308db2-data-volume\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.567763 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.567734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02807886-6aa1-41ca-844d-3dff80308db2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.569501 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.569482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4ssb5\" (UID: \"6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:21.569586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.569489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02807886-6aa1-41ca-844d-3dff80308db2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.576767 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.576750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsccn\" (UniqueName: \"kubernetes.io/projected/02807886-6aa1-41ca-844d-3dff80308db2-kube-api-access-tsccn\") pod \"insights-runtime-extractor-f7t7x\" (UID: \"02807886-6aa1-41ca-844d-3dff80308db2\") " pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.651985 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.651947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:21.662606 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.662581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7t7x" Jun 09 23:47:21.794437 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.794407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5"] Jun 09 23:47:21.797860 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:21.797836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbe6ab9_e0b3_47b5_a83b_a0a1378efa65.slice/crio-42bb6fad8b7790bc4586fcbc372195ec71711692522837205e083d2d239743f3 WatchSource:0}: Error finding container 42bb6fad8b7790bc4586fcbc372195ec71711692522837205e083d2d239743f3: Status 404 returned error can't find the container with id 42bb6fad8b7790bc4586fcbc372195ec71711692522837205e083d2d239743f3 Jun 09 23:47:21.819425 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.819352 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7t7x"] Jun 09 23:47:21.821901 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:21.821873 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02807886_6aa1_41ca_844d_3dff80308db2.slice/crio-fc8dc13c9b78510b66667caceb80c30e8f59307761f84b0e782220122e002b6f WatchSource:0}: Error finding container fc8dc13c9b78510b66667caceb80c30e8f59307761f84b0e782220122e002b6f: Status 404 returned error can't find the container with id fc8dc13c9b78510b66667caceb80c30e8f59307761f84b0e782220122e002b6f Jun 09 23:47:21.846923 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.846886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7t7x" event={"ID":"02807886-6aa1-41ca-844d-3dff80308db2","Type":"ContainerStarted","Data":"fc8dc13c9b78510b66667caceb80c30e8f59307761f84b0e782220122e002b6f"} Jun 09 23:47:21.847882 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:21.847861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" event={"ID":"6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65","Type":"ContainerStarted","Data":"42bb6fad8b7790bc4586fcbc372195ec71711692522837205e083d2d239743f3"} Jun 09 23:47:22.853138 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:22.853108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7t7x" event={"ID":"02807886-6aa1-41ca-844d-3dff80308db2","Type":"ContainerStarted","Data":"2e96c3c7b2c7c4c791c5b4cc782775cba91963c8e64fdd8dd60baf3872f324f1"} Jun 09 23:47:22.853493 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:22.853165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7t7x" event={"ID":"02807886-6aa1-41ca-844d-3dff80308db2","Type":"ContainerStarted","Data":"5cd28bbb7faf44f60ba45131b3a91cf57d38eb508c61223312ce862a26290538"} Jun 09 23:47:23.858308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:23.858271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" event={"ID":"6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65","Type":"ContainerStarted","Data":"17da239176c4419ae1ea66d653a1aed7d837c4c0f0f4d433e8d85cf52c63c60c"} Jun 09 23:47:23.858792 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:23.858452 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:23.863884 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:23.863856 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" Jun 09 23:47:23.874064 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:23.874022 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4ssb5" podStartSLOduration=1.817844955 podStartE2EDuration="2.874007547s" totalImagesPullingTime="1.056162592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:23.872743207 +0000 UTC m=+239.231864581" watchObservedRunningTime="2026-06-09 23:47:23.874007547 +0000 UTC m=+239.233128919" Jun 09 23:47:24.794945 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.794897 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-225ll"] Jun 09 23:47:24.798069 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.798049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.801715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.801694 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 23:47:24.801872 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.801853 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6j4dl\"" Jun 09 23:47:24.801949 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.801852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 23:47:24.802186 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.802171 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 23:47:24.806454 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.806433 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-225ll"] Jun 09 23:47:24.864096 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.864058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7t7x" event={"ID":"02807886-6aa1-41ca-844d-3dff80308db2","Type":"ContainerStarted","Data":"9850305cd9453052b0aa0cd6a7b6f99983cad76bb89e4120122d7ee876a069ff"} Jun 09 23:47:24.885623 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.885574 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f7t7x" podStartSLOduration=1.523562136 podStartE2EDuration="3.885558859s" totalImagesPullingTime="2.361996723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 23:47:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:24.884852045 +0000 UTC m=+240.243973417" watchObservedRunningTime="2026-06-09 23:47:24.885558859 +0000 UTC m=+240.244680249" Jun 09 23:47:24.891135 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.891112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.891273 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.891170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llbw7\" (UniqueName: \"kubernetes.io/projected/2679198c-4e84-4da0-bcd4-e13cea5dad31-kube-api-access-llbw7\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.891327 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.891309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.891439 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.891418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2679198c-4e84-4da0-bcd4-e13cea5dad31-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.991883 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.991842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llbw7\" (UniqueName: \"kubernetes.io/projected/2679198c-4e84-4da0-bcd4-e13cea5dad31-kube-api-access-llbw7\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.992089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.991904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.992089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.991948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2679198c-4e84-4da0-bcd4-e13cea5dad31-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.992089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.991998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.992679 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.992660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2679198c-4e84-4da0-bcd4-e13cea5dad31-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.994406 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.994388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:24.994458 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:24.994408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2679198c-4e84-4da0-bcd4-e13cea5dad31-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:25.000366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:25.000342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llbw7\" (UniqueName: \"kubernetes.io/projected/2679198c-4e84-4da0-bcd4-e13cea5dad31-kube-api-access-llbw7\") pod \"prometheus-operator-7f7d445d84-225ll\" (UID: \"2679198c-4e84-4da0-bcd4-e13cea5dad31\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:25.110597 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:25.110571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6j4dl\"" Jun 09 23:47:25.118724 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:25.118710 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" Jun 09 23:47:25.245082 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:25.245049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-225ll"] Jun 09 23:47:25.248044 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:25.248020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2679198c_4e84_4da0_bcd4_e13cea5dad31.slice/crio-b555e671218a131a856a3582dd5f7455edfbddbcb17f6034c4f4f4f2178facdf WatchSource:0}: Error finding container b555e671218a131a856a3582dd5f7455edfbddbcb17f6034c4f4f4f2178facdf: Status 404 returned error can't find the container with id b555e671218a131a856a3582dd5f7455edfbddbcb17f6034c4f4f4f2178facdf Jun 09 23:47:25.870501 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:25.870469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" event={"ID":"2679198c-4e84-4da0-bcd4-e13cea5dad31","Type":"ContainerStarted","Data":"b555e671218a131a856a3582dd5f7455edfbddbcb17f6034c4f4f4f2178facdf"} Jun 09 23:47:26.366035 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.365998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:26.366242 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.366071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:26.366500 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.366483 2576 scope.go:117] "RemoveContainer" containerID="d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81" Jun 09 23:47:26.366743 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:26.366714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:26.875843 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.875799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" event={"ID":"2679198c-4e84-4da0-bcd4-e13cea5dad31","Type":"ContainerStarted","Data":"57403bef8221d5503a47dedf80170d2573ab409059da19587015e38b1bbd109a"} Jun 09 23:47:26.876289 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.875868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" event={"ID":"2679198c-4e84-4da0-bcd4-e13cea5dad31","Type":"ContainerStarted","Data":"deaf4863ebc53806e1c3cefe507ad0af3e418f2f7b7374375577888ee2b789ce"} Jun 09 23:47:26.892587 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:26.892492 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-225ll" podStartSLOduration=1.648454435 podStartE2EDuration="2.892474241s" totalImagesPullingTime="1.244019806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:26.892033866 +0000 UTC m=+242.251155238" watchObservedRunningTime="2026-06-09 23:47:26.892474241 +0000 UTC m=+242.251595614" Jun 09 23:47:29.129096 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.129064 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jcvf5"] Jun 09 23:47:29.133918 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.133892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.136709 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.136684 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 23:47:29.136844 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.136742 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r98jm\"" Jun 09 23:47:29.136844 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.136822 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 23:47:29.137046 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.137032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 23:47:29.227234 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-textfile\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227392 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9l5j\" (UniqueName: \"kubernetes.io/projected/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-kube-api-access-r9l5j\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227392 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-sys\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227392 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-tls\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227392 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-wtmp\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-metrics-client-ca\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-root\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.227542 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.227474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328143 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-textfile\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9l5j\" (UniqueName: \"kubernetes.io/projected/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-kube-api-access-r9l5j\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-sys\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-tls\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-wtmp\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-metrics-client-ca\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-root\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-wtmp\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-sys\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-root\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.328847 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-textfile\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.329014 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.328996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-metrics-client-ca\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.329143 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.329122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.330541 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.330526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.330694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.330674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-node-exporter-tls\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.335568 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.335545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9l5j\" (UniqueName: \"kubernetes.io/projected/59cdeb00-7a69-421c-baa2-2e1dd1bd162c-kube-api-access-r9l5j\") pod \"node-exporter-jcvf5\" (UID: \"59cdeb00-7a69-421c-baa2-2e1dd1bd162c\") " pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.443414 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.443336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jcvf5" Jun 09 23:47:29.454671 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:29.454642 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cdeb00_7a69_421c_baa2_2e1dd1bd162c.slice/crio-d26855fbfcfdb1409025f7c0e6100de3a4848db1b4599423888041ad8f0d6bb0 WatchSource:0}: Error finding container d26855fbfcfdb1409025f7c0e6100de3a4848db1b4599423888041ad8f0d6bb0: Status 404 returned error can't find the container with id d26855fbfcfdb1409025f7c0e6100de3a4848db1b4599423888041ad8f0d6bb0 Jun 09 23:47:29.887134 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:29.887099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jcvf5" event={"ID":"59cdeb00-7a69-421c-baa2-2e1dd1bd162c","Type":"ContainerStarted","Data":"d26855fbfcfdb1409025f7c0e6100de3a4848db1b4599423888041ad8f0d6bb0"} Jun 09 23:47:30.892923 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:30.892884 2576 generic.go:356] "Generic (PLEG): container finished" podID="59cdeb00-7a69-421c-baa2-2e1dd1bd162c" containerID="f90d4828fbb8f6221deebc32b7417ad775d6e1b47f33f86338142d7ee30a8371" exitCode=0 Jun 09 23:47:30.893332 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:30.892978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jcvf5" event={"ID":"59cdeb00-7a69-421c-baa2-2e1dd1bd162c","Type":"ContainerDied","Data":"f90d4828fbb8f6221deebc32b7417ad775d6e1b47f33f86338142d7ee30a8371"} Jun 09 23:47:31.400315 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:31.400280 2576 patch_prober.go:28] interesting pod/image-registry-6d7f6bbf7-jwvmr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 23:47:31.400471 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:31.400339 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 23:47:31.899054 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:31.899019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jcvf5" event={"ID":"59cdeb00-7a69-421c-baa2-2e1dd1bd162c","Type":"ContainerStarted","Data":"244e5604ebd8c168ea349f8ed248dda29e10cfdd95363934d5ecf6e01b92c8ba"} Jun 09 23:47:31.899424 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:31.899068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jcvf5" event={"ID":"59cdeb00-7a69-421c-baa2-2e1dd1bd162c","Type":"ContainerStarted","Data":"dd30be9ba7507096b94d34410d7ccebd4c78fa7ad39f9b8d3ef6214cafb89391"} Jun 09 23:47:31.918565 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:31.918507 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jcvf5" podStartSLOduration=2.027190039 podStartE2EDuration="2.918489592s" totalImagesPullingTime="826.304443ms" totalInitContainerRuntime="64.99511ms" isStatefulPod=true podCreationTimestamp="2026-06-09 23:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:31.917166103 +0000 UTC m=+247.276287477" watchObservedRunningTime="2026-06-09 23:47:31.918489592 +0000 UTC m=+247.277610965" Jun 09 23:47:33.881818 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.881788 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq"] Jun 09 23:47:33.885129 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.885100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:33.887513 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.887484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 23:47:33.887646 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.887571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5n24v\"" Jun 09 23:47:33.891606 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.891583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq"] Jun 09 23:47:33.963244 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.963209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7c8835-b257-4de2-889f-8f1e43618462-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:33.963244 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:33.963250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66qfp\" (UniqueName: \"kubernetes.io/projected/1b7c8835-b257-4de2-889f-8f1e43618462-kube-api-access-66qfp\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.064303 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.064265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7c8835-b257-4de2-889f-8f1e43618462-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.064303 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.064308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66qfp\" (UniqueName: \"kubernetes.io/projected/1b7c8835-b257-4de2-889f-8f1e43618462-kube-api-access-66qfp\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.066860 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.066830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7c8835-b257-4de2-889f-8f1e43618462-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.071896 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.071871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66qfp\" (UniqueName: \"kubernetes.io/projected/1b7c8835-b257-4de2-889f-8f1e43618462-kube-api-access-66qfp\") pod \"monitoring-plugin-76b68cc874-fvrqq\" (UID: \"1b7c8835-b257-4de2-889f-8f1e43618462\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.195205 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.195121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:34.282215 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.282181 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5858c7645d-qjwwq"] Jun 09 23:47:34.287065 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.287037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.289716 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.289692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 23:47:34.289839 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.289692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 23:47:34.289839 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.289736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 23:47:34.290090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.290072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 23:47:34.290175 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.290140 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 23:47:34.290351 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.290335 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d6m68\"" Jun 09 23:47:34.297956 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.297932 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 23:47:34.298731 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.298709 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5858c7645d-qjwwq"] Jun 09 23:47:34.326196 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.326042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq"] Jun 09 23:47:34.328692 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:34.328665 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7c8835_b257_4de2_889f_8f1e43618462.slice/crio-0ac6af2382d76ad9ac067ac30a1e779a4c37d50fca54d655d10435901229ae67 WatchSource:0}: Error finding container 0ac6af2382d76ad9ac067ac30a1e779a4c37d50fca54d655d10435901229ae67: Status 404 returned error can't find the container with id 0ac6af2382d76ad9ac067ac30a1e779a4c37d50fca54d655d10435901229ae67 Jun 09 23:47:34.367442 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dcs6\" (UniqueName: \"kubernetes.io/projected/60a2fbdc-3604-447e-9333-0d7133fcbae8-kube-api-access-2dcs6\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367442 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367666 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367666 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-serving-certs-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367666 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367807 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367807 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-metrics-client-ca\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.367807 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.367726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-federate-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.468475 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.468475 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-serving-certs-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-metrics-client-ca\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-federate-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469231 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.468600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dcs6\" (UniqueName: \"kubernetes.io/projected/60a2fbdc-3604-447e-9333-0d7133fcbae8-kube-api-access-2dcs6\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469554 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.469359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-metrics-client-ca\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469554 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.469369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.469554 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.469374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a2fbdc-3604-447e-9333-0d7133fcbae8-serving-certs-ca-bundle\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.471048 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.471027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.471171 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.471154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-federate-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.471469 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.471450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-telemeter-client-tls\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.471543 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.471507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/60a2fbdc-3604-447e-9333-0d7133fcbae8-secret-telemeter-client\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.475968 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.475949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dcs6\" (UniqueName: \"kubernetes.io/projected/60a2fbdc-3604-447e-9333-0d7133fcbae8-kube-api-access-2dcs6\") pod \"telemeter-client-5858c7645d-qjwwq\" (UID: \"60a2fbdc-3604-447e-9333-0d7133fcbae8\") " pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.599597 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.599551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" Jun 09 23:47:34.736453 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.736428 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5858c7645d-qjwwq"] Jun 09 23:47:34.738360 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:34.738334 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a2fbdc_3604_447e_9333_0d7133fcbae8.slice/crio-a5dda4afffc1be00047a9dc0a15e4957c94efaa9bc247822f68e5f88a7fe17a9 WatchSource:0}: Error finding container a5dda4afffc1be00047a9dc0a15e4957c94efaa9bc247822f68e5f88a7fe17a9: Status 404 returned error can't find the container with id a5dda4afffc1be00047a9dc0a15e4957c94efaa9bc247822f68e5f88a7fe17a9 Jun 09 23:47:34.911127 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.911088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" event={"ID":"60a2fbdc-3604-447e-9333-0d7133fcbae8","Type":"ContainerStarted","Data":"a5dda4afffc1be00047a9dc0a15e4957c94efaa9bc247822f68e5f88a7fe17a9"} Jun 09 23:47:34.912172 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:34.912149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" event={"ID":"1b7c8835-b257-4de2-889f-8f1e43618462","Type":"ContainerStarted","Data":"0ac6af2382d76ad9ac067ac30a1e779a4c37d50fca54d655d10435901229ae67"} Jun 09 23:47:36.919563 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.919520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" event={"ID":"60a2fbdc-3604-447e-9333-0d7133fcbae8","Type":"ContainerStarted","Data":"82b8e28757f0a40d338c254dec66cc96599fb10ed8db7c467f31fd9264e09386"} Jun 09 23:47:36.920930 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.920910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" event={"ID":"1b7c8835-b257-4de2-889f-8f1e43618462","Type":"ContainerStarted","Data":"b9607a723e0e801fc92c3b916cc89fad8837150dbae2ec8a48f459488d47071b"} Jun 09 23:47:36.921146 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.921125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:36.925968 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.925941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" Jun 09 23:47:36.935930 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.935890 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fvrqq" podStartSLOduration=2.358460205 podStartE2EDuration="3.935876276s" totalImagesPullingTime="1.577416071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:36.935490807 +0000 UTC m=+252.294612180" watchObservedRunningTime="2026-06-09 23:47:36.935876276 +0000 UTC m=+252.294997649" Jun 09 23:47:36.993993 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.993909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:47:36.996322 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:36.996289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ecb1451-a42f-4114-b21f-345c7226ab22-metrics-certs\") pod \"network-metrics-daemon-tg6jt\" (UID: \"5ecb1451-a42f-4114-b21f-345c7226ab22\") " pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:47:37.135884 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.135847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hm2lq\"" Jun 09 23:47:37.143808 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.143789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tg6jt" Jun 09 23:47:37.286302 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.286217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tg6jt"] Jun 09 23:47:37.290981 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:47:37.290950 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecb1451_a42f_4114_b21f_345c7226ab22.slice/crio-5d1c258ff980d874069e8c16cc18c5444789825423456cb03f125fdbd83de2c7 WatchSource:0}: Error finding container 5d1c258ff980d874069e8c16cc18c5444789825423456cb03f125fdbd83de2c7: Status 404 returned error can't find the container with id 5d1c258ff980d874069e8c16cc18c5444789825423456cb03f125fdbd83de2c7 Jun 09 23:47:37.927971 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.927887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" event={"ID":"60a2fbdc-3604-447e-9333-0d7133fcbae8","Type":"ContainerStarted","Data":"8e08c8ebdbea1f85d65824f673844fe602ad19cfda856ec666acf9602ceb4375"} Jun 09 23:47:37.928416 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.928007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" event={"ID":"60a2fbdc-3604-447e-9333-0d7133fcbae8","Type":"ContainerStarted","Data":"746ef955ffadfefba503f6d7201f783ae5090269571045848fe480040080a01b"} Jun 09 23:47:37.929148 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.929116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tg6jt" event={"ID":"5ecb1451-a42f-4114-b21f-345c7226ab22","Type":"ContainerStarted","Data":"5d1c258ff980d874069e8c16cc18c5444789825423456cb03f125fdbd83de2c7"} Jun 09 23:47:37.948644 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:37.948581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5858c7645d-qjwwq" podStartSLOduration=1.044291071 podStartE2EDuration="3.948567227s" totalImagesPullingTime="2.904276156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:47:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:37.947050298 +0000 UTC m=+253.306171671" watchObservedRunningTime="2026-06-09 23:47:37.948567227 +0000 UTC m=+253.307688600" Jun 09 23:47:38.934893 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:38.934853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tg6jt" event={"ID":"5ecb1451-a42f-4114-b21f-345c7226ab22","Type":"ContainerStarted","Data":"79034fa8e50cf04bba52373137de1005692fa89a9ca55e0cad0ef2aa89c79669"} Jun 09 23:47:38.935350 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:38.934907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tg6jt" event={"ID":"5ecb1451-a42f-4114-b21f-345c7226ab22","Type":"ContainerStarted","Data":"a6bf29c23b3d10596608c54c1316b6b5aef60eeb050a1e14532d867e3465d0c0"} Jun 09 23:47:38.950778 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:38.950719 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tg6jt" podStartSLOduration=253.031915266 podStartE2EDuration="4m13.950697312s" totalImagesPullingTime="918.782046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:38.949796279 +0000 UTC m=+254.308917653" watchObservedRunningTime="2026-06-09 23:47:38.950697312 +0000 UTC m=+254.309818686" Jun 09 23:47:39.132629 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:39.132581 2576 scope.go:117] "RemoveContainer" containerID="d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81" Jun 09 23:47:39.132822 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:39.132798 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-29s68_openshift-console-operator(a11c11a3-ae56-4526-9916-fff7f992d983)\"" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podUID="a11c11a3-ae56-4526-9916-fff7f992d983" Jun 09 23:47:41.399190 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:41.399153 2576 patch_prober.go:28] interesting pod/image-registry-6d7f6bbf7-jwvmr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 23:47:41.399663 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:41.399378 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 23:47:46.413487 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.413443 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" containerID="cri-o://1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732" gracePeriod=30 Jun 09 23:47:46.654565 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.654537 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:46.782744 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782653 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.782744 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.782744 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb49m\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782777 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782853 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.782910 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca\") pod \"e69bfad3-917c-4936-9624-d3de71b29dcc\" (UID: \"e69bfad3-917c-4936-9624-d3de71b29dcc\") " Jun 09 23:47:46.783487 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.783462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:47:46.784008 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.783970 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:47:46.786127 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.785574 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:47:46.786127 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.785723 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:47:46.786127 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.785887 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m" (OuterVolumeSpecName: "kube-api-access-cb49m") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "kube-api-access-cb49m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:47:46.786306 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.786244 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:47:46.790689 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.786551 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:47:46.798016 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.797990 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e69bfad3-917c-4936-9624-d3de71b29dcc" (UID: "e69bfad3-917c-4936-9624-d3de71b29dcc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 23:47:46.884440 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884407 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-installation-pull-secrets\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884440 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884437 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e69bfad3-917c-4936-9624-d3de71b29dcc-ca-trust-extracted\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884440 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884447 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb49m\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-kube-api-access-cb49m\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884456 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e69bfad3-917c-4936-9624-d3de71b29dcc-image-registry-private-configuration\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884468 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-tls\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884477 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-registry-certificates\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884486 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e69bfad3-917c-4936-9624-d3de71b29dcc-bound-sa-token\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.884662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.884494 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e69bfad3-917c-4936-9624-d3de71b29dcc-trusted-ca\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:47:46.963062 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.963027 2576 generic.go:356] "Generic (PLEG): container finished" podID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerID="1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732" exitCode=0 Jun 09 23:47:46.963223 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.963085 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" Jun 09 23:47:46.963223 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.963112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" event={"ID":"e69bfad3-917c-4936-9624-d3de71b29dcc","Type":"ContainerDied","Data":"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732"} Jun 09 23:47:46.963223 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.963196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f6bbf7-jwvmr" event={"ID":"e69bfad3-917c-4936-9624-d3de71b29dcc","Type":"ContainerDied","Data":"3ad10c0a7b1ebaae5465c5d09f9f4c71d897bb5e12978d52331f7b7490378216"} Jun 09 23:47:46.963346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.963222 2576 scope.go:117] "RemoveContainer" containerID="1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732" Jun 09 23:47:46.973244 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.973218 2576 scope.go:117] "RemoveContainer" containerID="1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732" Jun 09 23:47:46.973595 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:47:46.973559 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732\": container with ID starting with 1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732 not found: ID does not exist" containerID="1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732" Jun 09 23:47:46.973719 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.973594 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732"} err="failed to get container status \"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732\": rpc error: code = NotFound desc = could not find container \"1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732\": container with ID starting with 1f3b6b1923721186d8d01a58b47158be1254088624c38a95625b3471a5ead732 not found: ID does not exist" Jun 09 23:47:46.985009 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.984982 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:47:46.988399 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:46.988374 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d7f6bbf7-jwvmr"] Jun 09 23:47:47.138107 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:47.138069 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" path="/var/lib/kubelet/pods/e69bfad3-917c-4936-9624-d3de71b29dcc/volumes" Jun 09 23:47:54.132848 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:54.132812 2576 scope.go:117] "RemoveContainer" containerID="d14681bc29270e7d824af8af4f68e0a675aae4a14687bbe066878536927dec81" Jun 09 23:47:54.999499 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:54.999476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:47:54.999673 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:54.999556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" event={"ID":"a11c11a3-ae56-4526-9916-fff7f992d983","Type":"ContainerStarted","Data":"9c7ccb97d690991e6675daf8de507135b8a827befd4bf781b9d4a5c555124b99"} Jun 09 23:47:54.999848 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:54.999828 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:55.004578 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:55.004553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" Jun 09 23:47:55.015069 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:47:55.015022 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-29s68" podStartSLOduration=56.011585751 podStartE2EDuration="59.015009297s" totalImagesPullingTime="3.003423546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:47:55.014850991 +0000 UTC m=+270.373972365" watchObservedRunningTime="2026-06-09 23:47:55.015009297 +0000 UTC m=+270.374130669" Jun 09 23:48:05.890024 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.889989 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:48:05.890479 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.890255 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" Jun 09 23:48:05.890479 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.890269 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" Jun 09 23:48:05.890479 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.890331 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69bfad3-917c-4936-9624-d3de71b29dcc" containerName="registry" Jun 09 23:48:05.898148 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.898128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:05.902385 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 23:48:05.902385 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 23:48:05.902584 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 23:48:05.902584 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 23:48:05.902584 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 23:48:05.902584 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902508 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 23:48:05.902806 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sv8l5\"" Jun 09 23:48:05.902866 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.902833 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 23:48:05.905454 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:05.905434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:48:06.044440 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.044674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.044674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.044674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbd9l\" (UniqueName: \"kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.044674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.044674 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.044664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146117 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146117 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146455 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbd9l\" (UniqueName: \"kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146895 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.146996 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.146921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.147037 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.147005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.148676 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.148660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.148733 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.148676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.154202 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.154162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbd9l\" (UniqueName: \"kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l\") pod \"console-59c547b694-4zv27\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.208044 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.208010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:06.335608 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:06.335581 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:48:06.337946 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:48:06.337918 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7867e2_d5b4_4e9c_9996_d19ffef6a550.slice/crio-4c52f432c871f77ce9f527351caa69dfbadb5ec5b75991116aaf97972d2ea288 WatchSource:0}: Error finding container 4c52f432c871f77ce9f527351caa69dfbadb5ec5b75991116aaf97972d2ea288: Status 404 returned error can't find the container with id 4c52f432c871f77ce9f527351caa69dfbadb5ec5b75991116aaf97972d2ea288 Jun 09 23:48:06.601722 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:48:06.601683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-27fdp" podUID="b30d5046-5b10-4a27-9e62-cd8ad139e8bb" Jun 09 23:48:07.047468 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:07.047363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:07.047892 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:07.047365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c547b694-4zv27" event={"ID":"ed7867e2-d5b4-4e9c-9996-d19ffef6a550","Type":"ContainerStarted","Data":"4c52f432c871f77ce9f527351caa69dfbadb5ec5b75991116aaf97972d2ea288"} Jun 09 23:48:10.060907 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.060868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c547b694-4zv27" event={"ID":"ed7867e2-d5b4-4e9c-9996-d19ffef6a550","Type":"ContainerStarted","Data":"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb"} Jun 09 23:48:10.076760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.076712 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c547b694-4zv27" podStartSLOduration=2.11576155 podStartE2EDuration="5.076696353s" totalImagesPullingTime="2.960934803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:48:10.075793633 +0000 UTC m=+285.434915007" watchObservedRunningTime="2026-06-09 23:48:10.076696353 +0000 UTC m=+285.435817725" Jun 09 23:48:10.485293 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.485251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:10.487738 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.487711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30d5046-5b10-4a27-9e62-cd8ad139e8bb-metrics-tls\") pod \"dns-default-27fdp\" (UID: \"b30d5046-5b10-4a27-9e62-cd8ad139e8bb\") " pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:10.651196 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.651163 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qxc8z\"" Jun 09 23:48:10.658602 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.658584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:10.785928 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:10.785895 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27fdp"] Jun 09 23:48:10.788918 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:48:10.788894 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30d5046_5b10_4a27_9e62_cd8ad139e8bb.slice/crio-b13c1d848f8c9dda8edbb832559a54f3ca65be5b64290281f872e9ccf12ceaaa WatchSource:0}: Error finding container b13c1d848f8c9dda8edbb832559a54f3ca65be5b64290281f872e9ccf12ceaaa: Status 404 returned error can't find the container with id b13c1d848f8c9dda8edbb832559a54f3ca65be5b64290281f872e9ccf12ceaaa Jun 09 23:48:11.065856 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:11.065771 2576 generic.go:356] "Generic (PLEG): container finished" podID="a8101261-827c-4dde-adb0-b3541246482d" containerID="5d46ddce53e33c3a0cf95fa67d4daf58307638af0318b9b32a62b1ff44072f32" exitCode=0 Jun 09 23:48:11.065856 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:11.065842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-vx5mq" event={"ID":"a8101261-827c-4dde-adb0-b3541246482d","Type":"ContainerDied","Data":"5d46ddce53e33c3a0cf95fa67d4daf58307638af0318b9b32a62b1ff44072f32"} Jun 09 23:48:11.066303 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:11.066177 2576 scope.go:117] "RemoveContainer" containerID="5d46ddce53e33c3a0cf95fa67d4daf58307638af0318b9b32a62b1ff44072f32" Jun 09 23:48:11.067181 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:11.067143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27fdp" event={"ID":"b30d5046-5b10-4a27-9e62-cd8ad139e8bb","Type":"ContainerStarted","Data":"b13c1d848f8c9dda8edbb832559a54f3ca65be5b64290281f872e9ccf12ceaaa"} Jun 09 23:48:12.074152 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:12.074112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-vx5mq" event={"ID":"a8101261-827c-4dde-adb0-b3541246482d","Type":"ContainerStarted","Data":"5119668baa95c10b5fbbbdd7acf44675f5dbc5b269b595e4d92c9d577ad624fb"} Jun 09 23:48:13.084720 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:13.084688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27fdp" event={"ID":"b30d5046-5b10-4a27-9e62-cd8ad139e8bb","Type":"ContainerStarted","Data":"0a99e4713f954925797a8fa927d1280470d2c2d820fb15131a88df29d56857ab"} Jun 09 23:48:13.403857 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:13.403829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjmnv_556c0f7e-3955-4a32-b08e-7e04de7b4372/dns-node-resolver/0.log" Jun 09 23:48:14.092601 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:14.092567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27fdp" event={"ID":"b30d5046-5b10-4a27-9e62-cd8ad139e8bb","Type":"ContainerStarted","Data":"3e849058fd444f6cecf1c0cab4b1061db55b598455b203c6638f08d49a1d47c9"} Jun 09 23:48:14.092985 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:14.092655 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:14.110818 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:14.110760 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-27fdp" podStartSLOduration=251.974616842 podStartE2EDuration="4m14.110745378s" totalImagesPullingTime="2.136128536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:48:14.109176392 +0000 UTC m=+289.468297747" watchObservedRunningTime="2026-06-09 23:48:14.110745378 +0000 UTC m=+289.469866751" Jun 09 23:48:14.404834 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:14.404761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8slhs_18479d69-08da-4dfd-9cd0-fb4d907b4eea/node-ca/0.log" Jun 09 23:48:15.003841 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.003812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 09 23:48:15.277118 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.277043 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:48:15.280355 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.280339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.289864 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.289839 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 23:48:15.290972 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.290953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:48:15.331471 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2mvb\" (UniqueName: \"kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331630 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.331779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.331730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432197 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432197 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432415 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432415 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432415 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432415 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2mvb\" (UniqueName: \"kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.432415 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.433092 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.432997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.433092 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.433046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.433270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.433146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.433270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.433207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.434758 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.434737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.434923 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.434906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.440272 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.440248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2mvb\" (UniqueName: \"kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb\") pod \"console-77799947d-zjsjj\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.590579 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.590546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:15.604815 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.604787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2gfb_4441aeec-d2a7-4713-b2f7-a16df9adeea7/serve-healthcheck-canary/0.log" Jun 09 23:48:15.718697 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:15.718667 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:48:15.721884 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:48:15.721859 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233182e5_9f7f_474c_9550_e57ec06ffad5.slice/crio-2565dcbeafca656a9702f1813f3778ab2a6c1922d352274c263e880c22da1de1 WatchSource:0}: Error finding container 2565dcbeafca656a9702f1813f3778ab2a6c1922d352274c263e880c22da1de1: Status 404 returned error can't find the container with id 2565dcbeafca656a9702f1813f3778ab2a6c1922d352274c263e880c22da1de1 Jun 09 23:48:16.101402 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.101372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77799947d-zjsjj" event={"ID":"233182e5-9f7f-474c-9550-e57ec06ffad5","Type":"ContainerStarted","Data":"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108"} Jun 09 23:48:16.101570 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.101422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77799947d-zjsjj" event={"ID":"233182e5-9f7f-474c-9550-e57ec06ffad5","Type":"ContainerStarted","Data":"2565dcbeafca656a9702f1813f3778ab2a6c1922d352274c263e880c22da1de1"} Jun 09 23:48:16.119319 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.119264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77799947d-zjsjj" podStartSLOduration=1.119250463 podStartE2EDuration="1.119250463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:48:16.117739517 +0000 UTC m=+291.476860889" watchObservedRunningTime="2026-06-09 23:48:16.119250463 +0000 UTC m=+291.478371836" Jun 09 23:48:16.208183 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.208146 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:16.208344 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.208218 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:16.209589 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.209561 2576 patch_prober.go:28] interesting pod/console-59c547b694-4zv27 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 09 23:48:16.209739 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:16.209606 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59c547b694-4zv27" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 09 23:48:21.121013 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:21.120980 2576 generic.go:356] "Generic (PLEG): container finished" podID="d674e199-e3d2-46ea-a8ed-1d0f52b867b4" containerID="e7eca00e280b17ac91f3830fa95ca258631ed38f78c14139d469c5b141b8389b" exitCode=0 Jun 09 23:48:21.121402 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:21.121051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" event={"ID":"d674e199-e3d2-46ea-a8ed-1d0f52b867b4","Type":"ContainerDied","Data":"e7eca00e280b17ac91f3830fa95ca258631ed38f78c14139d469c5b141b8389b"} Jun 09 23:48:21.121402 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:21.121328 2576 scope.go:117] "RemoveContainer" containerID="e7eca00e280b17ac91f3830fa95ca258631ed38f78c14139d469c5b141b8389b" Jun 09 23:48:22.127009 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:22.126969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-rmd56" event={"ID":"d674e199-e3d2-46ea-a8ed-1d0f52b867b4","Type":"ContainerStarted","Data":"f50fd907b4cde20146e711b6915d413cd0b9ec012b83036529e9b3ad73fddabb"} Jun 09 23:48:24.098094 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:24.098061 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-27fdp" Jun 09 23:48:25.078069 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.078042 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:48:25.079277 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.079257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:48:25.082670 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.082598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:48:25.084427 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.084402 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:48:25.091944 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.091929 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 23:48:25.591485 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.591442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:25.593979 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.591515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:25.593979 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.593060 2576 patch_prober.go:28] interesting pod/console-77799947d-zjsjj container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 09 23:48:25.593979 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:25.593128 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77799947d-zjsjj" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 09 23:48:26.212884 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:26.212855 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:26.216688 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:26.216664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:48:35.594796 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:35.594763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:35.598405 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:35.598380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:48:35.651379 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:35.651338 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:48:55.182966 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.182930 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:48:55.189455 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.189430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.198480 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.198339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:48:55.267930 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.267889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268098 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.267950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268098 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.268025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268098 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.268076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268245 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.268108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xw4g\" (UniqueName: \"kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268245 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.268132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.268245 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.268151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369506 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369506 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xw4g\" (UniqueName: \"kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.369795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.369667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.370406 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.370381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.370514 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.370461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.370514 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.370482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.370514 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.370493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.372140 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.372111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.372140 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.372124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.376858 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.376839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xw4g\" (UniqueName: \"kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g\") pod \"console-9b77d564f-kfnr2\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.501322 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.501218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:48:55.626845 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:55.626808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:48:55.629329 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:48:55.629303 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c7034b_d1f9_4536_a849_ca0dd2324272.slice/crio-c03300880eae1094587e5906f11b569d7a3faa36bb431ae732e244fe5eb852c4 WatchSource:0}: Error finding container c03300880eae1094587e5906f11b569d7a3faa36bb431ae732e244fe5eb852c4: Status 404 returned error can't find the container with id c03300880eae1094587e5906f11b569d7a3faa36bb431ae732e244fe5eb852c4 Jun 09 23:48:56.261417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:56.261385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77d564f-kfnr2" event={"ID":"53c7034b-d1f9-4536-a849-ca0dd2324272","Type":"ContainerStarted","Data":"8addb525c6e8d2e757985d018852dab541c3dc7faa42cfdb00fab7701737fcd1"} Jun 09 23:48:56.261933 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:56.261439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77d564f-kfnr2" event={"ID":"53c7034b-d1f9-4536-a849-ca0dd2324272","Type":"ContainerStarted","Data":"c03300880eae1094587e5906f11b569d7a3faa36bb431ae732e244fe5eb852c4"} Jun 09 23:48:56.278923 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:48:56.278875 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b77d564f-kfnr2" podStartSLOduration=1.278860332 podStartE2EDuration="1.278860332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:48:56.277203701 +0000 UTC m=+331.636325074" watchObservedRunningTime="2026-06-09 23:48:56.278860332 +0000 UTC m=+331.637981705" Jun 09 23:49:00.679779 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:00.679708 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59c547b694-4zv27" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerName="console" containerID="cri-o://4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb" gracePeriod=15 Jun 09 23:49:00.925218 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:00.925195 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:49:01.019341 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019341 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbd9l\" (UniqueName: \"kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019527 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019345 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019527 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019527 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019527 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert\") pod \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\" (UID: \"ed7867e2-d5b4-4e9c-9996-d19ffef6a550\") " Jun 09 23:49:01.019788 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config" (OuterVolumeSpecName: "console-config") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:01.019788 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.019777 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:01.020022 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.020003 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:01.021670 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.021647 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l" (OuterVolumeSpecName: "kube-api-access-wbd9l") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "kube-api-access-wbd9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:49:01.021790 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.021665 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:49:01.021790 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.021744 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed7867e2-d5b4-4e9c-9996-d19ffef6a550" (UID: "ed7867e2-d5b4-4e9c-9996-d19ffef6a550"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:49:01.120694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120659 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-service-ca\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.120694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120686 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-oauth-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.120694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120695 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-oauth-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.120694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120704 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.120950 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120712 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbd9l\" (UniqueName: \"kubernetes.io/projected/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-kube-api-access-wbd9l\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.120950 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.120721 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7867e2-d5b4-4e9c-9996-d19ffef6a550-console-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:01.281006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.280917 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerID="4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb" exitCode=0 Jun 09 23:49:01.281006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.280961 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c547b694-4zv27" Jun 09 23:49:01.281006 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.280961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c547b694-4zv27" event={"ID":"ed7867e2-d5b4-4e9c-9996-d19ffef6a550","Type":"ContainerDied","Data":"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb"} Jun 09 23:49:01.281221 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.281018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c547b694-4zv27" event={"ID":"ed7867e2-d5b4-4e9c-9996-d19ffef6a550","Type":"ContainerDied","Data":"4c52f432c871f77ce9f527351caa69dfbadb5ec5b75991116aaf97972d2ea288"} Jun 09 23:49:01.281221 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.281043 2576 scope.go:117] "RemoveContainer" containerID="4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb" Jun 09 23:49:01.288998 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.288982 2576 scope.go:117] "RemoveContainer" containerID="4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb" Jun 09 23:49:01.289257 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:49:01.289240 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb\": container with ID starting with 4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb not found: ID does not exist" containerID="4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb" Jun 09 23:49:01.289300 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.289266 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb"} err="failed to get container status \"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb\": rpc error: code = NotFound desc = could not find container \"4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb\": container with ID starting with 4951610b125e556ea89d040226104074df7b84822ae1db3c80d62675b71106cb not found: ID does not exist" Jun 09 23:49:01.300383 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.300361 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:49:01.304632 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:01.304602 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c547b694-4zv27"] Jun 09 23:49:03.136841 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:03.136809 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" path="/var/lib/kubelet/pods/ed7867e2-d5b4-4e9c-9996-d19ffef6a550/volumes" Jun 09 23:49:05.502111 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:05.502072 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:49:05.502494 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:05.502129 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:49:05.506806 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:05.506784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:49:06.304632 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:06.304597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:49:06.345801 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:06.345768 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:49:31.368311 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.368272 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77799947d-zjsjj" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerName="console" containerID="cri-o://f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108" gracePeriod=15 Jun 09 23:49:31.617089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.617065 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:49:31.657168 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657095 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657168 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657137 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657462 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657462 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657213 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2mvb\" (UniqueName: \"kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657462 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657462 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657462 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config\") pod \"233182e5-9f7f-474c-9550-e57ec06ffad5\" (UID: \"233182e5-9f7f-474c-9550-e57ec06ffad5\") " Jun 09 23:49:31.657733 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657503 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:31.657733 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657682 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config" (OuterVolumeSpecName: "console-config") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:31.657831 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657783 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:31.657831 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.657814 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca" (OuterVolumeSpecName: "service-ca") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:49:31.659528 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.659498 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:49:31.659659 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.659523 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb" (OuterVolumeSpecName: "kube-api-access-g2mvb") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "kube-api-access-g2mvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:49:31.659659 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.659521 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "233182e5-9f7f-474c-9550-e57ec06ffad5" (UID: "233182e5-9f7f-474c-9550-e57ec06ffad5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:49:31.758242 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758211 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-service-ca\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758242 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758240 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-oauth-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758242 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758250 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-oauth-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758472 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758259 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-console-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758472 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758267 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/233182e5-9f7f-474c-9550-e57ec06ffad5-trusted-ca-bundle\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758472 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758275 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2mvb\" (UniqueName: \"kubernetes.io/projected/233182e5-9f7f-474c-9550-e57ec06ffad5-kube-api-access-g2mvb\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:31.758472 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:31.758283 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/233182e5-9f7f-474c-9550-e57ec06ffad5-console-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:49:32.397610 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.397569 2576 generic.go:356] "Generic (PLEG): container finished" podID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerID="f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108" exitCode=0 Jun 09 23:49:32.398077 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.397640 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77799947d-zjsjj" Jun 09 23:49:32.398077 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.397667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77799947d-zjsjj" event={"ID":"233182e5-9f7f-474c-9550-e57ec06ffad5","Type":"ContainerDied","Data":"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108"} Jun 09 23:49:32.398077 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.397730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77799947d-zjsjj" event={"ID":"233182e5-9f7f-474c-9550-e57ec06ffad5","Type":"ContainerDied","Data":"2565dcbeafca656a9702f1813f3778ab2a6c1922d352274c263e880c22da1de1"} Jun 09 23:49:32.398077 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.397761 2576 scope.go:117] "RemoveContainer" containerID="f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108" Jun 09 23:49:32.406435 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.406416 2576 scope.go:117] "RemoveContainer" containerID="f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108" Jun 09 23:49:32.406710 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:49:32.406691 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108\": container with ID starting with f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108 not found: ID does not exist" containerID="f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108" Jun 09 23:49:32.406760 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.406718 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108"} err="failed to get container status \"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108\": rpc error: code = NotFound desc = could not find container \"f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108\": container with ID starting with f6a3ef20686ee525fd32e5a041395bd30619dd6cb48fcc794b45f588e8bdc108 not found: ID does not exist" Jun 09 23:49:32.416967 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.416943 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:49:32.420708 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:32.420686 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77799947d-zjsjj"] Jun 09 23:49:33.137450 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:33.137418 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" path="/var/lib/kubelet/pods/233182e5-9f7f-474c-9550-e57ec06ffad5/volumes" Jun 09 23:49:49.479868 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.479833 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-br85p"] Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480111 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerName="console" Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480122 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerName="console" Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480144 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerName="console" Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480150 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerName="console" Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480194 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="233182e5-9f7f-474c-9550-e57ec06ffad5" containerName="console" Jun 09 23:49:49.480281 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.480201 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7867e2-d5b4-4e9c-9996-d19ffef6a550" containerName="console" Jun 09 23:49:49.482906 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.482889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.485483 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.485465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-znjj9\"" Jun 09 23:49:49.485752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.485736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 23:49:49.486651 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.486631 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 23:49:49.490426 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.490401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-br85p"] Jun 09 23:49:49.606391 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.606354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.606582 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.606407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkbg\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-kube-api-access-bhkbg\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.707939 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.707886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.708120 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.707957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkbg\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-kube-api-access-bhkbg\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.715677 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.715649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.715787 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.715680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkbg\" (UniqueName: \"kubernetes.io/projected/f3c9c43a-a45c-411c-9a03-477605ba5ef3-kube-api-access-bhkbg\") pod \"cert-manager-cainjector-5d99449ffd-br85p\" (UID: \"f3c9c43a-a45c-411c-9a03-477605ba5ef3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.792332 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.792250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" Jun 09 23:49:49.918193 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.918169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-br85p"] Jun 09 23:49:49.920702 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:49:49.920659 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3c9c43a_a45c_411c_9a03_477605ba5ef3.slice/crio-4ab432fc0df564a917af15b6b2a39f78696c1e99f71a06b8ba7085ea61086d53 WatchSource:0}: Error finding container 4ab432fc0df564a917af15b6b2a39f78696c1e99f71a06b8ba7085ea61086d53: Status 404 returned error can't find the container with id 4ab432fc0df564a917af15b6b2a39f78696c1e99f71a06b8ba7085ea61086d53 Jun 09 23:49:49.922715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:49.922700 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 23:49:50.470916 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:50.470875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" event={"ID":"f3c9c43a-a45c-411c-9a03-477605ba5ef3","Type":"ContainerStarted","Data":"4ab432fc0df564a917af15b6b2a39f78696c1e99f71a06b8ba7085ea61086d53"} Jun 09 23:49:52.480956 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:52.480918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" event={"ID":"f3c9c43a-a45c-411c-9a03-477605ba5ef3","Type":"ContainerStarted","Data":"8bee181a4a0f60df1e70d0eff2ecd54eeb21c1e28f662fb7ef7052085789bc19"} Jun 09 23:49:52.495593 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:49:52.495531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-br85p" podStartSLOduration=1.033750159 podStartE2EDuration="3.495513276s" totalImagesPullingTime="2.461763117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:49:52.494751987 +0000 UTC m=+387.853873361" watchObservedRunningTime="2026-06-09 23:49:52.495513276 +0000 UTC m=+387.854634650" Jun 09 23:50:02.270701 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.270668 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb"] Jun 09 23:50:02.273970 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.273954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.276467 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.276446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qh89s\"" Jun 09 23:50:02.276583 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.276493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 23:50:02.277737 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.277722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 23:50:02.281810 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.281788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb"] Jun 09 23:50:02.420526 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.420486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ctt\" (UniqueName: \"kubernetes.io/projected/38de7c10-ae1d-46ab-bd28-36f755f9a544-kube-api-access-z5ctt\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.420744 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.420567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38de7c10-ae1d-46ab-bd28-36f755f9a544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.521039 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.520967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ctt\" (UniqueName: \"kubernetes.io/projected/38de7c10-ae1d-46ab-bd28-36f755f9a544-kube-api-access-z5ctt\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.521039 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.521033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38de7c10-ae1d-46ab-bd28-36f755f9a544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.521354 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.521336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38de7c10-ae1d-46ab-bd28-36f755f9a544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.528734 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.528706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ctt\" (UniqueName: \"kubernetes.io/projected/38de7c10-ae1d-46ab-bd28-36f755f9a544-kube-api-access-z5ctt\") pod \"openshift-lws-operator-fd8ccff4c-wh9sb\" (UID: \"38de7c10-ae1d-46ab-bd28-36f755f9a544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.583633 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.583583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" Jun 09 23:50:02.710405 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:02.710379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb"] Jun 09 23:50:02.712826 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:50:02.712800 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38de7c10_ae1d_46ab_bd28_36f755f9a544.slice/crio-16fec50a8f5385572e3a6d80301cbe8e084d290be80fe4e76b2d91b0a741640b WatchSource:0}: Error finding container 16fec50a8f5385572e3a6d80301cbe8e084d290be80fe4e76b2d91b0a741640b: Status 404 returned error can't find the container with id 16fec50a8f5385572e3a6d80301cbe8e084d290be80fe4e76b2d91b0a741640b Jun 09 23:50:03.524943 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:03.524909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" event={"ID":"38de7c10-ae1d-46ab-bd28-36f755f9a544","Type":"ContainerStarted","Data":"16fec50a8f5385572e3a6d80301cbe8e084d290be80fe4e76b2d91b0a741640b"} Jun 09 23:50:05.533999 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:05.533964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" event={"ID":"38de7c10-ae1d-46ab-bd28-36f755f9a544","Type":"ContainerStarted","Data":"afd8a82bd5f6c80c707c9c3f7d6eb5dcdc39d2dc5d1e8d8f5e1278f03aba6143"} Jun 09 23:50:05.549168 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:05.549121 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wh9sb" podStartSLOduration=0.855068181 podStartE2EDuration="3.549106781s" totalImagesPullingTime="2.6940386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:50:05.548193202 +0000 UTC m=+400.907314575" watchObservedRunningTime="2026-06-09 23:50:05.549106781 +0000 UTC m=+400.908228154" Jun 09 23:50:21.388396 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.388361 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct"] Jun 09 23:50:21.391113 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.391096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.398783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.398724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 23:50:21.399071 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.399042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 23:50:21.399071 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.399042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 23:50:21.399232 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.399185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 23:50:21.399287 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.399270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x7lsx\"" Jun 09 23:50:21.413786 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.413760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct"] Jun 09 23:50:21.482591 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.482552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-manifests\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.482773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.482641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-tmp\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.482773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.482714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-webhook-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.482773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.482745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlnsm\" (UniqueName: \"kubernetes.io/projected/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-kube-api-access-qlnsm\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.482887 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.482791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-manifests\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-tmp\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-webhook-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583557 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlnsm\" (UniqueName: \"kubernetes.io/projected/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-kube-api-access-qlnsm\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.583793 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.583741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-manifests\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.585715 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.585691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-tmp\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.586210 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.586194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.586349 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.586329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-webhook-cert\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.591678 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.591652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlnsm\" (UniqueName: \"kubernetes.io/projected/6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97-kube-api-access-qlnsm\") pod \"opendatahub-operator-controller-manager-58457dd84-xgbct\" (UID: \"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97\") " pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.700781 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.700712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:21.846117 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:21.846089 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct"] Jun 09 23:50:21.848627 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:50:21.848590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec6b086_3d2c_4114_9dc1_0ce3f71c8e97.slice/crio-9bd1f1cad43222a2bbc1adbdc91257fea2044eebc8d3cde1089cdaa714adf6d7 WatchSource:0}: Error finding container 9bd1f1cad43222a2bbc1adbdc91257fea2044eebc8d3cde1089cdaa714adf6d7: Status 404 returned error can't find the container with id 9bd1f1cad43222a2bbc1adbdc91257fea2044eebc8d3cde1089cdaa714adf6d7 Jun 09 23:50:22.602448 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:22.602414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" event={"ID":"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97","Type":"ContainerStarted","Data":"9bd1f1cad43222a2bbc1adbdc91257fea2044eebc8d3cde1089cdaa714adf6d7"} Jun 09 23:50:25.618224 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:25.618190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" event={"ID":"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97","Type":"ContainerStarted","Data":"6c6e66133312fc90e00a27fb19cee85ef7b89d951c5fb865e6a1c1e79b940b5b"} Jun 09 23:50:26.623483 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:26.623452 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97" containerID="6c6e66133312fc90e00a27fb19cee85ef7b89d951c5fb865e6a1c1e79b940b5b" exitCode=0 Jun 09 23:50:26.623861 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:26.623543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" event={"ID":"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97","Type":"ContainerDied","Data":"6c6e66133312fc90e00a27fb19cee85ef7b89d951c5fb865e6a1c1e79b940b5b"} Jun 09 23:50:27.630033 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:27.630004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" event={"ID":"6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97","Type":"ContainerStarted","Data":"b8aa6de16e23f68b05c4dc90a31a12c4cd76891510e3f682b006748bf506a322"} Jun 09 23:50:27.630424 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:27.630106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:27.651830 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:27.651780 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" podStartSLOduration=2.390877423 podStartE2EDuration="6.651764734s" totalImagesPullingTime="3.26271408s" totalInitContainerRuntime="998.173231ms" isStatefulPod=false podCreationTimestamp="2026-06-09 23:50:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:50:27.649055293 +0000 UTC m=+423.008176667" watchObservedRunningTime="2026-06-09 23:50:27.651764734 +0000 UTC m=+423.010886107" Jun 09 23:50:38.637598 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:38.637518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58457dd84-xgbct" Jun 09 23:50:41.042041 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.042010 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nchmp"] Jun 09 23:50:41.127161 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.127124 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x"] Jun 09 23:50:41.127349 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.127251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.129827 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.129807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 23:50:41.141509 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.141490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nchmp"] Jun 09 23:50:41.141625 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.141600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.144179 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.144161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 23:50:41.144453 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.144433 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 23:50:41.144553 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.144526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 23:50:41.144652 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.144636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cx92s\"" Jun 09 23:50:41.147961 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.147934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x"] Jun 09 23:50:41.260370 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-metrics-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.260539 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hh7\" (UniqueName: \"kubernetes.io/projected/4cd7c95f-27e0-4630-8b6a-65601969178f-kube-api-access-g4hh7\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.260539 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd7c95f-27e0-4630-8b6a-65601969178f-manager-config\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.260539 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cf61bd-5585-4bb8-bacc-0feee19e53de-tls-certs\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.260539 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.260691 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.260585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97mf\" (UniqueName: \"kubernetes.io/projected/78cf61bd-5585-4bb8-bacc-0feee19e53de-kube-api-access-k97mf\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.361267 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97mf\" (UniqueName: \"kubernetes.io/projected/78cf61bd-5585-4bb8-bacc-0feee19e53de-kube-api-access-k97mf\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.361421 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-metrics-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.361421 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hh7\" (UniqueName: \"kubernetes.io/projected/4cd7c95f-27e0-4630-8b6a-65601969178f-kube-api-access-g4hh7\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.361421 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd7c95f-27e0-4630-8b6a-65601969178f-manager-config\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.361421 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cf61bd-5585-4bb8-bacc-0feee19e53de-tls-certs\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.361700 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.361428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.362167 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.362142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd7c95f-27e0-4630-8b6a-65601969178f-manager-config\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.363977 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.363950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cf61bd-5585-4bb8-bacc-0feee19e53de-tls-certs\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.363977 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.363959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.364132 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.364110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd7c95f-27e0-4630-8b6a-65601969178f-metrics-cert\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.371824 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.371804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97mf\" (UniqueName: \"kubernetes.io/projected/78cf61bd-5585-4bb8-bacc-0feee19e53de-kube-api-access-k97mf\") pod \"model-serving-api-5dd488fc48-nchmp\" (UID: \"78cf61bd-5585-4bb8-bacc-0feee19e53de\") " pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.372228 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.372208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hh7\" (UniqueName: \"kubernetes.io/projected/4cd7c95f-27e0-4630-8b6a-65601969178f-kube-api-access-g4hh7\") pod \"lws-controller-manager-6884cb4c8b-skf8x\" (UID: \"4cd7c95f-27e0-4630-8b6a-65601969178f\") " pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.437068 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.437030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:41.451235 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.451202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:41.606108 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.606073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nchmp"] Jun 09 23:50:41.606949 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:50:41.606924 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78cf61bd_5585_4bb8_bacc_0feee19e53de.slice/crio-acb90c4202fec52bdcb0deab409a6a80d9cea91015c9a78334cd1798277da894 WatchSource:0}: Error finding container acb90c4202fec52bdcb0deab409a6a80d9cea91015c9a78334cd1798277da894: Status 404 returned error can't find the container with id acb90c4202fec52bdcb0deab409a6a80d9cea91015c9a78334cd1798277da894 Jun 09 23:50:41.633204 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.633135 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x"] Jun 09 23:50:41.636426 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:50:41.636395 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd7c95f_27e0_4630_8b6a_65601969178f.slice/crio-52d7a99fc5f9c790c6a5ebccb503739a52af7fbc6205bd61131394480f3450b9 WatchSource:0}: Error finding container 52d7a99fc5f9c790c6a5ebccb503739a52af7fbc6205bd61131394480f3450b9: Status 404 returned error can't find the container with id 52d7a99fc5f9c790c6a5ebccb503739a52af7fbc6205bd61131394480f3450b9 Jun 09 23:50:41.694278 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.694240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" event={"ID":"78cf61bd-5585-4bb8-bacc-0feee19e53de","Type":"ContainerStarted","Data":"acb90c4202fec52bdcb0deab409a6a80d9cea91015c9a78334cd1798277da894"} Jun 09 23:50:41.695275 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:41.695252 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" event={"ID":"4cd7c95f-27e0-4630-8b6a-65601969178f","Type":"ContainerStarted","Data":"52d7a99fc5f9c790c6a5ebccb503739a52af7fbc6205bd61131394480f3450b9"} Jun 09 23:50:44.712320 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.712285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" event={"ID":"4cd7c95f-27e0-4630-8b6a-65601969178f","Type":"ContainerStarted","Data":"bea0fd28bdd6573927e71d8d782f017d7e80b5b33c45d2112dc97f94e69e4e2c"} Jun 09 23:50:44.712778 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.712440 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:44.713731 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.713707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" event={"ID":"78cf61bd-5585-4bb8-bacc-0feee19e53de","Type":"ContainerStarted","Data":"7f6a987b3359a91bb1d51723a70273e124d38e21adf6646af2a36ef0a592d054"} Jun 09 23:50:44.713863 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.713758 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:50:44.730124 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.730078 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" podStartSLOduration=1.2330874729999999 podStartE2EDuration="3.730062732s" totalImagesPullingTime="2.496975259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:50:44.728865243 +0000 UTC m=+440.087986619" watchObservedRunningTime="2026-06-09 23:50:44.730062732 +0000 UTC m=+440.089184105" Jun 09 23:50:44.745658 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:44.745597 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" podStartSLOduration=1.191628757 podStartE2EDuration="3.745583014s" totalImagesPullingTime="2.553954257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:50:44.744432614 +0000 UTC m=+440.103553987" watchObservedRunningTime="2026-06-09 23:50:44.745583014 +0000 UTC m=+440.104704383" Jun 09 23:50:55.726285 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:55.726245 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6884cb4c8b-skf8x" Jun 09 23:50:55.728431 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:50:55.728410 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-nchmp" Jun 09 23:51:07.862416 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.862379 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67868bd8d6-blbdq"] Jun 09 23:51:07.865417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.865398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.868159 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.868139 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 23:51:07.868277 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.868230 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v8jlz\"" Jun 09 23:51:07.877988 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.877962 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67868bd8d6-blbdq"] Jun 09 23:51:07.880802 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.880778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/64e770d5-7439-4677-8800-fd7f2298bb3d-redirect-config\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.880897 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.880835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zcv\" (UniqueName: \"kubernetes.io/projected/64e770d5-7439-4677-8800-fd7f2298bb3d-kube-api-access-k8zcv\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.982008 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.981958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zcv\" (UniqueName: \"kubernetes.io/projected/64e770d5-7439-4677-8800-fd7f2298bb3d-kube-api-access-k8zcv\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.982218 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.982065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/64e770d5-7439-4677-8800-fd7f2298bb3d-redirect-config\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.982800 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.982777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/64e770d5-7439-4677-8800-fd7f2298bb3d-redirect-config\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:07.994050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:07.994025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zcv\" (UniqueName: \"kubernetes.io/projected/64e770d5-7439-4677-8800-fd7f2298bb3d-kube-api-access-k8zcv\") pod \"dashboard-redirect-67868bd8d6-blbdq\" (UID: \"64e770d5-7439-4677-8800-fd7f2298bb3d\") " pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:08.177363 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:08.177268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" Jun 09 23:51:08.306521 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:08.306490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67868bd8d6-blbdq"] Jun 09 23:51:08.309946 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:51:08.309916 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e770d5_7439_4677_8800_fd7f2298bb3d.slice/crio-135886b862467e95556b2704bb283a6ffd05d5882e5080d1e3c866929d810fad WatchSource:0}: Error finding container 135886b862467e95556b2704bb283a6ffd05d5882e5080d1e3c866929d810fad: Status 404 returned error can't find the container with id 135886b862467e95556b2704bb283a6ffd05d5882e5080d1e3c866929d810fad Jun 09 23:51:08.823494 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:08.823457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" event={"ID":"64e770d5-7439-4677-8800-fd7f2298bb3d","Type":"ContainerStarted","Data":"135886b862467e95556b2704bb283a6ffd05d5882e5080d1e3c866929d810fad"} Jun 09 23:51:10.833721 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:10.833684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" event={"ID":"64e770d5-7439-4677-8800-fd7f2298bb3d","Type":"ContainerStarted","Data":"ecc9c822dc788ec8807d786355b7523f6a3b6b42c1af3708c3e5b0638c6f6d87"} Jun 09 23:51:10.850112 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:10.850060 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67868bd8d6-blbdq" podStartSLOduration=1.522580863 podStartE2EDuration="3.850044015s" totalImagesPullingTime="2.327463152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:51:10.848601886 +0000 UTC m=+466.207723259" watchObservedRunningTime="2026-06-09 23:51:10.850044015 +0000 UTC m=+466.209165442" Jun 09 23:51:27.859345 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.859314 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv"] Jun 09 23:51:27.864606 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.864582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.867056 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.867038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 23:51:27.867139 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.867038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-w4jdx\"" Jun 09 23:51:27.873686 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.873661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv"] Jun 09 23:51:27.944583 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944583 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944854 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944854 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ctt\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-kube-api-access-k4ctt\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944854 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944854 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.944854 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.945018 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:27.945018 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:27.944940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045600 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.045773 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ctt\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-kube-api-access-k4ctt\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046088 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046088 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046088 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.045992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046247 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.046125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046247 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.046188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046351 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.046315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.046533 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.046511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.048042 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.048021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.048249 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.048233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.053532 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.053511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.053532 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.053522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ctt\" (UniqueName: \"kubernetes.io/projected/acef2bb6-a7ef-46ce-9dfb-f4f9776ad456-kube-api-access-k4ctt\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv\" (UID: \"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.175978 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.175881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:28.310363 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.310338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv"] Jun 09 23:51:28.313031 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:51:28.313005 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacef2bb6_a7ef_46ce_9dfb_f4f9776ad456.slice/crio-d72b58311c9f9acc429c3416c5db038b1e57cee8ad17de2e240244a7721999b0 WatchSource:0}: Error finding container d72b58311c9f9acc429c3416c5db038b1e57cee8ad17de2e240244a7721999b0: Status 404 returned error can't find the container with id d72b58311c9f9acc429c3416c5db038b1e57cee8ad17de2e240244a7721999b0 Jun 09 23:51:28.912329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:28.912287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" event={"ID":"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456","Type":"ContainerStarted","Data":"d72b58311c9f9acc429c3416c5db038b1e57cee8ad17de2e240244a7721999b0"} Jun 09 23:51:31.399587 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:31.399545 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:51:31.399914 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:31.399640 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:51:31.399914 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:31.399670 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:51:31.932160 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:31.932124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" event={"ID":"acef2bb6-a7ef-46ce-9dfb-f4f9776ad456","Type":"ContainerStarted","Data":"ce666eaaca79c09f3205a5d15bdaaf55e51fd8bb108d8c3f20912cc7789afe6b"} Jun 09 23:51:31.953090 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:31.953041 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" podStartSLOduration=1.8691838459999999 podStartE2EDuration="4.953027441s" totalImagesPullingTime="3.083843595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:51:31.950838772 +0000 UTC m=+487.309960144" watchObservedRunningTime="2026-06-09 23:51:31.953027441 +0000 UTC m=+487.312148814" Jun 09 23:51:32.176227 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:32.176184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:32.180927 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:32.180902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:32.936224 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:32.936191 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:32.937282 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:32.937259 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv" Jun 09 23:51:41.702546 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.702518 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:41.705930 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.705906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:41.708652 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.708602 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dj7np\"" Jun 09 23:51:41.708766 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.708676 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 23:51:41.709861 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.709842 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 23:51:41.716663 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.716642 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:41.867870 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.867829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6cw\" (UniqueName: \"kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw\") pod \"kuadrant-operator-catalog-cx79x\" (UID: \"8e6bc4d2-fd34-4927-bafc-683c67ef0865\") " pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:41.969088 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.968999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6cw\" (UniqueName: \"kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw\") pod \"kuadrant-operator-catalog-cx79x\" (UID: \"8e6bc4d2-fd34-4927-bafc-683c67ef0865\") " pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:41.978804 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:41.978780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6cw\" (UniqueName: \"kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw\") pod \"kuadrant-operator-catalog-cx79x\" (UID: \"8e6bc4d2-fd34-4927-bafc-683c67ef0865\") " pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:42.018002 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.017969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:42.075109 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.075081 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:42.149679 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.149641 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:42.153743 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:51:42.153718 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6bc4d2_fd34_4927_bafc_683c67ef0865.slice/crio-89635c196500a15cd22113c3ce4aaee108551e8ccc9c695d50dc0dd3ad5101fc WatchSource:0}: Error finding container 89635c196500a15cd22113c3ce4aaee108551e8ccc9c695d50dc0dd3ad5101fc: Status 404 returned error can't find the container with id 89635c196500a15cd22113c3ce4aaee108551e8ccc9c695d50dc0dd3ad5101fc Jun 09 23:51:42.282868 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.282791 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gxvjg"] Jun 09 23:51:42.287099 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.287083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:42.293655 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.293625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gxvjg"] Jun 09 23:51:42.373103 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.373066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmqg\" (UniqueName: \"kubernetes.io/projected/0412219a-1440-43dd-987d-03e09173371e-kube-api-access-8vmqg\") pod \"kuadrant-operator-catalog-gxvjg\" (UID: \"0412219a-1440-43dd-987d-03e09173371e\") " pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:42.474165 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.474129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmqg\" (UniqueName: \"kubernetes.io/projected/0412219a-1440-43dd-987d-03e09173371e-kube-api-access-8vmqg\") pod \"kuadrant-operator-catalog-gxvjg\" (UID: \"0412219a-1440-43dd-987d-03e09173371e\") " pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:42.482073 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.482047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmqg\" (UniqueName: \"kubernetes.io/projected/0412219a-1440-43dd-987d-03e09173371e-kube-api-access-8vmqg\") pod \"kuadrant-operator-catalog-gxvjg\" (UID: \"0412219a-1440-43dd-987d-03e09173371e\") " pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:42.597448 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.597411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:42.746105 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.746072 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gxvjg"] Jun 09 23:51:42.778219 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:51:42.778189 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0412219a_1440_43dd_987d_03e09173371e.slice/crio-f68f9ff15aa1c725d8149339e34caff2da0fb034094d8e6068a26a15edaf47f1 WatchSource:0}: Error finding container f68f9ff15aa1c725d8149339e34caff2da0fb034094d8e6068a26a15edaf47f1: Status 404 returned error can't find the container with id f68f9ff15aa1c725d8149339e34caff2da0fb034094d8e6068a26a15edaf47f1 Jun 09 23:51:42.980005 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.979930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" event={"ID":"0412219a-1440-43dd-987d-03e09173371e","Type":"ContainerStarted","Data":"f68f9ff15aa1c725d8149339e34caff2da0fb034094d8e6068a26a15edaf47f1"} Jun 09 23:51:42.981031 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:42.981006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" event={"ID":"8e6bc4d2-fd34-4927-bafc-683c67ef0865","Type":"ContainerStarted","Data":"89635c196500a15cd22113c3ce4aaee108551e8ccc9c695d50dc0dd3ad5101fc"} Jun 09 23:51:44.992110 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:44.992069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" event={"ID":"0412219a-1440-43dd-987d-03e09173371e","Type":"ContainerStarted","Data":"072ba9a18a5fbacd79fb91b46d383887e5cea4e7f6a3ec018a76eb7c6c016af0"} Jun 09 23:51:44.993463 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:44.993440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" event={"ID":"8e6bc4d2-fd34-4927-bafc-683c67ef0865","Type":"ContainerStarted","Data":"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2"} Jun 09 23:51:44.993577 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:44.993483 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" podUID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" containerName="registry-server" containerID="cri-o://a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2" gracePeriod=2 Jun 09 23:51:45.008063 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.008015 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" podStartSLOduration=1.511102736 podStartE2EDuration="3.007998658s" totalImagesPullingTime="1.496895922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:51:45.007310614 +0000 UTC m=+500.366431989" watchObservedRunningTime="2026-06-09 23:51:45.007998658 +0000 UTC m=+500.367120031" Jun 09 23:51:45.021359 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.021303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" podStartSLOduration=1.903746481 podStartE2EDuration="4.021284196s" totalImagesPullingTime="2.117537715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:51:45.020313068 +0000 UTC m=+500.379434444" watchObservedRunningTime="2026-06-09 23:51:45.021284196 +0000 UTC m=+500.380405570" Jun 09 23:51:45.250519 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.250461 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:45.404109 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.404077 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb6cw\" (UniqueName: \"kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw\") pod \"8e6bc4d2-fd34-4927-bafc-683c67ef0865\" (UID: \"8e6bc4d2-fd34-4927-bafc-683c67ef0865\") " Jun 09 23:51:45.406181 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.406159 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw" (OuterVolumeSpecName: "kube-api-access-nb6cw") pod "8e6bc4d2-fd34-4927-bafc-683c67ef0865" (UID: "8e6bc4d2-fd34-4927-bafc-683c67ef0865"). InnerVolumeSpecName "kube-api-access-nb6cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:51:45.505213 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.505141 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb6cw\" (UniqueName: \"kubernetes.io/projected/8e6bc4d2-fd34-4927-bafc-683c67ef0865-kube-api-access-nb6cw\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:51:45.999754 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.999718 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" containerID="a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2" exitCode=0 Jun 09 23:51:46.000189 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.999765 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" Jun 09 23:51:46.000189 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.999806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" event={"ID":"8e6bc4d2-fd34-4927-bafc-683c67ef0865","Type":"ContainerDied","Data":"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2"} Jun 09 23:51:46.000189 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.999857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cx79x" event={"ID":"8e6bc4d2-fd34-4927-bafc-683c67ef0865","Type":"ContainerDied","Data":"89635c196500a15cd22113c3ce4aaee108551e8ccc9c695d50dc0dd3ad5101fc"} Jun 09 23:51:46.000189 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:45.999880 2576 scope.go:117] "RemoveContainer" containerID="a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2" Jun 09 23:51:46.008901 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:46.008883 2576 scope.go:117] "RemoveContainer" containerID="a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2" Jun 09 23:51:46.009138 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:51:46.009118 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2\": container with ID starting with a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2 not found: ID does not exist" containerID="a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2" Jun 09 23:51:46.009185 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:46.009146 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2"} err="failed to get container status \"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2\": rpc error: code = NotFound desc = could not find container \"a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2\": container with ID starting with a1ade7cf86680a2599f9b9d9c1ef27002fb620076c68db94bb40bbc8e1f726a2 not found: ID does not exist" Jun 09 23:51:46.020084 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:46.020062 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:46.023262 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:46.023241 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cx79x"] Jun 09 23:51:47.138018 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:47.137987 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" path="/var/lib/kubelet/pods/8e6bc4d2-fd34-4927-bafc-683c67ef0865/volumes" Jun 09 23:51:52.598086 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:52.598046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:52.598507 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:52.598105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:52.619780 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:52.619756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:51:53.053299 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:51:53.053231 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gxvjg" Jun 09 23:52:09.516919 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.516829 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv"] Jun 09 23:52:09.517354 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.517333 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" containerName="registry-server" Jun 09 23:52:09.517445 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.517358 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" containerName="registry-server" Jun 09 23:52:09.517498 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.517451 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e6bc4d2-fd34-4927-bafc-683c67ef0865" containerName="registry-server" Jun 09 23:52:09.520016 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.519993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.522767 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.522749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2fbx\"" Jun 09 23:52:09.534290 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.534266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv"] Jun 09 23:52:09.605525 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.605479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5fz6\" (UniqueName: \"kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.605525 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.605535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.706000 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.705960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5fz6\" (UniqueName: \"kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.706154 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.706009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.706392 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.706375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.715060 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.715023 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5fz6\" (UniqueName: \"kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.829852 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.829770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:09.973726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:09.973685 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv"] Jun 09 23:52:09.977243 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:52:09.977218 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe53d96_2c09_47d5_8d9e_4798c83d13c4.slice/crio-9d44dea909812b336536aaa0b02f10cb8ac0c0fb7f7f083ae727429d5c78971d WatchSource:0}: Error finding container 9d44dea909812b336536aaa0b02f10cb8ac0c0fb7f7f083ae727429d5c78971d: Status 404 returned error can't find the container with id 9d44dea909812b336536aaa0b02f10cb8ac0c0fb7f7f083ae727429d5c78971d Jun 09 23:52:10.106778 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:10.106746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" event={"ID":"5fe53d96-2c09-47d5-8d9e-4798c83d13c4","Type":"ContainerStarted","Data":"9d44dea909812b336536aaa0b02f10cb8ac0c0fb7f7f083ae727429d5c78971d"} Jun 09 23:52:18.152215 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:18.152176 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" event={"ID":"5fe53d96-2c09-47d5-8d9e-4798c83d13c4","Type":"ContainerStarted","Data":"8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b"} Jun 09 23:52:18.152673 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:18.152341 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:18.174922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:18.174869 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" podStartSLOduration=1.688814024 podStartE2EDuration="9.174854514s" totalImagesPullingTime="7.48604049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:52:18.17311855 +0000 UTC m=+533.532239924" watchObservedRunningTime="2026-06-09 23:52:18.174854514 +0000 UTC m=+533.533975887" Jun 09 23:52:20.142025 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.141994 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb"] Jun 09 23:52:20.145684 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.145663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.148219 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.148189 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 23:52:20.148346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.148223 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 23:52:20.148346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.148240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jmztn\"" Jun 09 23:52:20.155114 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.155090 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb"] Jun 09 23:52:20.201046 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.201013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54p4\" (UniqueName: \"kubernetes.io/projected/c7925b73-7192-47f9-8271-42ebd04ee287-kube-api-access-z54p4\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.201203 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.201051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7925b73-7192-47f9-8271-42ebd04ee287-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.201245 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.201208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.301926 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.301892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54p4\" (UniqueName: \"kubernetes.io/projected/c7925b73-7192-47f9-8271-42ebd04ee287-kube-api-access-z54p4\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.301926 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.301932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7925b73-7192-47f9-8271-42ebd04ee287-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.302126 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.302011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.302126 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:20.302116 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 23:52:20.302211 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:20.302191 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert podName:c7925b73-7192-47f9-8271-42ebd04ee287 nodeName:}" failed. No retries permitted until 2026-06-09 23:52:20.802171502 +0000 UTC m=+536.161292853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cr5rb" (UID: "c7925b73-7192-47f9-8271-42ebd04ee287") : secret "plugin-serving-cert" not found Jun 09 23:52:20.302700 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.302681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7925b73-7192-47f9-8271-42ebd04ee287-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.310932 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.310907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54p4\" (UniqueName: \"kubernetes.io/projected/c7925b73-7192-47f9-8271-42ebd04ee287-kube-api-access-z54p4\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.807417 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.807380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:20.809798 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:20.809779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7925b73-7192-47f9-8271-42ebd04ee287-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cr5rb\" (UID: \"c7925b73-7192-47f9-8271-42ebd04ee287\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:21.055692 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:21.055659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" Jun 09 23:52:21.185795 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:21.185770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb"] Jun 09 23:52:21.187906 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:52:21.187873 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7925b73_7192_47f9_8271_42ebd04ee287.slice/crio-ea4df5fafa2cf0e27b04c7bdcd8610715052aa20c2d88543bd3bd0e55de21095 WatchSource:0}: Error finding container ea4df5fafa2cf0e27b04c7bdcd8610715052aa20c2d88543bd3bd0e55de21095: Status 404 returned error can't find the container with id ea4df5fafa2cf0e27b04c7bdcd8610715052aa20c2d88543bd3bd0e55de21095 Jun 09 23:52:22.174155 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:22.174120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" event={"ID":"c7925b73-7192-47f9-8271-42ebd04ee287","Type":"ContainerStarted","Data":"ea4df5fafa2cf0e27b04c7bdcd8610715052aa20c2d88543bd3bd0e55de21095"} Jun 09 23:52:29.160052 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:29.160019 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:30.771493 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.771454 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv"] Jun 09 23:52:30.771983 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.771790 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" containerName="manager" containerID="cri-o://8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b" gracePeriod=2 Jun 09 23:52:30.773551 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.773517 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv"] Jun 09 23:52:30.774818 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:30.774781 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:30.783160 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.783135 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:30.783852 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.783571 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" containerName="manager" Jun 09 23:52:30.783852 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.783588 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" containerName="manager" Jun 09 23:52:30.783852 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.783680 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" containerName="manager" Jun 09 23:52:30.801089 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.801057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:30.804281 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:30.804226 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:30.806885 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.806861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:30.908078 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.907876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4k5\" (UniqueName: \"kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:30.908078 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:30.907990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:31.009306 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:31.009263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4k5\" (UniqueName: \"kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:31.009478 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:31.009354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:31.009738 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:31.009710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:31.022936 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:31.022873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4k5\" (UniqueName: \"kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2w6q7\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:31.157117 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:31.157081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:42.979465 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:42.979442 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:42.982029 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:42.981989 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:42.984776 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:42.984400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:42.988202 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:52:42.988178 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71afebd4_0f26_42b0_9432_5418ca1523bc.slice/crio-0f7325128c3d42cec21225a49dd2bec40c723b852888e9193f6cdc8bdb58aab2 WatchSource:0}: Error finding container 0f7325128c3d42cec21225a49dd2bec40c723b852888e9193f6cdc8bdb58aab2: Status 404 returned error can't find the container with id 0f7325128c3d42cec21225a49dd2bec40c723b852888e9193f6cdc8bdb58aab2 Jun 09 23:52:43.016668 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.016642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume\") pod \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " Jun 09 23:52:43.016799 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.016751 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5fz6\" (UniqueName: \"kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6\") pod \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\" (UID: \"5fe53d96-2c09-47d5-8d9e-4798c83d13c4\") " Jun 09 23:52:43.017007 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.016978 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fe53d96-2c09-47d5-8d9e-4798c83d13c4" (UID: "5fe53d96-2c09-47d5-8d9e-4798c83d13c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 23:52:43.018761 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.018736 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6" (OuterVolumeSpecName: "kube-api-access-n5fz6") pod "5fe53d96-2c09-47d5-8d9e-4798c83d13c4" (UID: "5fe53d96-2c09-47d5-8d9e-4798c83d13c4"). InnerVolumeSpecName "kube-api-access-n5fz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:52:43.117310 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.117220 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-extensions-socket-volume\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:52:43.117310 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.117251 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5fz6\" (UniqueName: \"kubernetes.io/projected/5fe53d96-2c09-47d5-8d9e-4798c83d13c4-kube-api-access-n5fz6\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:52:43.138346 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.138310 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" path="/var/lib/kubelet/pods/5fe53d96-2c09-47d5-8d9e-4798c83d13c4/volumes" Jun 09 23:52:43.289388 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.289353 2576 generic.go:356] "Generic (PLEG): container finished" podID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" containerID="8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b" exitCode=0 Jun 09 23:52:43.289586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.289407 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:43.289586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.289464 2576 scope.go:117] "RemoveContainer" containerID="8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b" Jun 09 23:52:43.291283 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.291250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" event={"ID":"71afebd4-0f26-42b0-9432-5418ca1523bc","Type":"ContainerStarted","Data":"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320"} Jun 09 23:52:43.291414 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.291321 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:43.291414 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.291347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" event={"ID":"71afebd4-0f26-42b0-9432-5418ca1523bc","Type":"ContainerStarted","Data":"0f7325128c3d42cec21225a49dd2bec40c723b852888e9193f6cdc8bdb58aab2"} Jun 09 23:52:43.291998 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:43.291965 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:43.293146 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.293113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" event={"ID":"c7925b73-7192-47f9-8271-42ebd04ee287","Type":"ContainerStarted","Data":"f2d0c33b90aaaf34c46ae09ab2f19ded40b77f2c83391166b1536997fbc6547a"} Jun 09 23:52:43.298457 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.298437 2576 scope.go:117] "RemoveContainer" containerID="8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b" Jun 09 23:52:43.298719 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:43.298697 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b\": container with ID starting with 8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b not found: ID does not exist" containerID="8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b" Jun 09 23:52:43.298801 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.298723 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b"} err="failed to get container status \"8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b\": rpc error: code = NotFound desc = could not find container \"8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b\": container with ID starting with 8a64ad89231ae86d298cd3909d3e3cd6d673157aa179fdf181a6b8a470a1192b not found: ID does not exist" Jun 09 23:52:43.318757 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:43.318726 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:43.337817 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.337770 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cr5rb" podStartSLOduration=1.597528692 podStartE2EDuration="23.337753393s" totalImagesPullingTime="21.740224701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:52:43.336737656 +0000 UTC m=+558.695859029" watchObservedRunningTime="2026-06-09 23:52:43.337753393 +0000 UTC m=+558.696874765" Jun 09 23:52:43.338369 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:43.338344 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" podStartSLOduration=13.338336165 podStartE2EDuration="13.338336165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:52:43.316544996 +0000 UTC m=+558.675666370" watchObservedRunningTime="2026-06-09 23:52:43.338336165 +0000 UTC m=+558.697457570" Jun 09 23:52:43.338922 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:43.338891 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:45.136276 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:45.136240 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dc9mv\" is forbidden: User \"system:node:ip-10-0-129-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-49.ec2.internal' and this object" podUID="5fe53d96-2c09-47d5-8d9e-4798c83d13c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dc9mv" Jun 09 23:52:47.754525 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:47.754493 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:47.754958 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:47.754720 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" podUID="71afebd4-0f26-42b0-9432-5418ca1523bc" containerName="manager" containerID="cri-o://13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320" gracePeriod=10 Jun 09 23:52:48.013022 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.012962 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:48.052434 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.052403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume\") pod \"71afebd4-0f26-42b0-9432-5418ca1523bc\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " Jun 09 23:52:48.052434 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.052436 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk4k5\" (UniqueName: \"kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5\") pod \"71afebd4-0f26-42b0-9432-5418ca1523bc\" (UID: \"71afebd4-0f26-42b0-9432-5418ca1523bc\") " Jun 09 23:52:48.052895 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.052868 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "71afebd4-0f26-42b0-9432-5418ca1523bc" (UID: "71afebd4-0f26-42b0-9432-5418ca1523bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 23:52:48.054490 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.054461 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5" (OuterVolumeSpecName: "kube-api-access-bk4k5") pod "71afebd4-0f26-42b0-9432-5418ca1523bc" (UID: "71afebd4-0f26-42b0-9432-5418ca1523bc"). InnerVolumeSpecName "kube-api-access-bk4k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:52:48.153329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.153292 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71afebd4-0f26-42b0-9432-5418ca1523bc-extensions-socket-volume\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:52:48.153329 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.153322 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk4k5\" (UniqueName: \"kubernetes.io/projected/71afebd4-0f26-42b0-9432-5418ca1523bc-kube-api-access-bk4k5\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:52:48.318814 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.318733 2576 generic.go:356] "Generic (PLEG): container finished" podID="71afebd4-0f26-42b0-9432-5418ca1523bc" containerID="13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320" exitCode=0 Jun 09 23:52:48.318814 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.318776 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" Jun 09 23:52:48.318814 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.318795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" event={"ID":"71afebd4-0f26-42b0-9432-5418ca1523bc","Type":"ContainerDied","Data":"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320"} Jun 09 23:52:48.319120 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.318836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7" event={"ID":"71afebd4-0f26-42b0-9432-5418ca1523bc","Type":"ContainerDied","Data":"0f7325128c3d42cec21225a49dd2bec40c723b852888e9193f6cdc8bdb58aab2"} Jun 09 23:52:48.319120 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.318857 2576 scope.go:117] "RemoveContainer" containerID="13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320" Jun 09 23:52:48.327987 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.327969 2576 scope.go:117] "RemoveContainer" containerID="13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320" Jun 09 23:52:48.328262 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:52:48.328241 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320\": container with ID starting with 13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320 not found: ID does not exist" containerID="13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320" Jun 09 23:52:48.328319 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.328272 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320"} err="failed to get container status \"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320\": rpc error: code = NotFound desc = could not find container \"13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320\": container with ID starting with 13f8e65953b0c7218b9a10371b1742d47559fc74abb5d6fc0b7a072ea53ee320 not found: ID does not exist" Jun 09 23:52:48.339797 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.339772 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:48.343531 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:48.343511 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2w6q7"] Jun 09 23:52:49.138592 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:52:49.138555 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71afebd4-0f26-42b0-9432-5418ca1523bc" path="/var/lib/kubelet/pods/71afebd4-0f26-42b0-9432-5418ca1523bc/volumes" Jun 09 23:53:03.936053 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.936020 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446"] Jun 09 23:53:03.936399 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.936367 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71afebd4-0f26-42b0-9432-5418ca1523bc" containerName="manager" Jun 09 23:53:03.936399 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.936382 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71afebd4-0f26-42b0-9432-5418ca1523bc" containerName="manager" Jun 09 23:53:03.936473 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.936462 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="71afebd4-0f26-42b0-9432-5418ca1523bc" containerName="manager" Jun 09 23:53:03.968168 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.968140 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446"] Jun 09 23:53:03.968311 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.968237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:03.970791 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:03.970770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7xbp7\"" Jun 09 23:53:04.090115 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsg8\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-kube-api-access-ncsg8\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090115 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159f3497-6873-468e-bf1f-c8837c988d88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159f3497-6873-468e-bf1f-c8837c988d88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090337 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090508 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.090508 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.090385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191347 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191347 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159f3497-6873-468e-bf1f-c8837c988d88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191347 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159f3497-6873-468e-bf1f-c8837c988d88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191347 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191705 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsg8\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-kube-api-access-ncsg8\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.191922 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.192064 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.192064 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.191996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.192361 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.192336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159f3497-6873-468e-bf1f-c8837c988d88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.193710 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.193681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159f3497-6873-468e-bf1f-c8837c988d88-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.194045 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.194028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159f3497-6873-468e-bf1f-c8837c988d88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.199169 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.199140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.199268 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.199252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsg8\" (UniqueName: \"kubernetes.io/projected/159f3497-6873-468e-bf1f-c8837c988d88-kube-api-access-ncsg8\") pod \"maas-default-gateway-openshift-default-67497754f6-58446\" (UID: \"159f3497-6873-468e-bf1f-c8837c988d88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.278387 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.278351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:04.414775 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.414744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446"] Jun 09 23:53:04.416889 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:53:04.416854 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159f3497_6873_468e_bf1f_c8837c988d88.slice/crio-af59803100c9d4966dc6d0a1101ef6b77896104d8d62b0e3dc6d57944138c5ef WatchSource:0}: Error finding container af59803100c9d4966dc6d0a1101ef6b77896104d8d62b0e3dc6d57944138c5ef: Status 404 returned error can't find the container with id af59803100c9d4966dc6d0a1101ef6b77896104d8d62b0e3dc6d57944138c5ef Jun 09 23:53:04.419216 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.419183 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:53:04.419326 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.419254 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:53:04.419326 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:04.419315 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:53:05.401297 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:05.401259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" event={"ID":"159f3497-6873-468e-bf1f-c8837c988d88","Type":"ContainerStarted","Data":"bc2106b8db56578b4ef37c1a3eaa58d51d954cd0ad5a7cf1a1af02fc8663a4cf"} Jun 09 23:53:05.401698 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:05.401316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" event={"ID":"159f3497-6873-468e-bf1f-c8837c988d88","Type":"ContainerStarted","Data":"af59803100c9d4966dc6d0a1101ef6b77896104d8d62b0e3dc6d57944138c5ef"} Jun 09 23:53:05.422743 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:05.422687 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" podStartSLOduration=2.422672627 podStartE2EDuration="2.422672627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:53:05.420192241 +0000 UTC m=+580.779313615" watchObservedRunningTime="2026-06-09 23:53:05.422672627 +0000 UTC m=+580.781794000" Jun 09 23:53:06.279560 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:06.279516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:06.284174 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:06.284150 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:06.405809 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:06.405781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:06.406649 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:06.406624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:53:07.645442 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.645399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:07.648191 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.648170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.650786 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.650769 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 23:53:07.656308 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.656289 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:07.722428 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.722394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtv5s\" (UniqueName: \"kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.722428 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.722438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.736712 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.736678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:07.823365 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.823328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtv5s\" (UniqueName: \"kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.823365 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.823370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.824024 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.824006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.842566 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.842538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtv5s\" (UniqueName: \"kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s\") pod \"limitador-limitador-64c94fd64f-t7hjd\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:07.959693 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:07.959577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:08.070411 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.070381 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:53:08.073578 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.073556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.083500 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.083480 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:53:08.098712 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.098692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:08.100682 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:53:08.100661 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9fe168_c052_4695_a9fb_d31647a2f464.slice/crio-818921fe3f2f72042cbe2182a8e1bd29a4bb3152e3eddb1e1ce7d046e7f0848f WatchSource:0}: Error finding container 818921fe3f2f72042cbe2182a8e1bd29a4bb3152e3eddb1e1ce7d046e7f0848f: Status 404 returned error can't find the container with id 818921fe3f2f72042cbe2182a8e1bd29a4bb3152e3eddb1e1ce7d046e7f0848f Jun 09 23:53:08.109770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.109747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:53:08.126804 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.126783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a61f40-8124-481a-8692-ba8c86db85ce-config-file\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.126949 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.126930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mss6\" (UniqueName: \"kubernetes.io/projected/54a61f40-8124-481a-8692-ba8c86db85ce-kube-api-access-8mss6\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.228390 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.228240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mss6\" (UniqueName: \"kubernetes.io/projected/54a61f40-8124-481a-8692-ba8c86db85ce-kube-api-access-8mss6\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.228390 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.228296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a61f40-8124-481a-8692-ba8c86db85ce-config-file\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.233937 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.229793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a61f40-8124-481a-8692-ba8c86db85ce-config-file\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.236910 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.236882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mss6\" (UniqueName: \"kubernetes.io/projected/54a61f40-8124-481a-8692-ba8c86db85ce-kube-api-access-8mss6\") pod \"limitador-limitador-54d6d988d5-kl92n\" (UID: \"54a61f40-8124-481a-8692-ba8c86db85ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.385770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.385728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:08.420304 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.420269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" event={"ID":"2b9fe168-c052-4695-a9fb-d31647a2f464","Type":"ContainerStarted","Data":"818921fe3f2f72042cbe2182a8e1bd29a4bb3152e3eddb1e1ce7d046e7f0848f"} Jun 09 23:53:08.517075 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:08.517050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:53:08.519202 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:53:08.519170 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a61f40_8124_481a_8692_ba8c86db85ce.slice/crio-f42bb2b73b98072409971bcc51c156a5b6ba564c5513a2f887c7149bd53d09ec WatchSource:0}: Error finding container f42bb2b73b98072409971bcc51c156a5b6ba564c5513a2f887c7149bd53d09ec: Status 404 returned error can't find the container with id f42bb2b73b98072409971bcc51c156a5b6ba564c5513a2f887c7149bd53d09ec Jun 09 23:53:09.428798 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:09.428752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" event={"ID":"54a61f40-8124-481a-8692-ba8c86db85ce","Type":"ContainerStarted","Data":"f42bb2b73b98072409971bcc51c156a5b6ba564c5513a2f887c7149bd53d09ec"} Jun 09 23:53:11.441811 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.441772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" event={"ID":"2b9fe168-c052-4695-a9fb-d31647a2f464","Type":"ContainerStarted","Data":"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935"} Jun 09 23:53:11.442271 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.441842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:11.443314 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.443289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" event={"ID":"54a61f40-8124-481a-8692-ba8c86db85ce","Type":"ContainerStarted","Data":"1539f7084b7469efb9500a21993d641a27c1d3e4cbc0a47491ecdaceddaafc8f"} Jun 09 23:53:11.443413 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.443370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:11.458570 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.458527 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" podStartSLOduration=1.665839716 podStartE2EDuration="4.45851379s" totalImagesPullingTime="2.792674074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:53:11.457635445 +0000 UTC m=+586.816756808" watchObservedRunningTime="2026-06-09 23:53:11.45851379 +0000 UTC m=+586.817635192" Jun 09 23:53:11.471771 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:11.471724 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" podStartSLOduration=1.090949778 podStartE2EDuration="3.471712237s" totalImagesPullingTime="2.380762459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:53:11.471647021 +0000 UTC m=+586.830768391" watchObservedRunningTime="2026-06-09 23:53:11.471712237 +0000 UTC m=+586.830833610" Jun 09 23:53:22.448526 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:22.448496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:22.449024 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:22.448561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kl92n" Jun 09 23:53:22.506096 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:22.506060 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:22.506289 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:22.506265 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" podUID="2b9fe168-c052-4695-a9fb-d31647a2f464" containerName="limitador" containerID="cri-o://5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935" gracePeriod=30 Jun 09 23:53:23.056108 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.056086 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:23.171505 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.171469 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtv5s\" (UniqueName: \"kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s\") pod \"2b9fe168-c052-4695-a9fb-d31647a2f464\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " Jun 09 23:53:23.171774 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.171580 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file\") pod \"2b9fe168-c052-4695-a9fb-d31647a2f464\" (UID: \"2b9fe168-c052-4695-a9fb-d31647a2f464\") " Jun 09 23:53:23.171990 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.171966 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file" (OuterVolumeSpecName: "config-file") pod "2b9fe168-c052-4695-a9fb-d31647a2f464" (UID: "2b9fe168-c052-4695-a9fb-d31647a2f464"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:53:23.173639 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.173600 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s" (OuterVolumeSpecName: "kube-api-access-gtv5s") pod "2b9fe168-c052-4695-a9fb-d31647a2f464" (UID: "2b9fe168-c052-4695-a9fb-d31647a2f464"). InnerVolumeSpecName "kube-api-access-gtv5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:53:23.272586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.272554 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtv5s\" (UniqueName: \"kubernetes.io/projected/2b9fe168-c052-4695-a9fb-d31647a2f464-kube-api-access-gtv5s\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:53:23.272586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.272583 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b9fe168-c052-4695-a9fb-d31647a2f464-config-file\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:53:23.498506 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.498426 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b9fe168-c052-4695-a9fb-d31647a2f464" containerID="5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935" exitCode=0 Jun 09 23:53:23.498506 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.498470 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" Jun 09 23:53:23.498506 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.498492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" event={"ID":"2b9fe168-c052-4695-a9fb-d31647a2f464","Type":"ContainerDied","Data":"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935"} Jun 09 23:53:23.498987 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.498531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t7hjd" event={"ID":"2b9fe168-c052-4695-a9fb-d31647a2f464","Type":"ContainerDied","Data":"818921fe3f2f72042cbe2182a8e1bd29a4bb3152e3eddb1e1ce7d046e7f0848f"} Jun 09 23:53:23.498987 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.498554 2576 scope.go:117] "RemoveContainer" containerID="5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935" Jun 09 23:53:23.507270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.507148 2576 scope.go:117] "RemoveContainer" containerID="5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935" Jun 09 23:53:23.507389 ip-10-0-129-49 kubenswrapper[2576]: E0609 23:53:23.507372 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935\": container with ID starting with 5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935 not found: ID does not exist" containerID="5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935" Jun 09 23:53:23.507431 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.507397 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935"} err="failed to get container status \"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935\": rpc error: code = NotFound desc = could not find container \"5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935\": container with ID starting with 5500adee85f2a91780140615712f3fb9d79eb9e8148aa6423304f5a8dd589935 not found: ID does not exist" Jun 09 23:53:23.518985 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.518960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:23.521175 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.521154 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t7hjd"] Jun 09 23:53:23.633187 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.633152 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-27zq5"] Jun 09 23:53:23.633576 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.633559 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9fe168-c052-4695-a9fb-d31647a2f464" containerName="limitador" Jun 09 23:53:23.633684 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.633579 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9fe168-c052-4695-a9fb-d31647a2f464" containerName="limitador" Jun 09 23:53:23.633749 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.633682 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9fe168-c052-4695-a9fb-d31647a2f464" containerName="limitador" Jun 09 23:53:23.636553 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.636531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.639718 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.639664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 23:53:23.641662 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.641641 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-27zq5"] Jun 09 23:53:23.776050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.775960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/008e351a-1e25-4ece-a949-d4b48379fb27-data\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.776050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.776022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdn4t\" (UniqueName: \"kubernetes.io/projected/008e351a-1e25-4ece-a949-d4b48379fb27-kube-api-access-mdn4t\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.877203 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.877168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/008e351a-1e25-4ece-a949-d4b48379fb27-data\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.877378 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.877227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdn4t\" (UniqueName: \"kubernetes.io/projected/008e351a-1e25-4ece-a949-d4b48379fb27-kube-api-access-mdn4t\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.877605 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.877586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/008e351a-1e25-4ece-a949-d4b48379fb27-data\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.886751 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.886729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdn4t\" (UniqueName: \"kubernetes.io/projected/008e351a-1e25-4ece-a949-d4b48379fb27-kube-api-access-mdn4t\") pod \"postgres-69fb4594cf-27zq5\" (UID: \"008e351a-1e25-4ece-a949-d4b48379fb27\") " pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:23.947709 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:23.947669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:24.078682 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:24.078659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-27zq5"] Jun 09 23:53:24.081237 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:53:24.081207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008e351a_1e25_4ece_a949_d4b48379fb27.slice/crio-623692dea101843147bdd3347be2e2505ef3633d734655175b7e27a209e1a673 WatchSource:0}: Error finding container 623692dea101843147bdd3347be2e2505ef3633d734655175b7e27a209e1a673: Status 404 returned error can't find the container with id 623692dea101843147bdd3347be2e2505ef3633d734655175b7e27a209e1a673 Jun 09 23:53:24.504534 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:24.504497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-27zq5" event={"ID":"008e351a-1e25-4ece-a949-d4b48379fb27","Type":"ContainerStarted","Data":"623692dea101843147bdd3347be2e2505ef3633d734655175b7e27a209e1a673"} Jun 09 23:53:25.117094 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:25.117051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:53:25.118434 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:25.118409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:53:25.123088 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:25.123062 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:53:25.125001 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:25.124975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:53:25.142993 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:25.142958 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9fe168-c052-4695-a9fb-d31647a2f464" path="/var/lib/kubelet/pods/2b9fe168-c052-4695-a9fb-d31647a2f464/volumes" Jun 09 23:53:29.092667 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.089857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 23:53:29.534195 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.534163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-27zq5" event={"ID":"008e351a-1e25-4ece-a949-d4b48379fb27","Type":"ContainerStarted","Data":"713dfc1ba3f4c6d3cf09eac7bcd3d293ca04ca7b08eff6b494672263f6509e7e"} Jun 09 23:53:29.534394 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.534272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:29.549271 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.549224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-27zq5" podStartSLOduration=1.545023993 podStartE2EDuration="6.549209374s" totalImagesPullingTime="5.004185381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:53:29.548436458 +0000 UTC m=+604.907557833" watchObservedRunningTime="2026-06-09 23:53:29.549209374 +0000 UTC m=+604.908330747" Jun 09 23:53:29.710942 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.710896 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8f8c5ff7-l8rj6"] Jun 09 23:53:29.714270 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.714246 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.723664 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.723638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8f8c5ff7-l8rj6"] Jun 09 23:53:29.729658 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-oauth-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-service-ca\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-oauth-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729783 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-trusted-ca-bundle\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729936 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.729936 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.729897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtdm\" (UniqueName: \"kubernetes.io/projected/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-kube-api-access-nvtdm\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830567 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtdm\" (UniqueName: \"kubernetes.io/projected/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-kube-api-access-nvtdm\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830567 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-oauth-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830567 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-service-ca\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-oauth-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-trusted-ca-bundle\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.830871 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.830684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.831366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.831335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-oauth-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.831478 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.831427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.831478 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.831430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-service-ca\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.831688 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.831663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-trusted-ca-bundle\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.833210 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.833192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-serving-cert\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.833484 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.833466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-console-oauth-config\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:29.839294 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:29.839265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtdm\" (UniqueName: \"kubernetes.io/projected/00d3a62f-d08c-4b5a-aa5e-30d3531e9755-kube-api-access-nvtdm\") pod \"console-f8f8c5ff7-l8rj6\" (UID: \"00d3a62f-d08c-4b5a-aa5e-30d3531e9755\") " pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:30.025439 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:30.025398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:30.161255 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:30.161229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8f8c5ff7-l8rj6"] Jun 09 23:53:30.163487 ip-10-0-129-49 kubenswrapper[2576]: W0609 23:53:30.163460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d3a62f_d08c_4b5a_aa5e_30d3531e9755.slice/crio-436223768e5c5923a5414e94aab74999d0f36ba39189444d179e6b81463d921b WatchSource:0}: Error finding container 436223768e5c5923a5414e94aab74999d0f36ba39189444d179e6b81463d921b: Status 404 returned error can't find the container with id 436223768e5c5923a5414e94aab74999d0f36ba39189444d179e6b81463d921b Jun 09 23:53:30.542567 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:30.542534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8c5ff7-l8rj6" event={"ID":"00d3a62f-d08c-4b5a-aa5e-30d3531e9755","Type":"ContainerStarted","Data":"ced0a1da963721fb2034238f27af1a29baab7418205bd8316cb00f67cacc55cc"} Jun 09 23:53:30.542745 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:30.542584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8c5ff7-l8rj6" event={"ID":"00d3a62f-d08c-4b5a-aa5e-30d3531e9755","Type":"ContainerStarted","Data":"436223768e5c5923a5414e94aab74999d0f36ba39189444d179e6b81463d921b"} Jun 09 23:53:30.559185 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:30.559136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f8f8c5ff7-l8rj6" podStartSLOduration=1.5591201780000001 podStartE2EDuration="1.559120178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:53:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:53:30.558205246 +0000 UTC m=+605.917326620" watchObservedRunningTime="2026-06-09 23:53:30.559120178 +0000 UTC m=+605.918241551" Jun 09 23:53:35.571917 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:35.571881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-27zq5" Jun 09 23:53:40.026438 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:40.026350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:40.026438 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:40.026426 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:40.031214 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:40.031186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:40.591315 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:40.591290 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f8f8c5ff7-l8rj6" Jun 09 23:53:40.634971 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:53:40.634941 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:54:01.097628 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.097579 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xwqc2"] Jun 09 23:54:01.107956 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.107926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" Jun 09 23:54:01.109844 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.109815 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xwqc2"] Jun 09 23:54:01.111019 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.110994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-ntqrm\"" Jun 09 23:54:01.111144 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.111034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 23:54:01.111144 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.111053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 23:54:01.215741 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.215701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4q2d\" (UniqueName: \"kubernetes.io/projected/5841a333-541d-4c7a-a0b8-b05f9124baa3-kube-api-access-d4q2d\") pod \"keycloak-operator-d67dbbb48-xwqc2\" (UID: \"5841a333-541d-4c7a-a0b8-b05f9124baa3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" Jun 09 23:54:01.317161 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.317111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4q2d\" (UniqueName: \"kubernetes.io/projected/5841a333-541d-4c7a-a0b8-b05f9124baa3-kube-api-access-d4q2d\") pod \"keycloak-operator-d67dbbb48-xwqc2\" (UID: \"5841a333-541d-4c7a-a0b8-b05f9124baa3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" Jun 09 23:54:01.328304 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.328272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4q2d\" (UniqueName: \"kubernetes.io/projected/5841a333-541d-4c7a-a0b8-b05f9124baa3-kube-api-access-d4q2d\") pod \"keycloak-operator-d67dbbb48-xwqc2\" (UID: \"5841a333-541d-4c7a-a0b8-b05f9124baa3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" Jun 09 23:54:01.419316 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.419231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" Jun 09 23:54:01.552957 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.552881 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xwqc2"] Jun 09 23:54:01.686820 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:01.686741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" event={"ID":"5841a333-541d-4c7a-a0b8-b05f9124baa3","Type":"ContainerStarted","Data":"f42d14a1a9fa132e5c7315692abff90d7dcde78d62c5ad10941cbc84ca8c21e0"} Jun 09 23:54:05.657738 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:05.657684 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9b77d564f-kfnr2" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerName="console" containerID="cri-o://8addb525c6e8d2e757985d018852dab541c3dc7faa42cfdb00fab7701737fcd1" gracePeriod=15 Jun 09 23:54:06.301880 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:06.301844 2576 patch_prober.go:28] interesting pod/console-9b77d564f-kfnr2 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 09 23:54:06.302081 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:06.301939 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-9b77d564f-kfnr2" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 09 23:54:06.715856 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:06.715822 2576 generic.go:356] "Generic (PLEG): container finished" podID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerID="8addb525c6e8d2e757985d018852dab541c3dc7faa42cfdb00fab7701737fcd1" exitCode=0 Jun 09 23:54:06.716310 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:06.715891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77d564f-kfnr2" event={"ID":"53c7034b-d1f9-4536-a849-ca0dd2324272","Type":"ContainerDied","Data":"8addb525c6e8d2e757985d018852dab541c3dc7faa42cfdb00fab7701737fcd1"} Jun 09 23:54:06.970960 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:06.970937 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:54:07.075318 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075290 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075430 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075430 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075362 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075430 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075396 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075687 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075451 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075687 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075530 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075687 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075581 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xw4g\" (UniqueName: \"kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g\") pod \"53c7034b-d1f9-4536-a849-ca0dd2324272\" (UID: \"53c7034b-d1f9-4536-a849-ca0dd2324272\") " Jun 09 23:54:07.075840 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca" (OuterVolumeSpecName: "service-ca") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:54:07.075958 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.075815 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config" (OuterVolumeSpecName: "console-config") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:54:07.076060 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.076032 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:54:07.076149 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.076123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 23:54:07.077527 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.077497 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:54:07.077775 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.077750 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 23:54:07.077775 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.077767 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g" (OuterVolumeSpecName: "kube-api-access-2xw4g") pod "53c7034b-d1f9-4536-a849-ca0dd2324272" (UID: "53c7034b-d1f9-4536-a849-ca0dd2324272"). InnerVolumeSpecName "kube-api-access-2xw4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 23:54:07.176328 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176295 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176328 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176327 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-trusted-ca-bundle\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176340 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xw4g\" (UniqueName: \"kubernetes.io/projected/53c7034b-d1f9-4536-a849-ca0dd2324272-kube-api-access-2xw4g\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176353 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7034b-d1f9-4536-a849-ca0dd2324272-console-oauth-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176365 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-service-ca\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176376 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-console-config\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.176516 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.176386 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7034b-d1f9-4536-a849-ca0dd2324272-oauth-serving-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 09 23:54:07.722217 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.722190 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b77d564f-kfnr2" Jun 09 23:54:07.722217 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.722194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b77d564f-kfnr2" event={"ID":"53c7034b-d1f9-4536-a849-ca0dd2324272","Type":"ContainerDied","Data":"c03300880eae1094587e5906f11b569d7a3faa36bb431ae732e244fe5eb852c4"} Jun 09 23:54:07.722770 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.722300 2576 scope.go:117] "RemoveContainer" containerID="8addb525c6e8d2e757985d018852dab541c3dc7faa42cfdb00fab7701737fcd1" Jun 09 23:54:07.724129 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.724103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" event={"ID":"5841a333-541d-4c7a-a0b8-b05f9124baa3","Type":"ContainerStarted","Data":"c15cbeddc37a01f4e435fbe2d17c93e13737f59209311a1163769cbe636b7909"} Jun 09 23:54:07.744375 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.744327 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-xwqc2" podStartSLOduration=1.28316063 podStartE2EDuration="6.74431154s" totalImagesPullingTime="5.46115091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 23:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 23:54:07.743569807 +0000 UTC m=+643.102691180" watchObservedRunningTime="2026-06-09 23:54:07.74431154 +0000 UTC m=+643.103432913" Jun 09 23:54:07.757568 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.757534 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:54:07.763726 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:07.763698 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b77d564f-kfnr2"] Jun 09 23:54:09.139378 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:54:09.139340 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" path="/var/lib/kubelet/pods/53c7034b-d1f9-4536-a849-ca0dd2324272/volumes" Jun 09 23:55:26.389062 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:26.389029 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:55:34.134932 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.134845 2576 generic.go:356] "Generic (PLEG): container finished" podID="159f3497-6873-468e-bf1f-c8837c988d88" containerID="bc2106b8db56578b4ef37c1a3eaa58d51d954cd0ad5a7cf1a1af02fc8663a4cf" exitCode=0 Jun 09 23:55:34.135318 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.134923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" event={"ID":"159f3497-6873-468e-bf1f-c8837c988d88","Type":"ContainerDied","Data":"bc2106b8db56578b4ef37c1a3eaa58d51d954cd0ad5a7cf1a1af02fc8663a4cf"} Jun 09 23:55:34.135318 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.135302 2576 scope.go:117] "RemoveContainer" containerID="bc2106b8db56578b4ef37c1a3eaa58d51d954cd0ad5a7cf1a1af02fc8663a4cf" Jun 09 23:55:34.136267 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.136231 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:55:34.136366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.136313 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:55:34.136366 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:34.136358 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 23:55:35.149128 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:35.149090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" event={"ID":"159f3497-6873-468e-bf1f-c8837c988d88","Type":"ContainerStarted","Data":"6284ab29569acb8728fabd622313e4e99491a6ead579afa2eda16cdcab7e0d41"} Jun 09 23:55:35.279528 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:35.279496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:55:35.280647 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:35.280605 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-58446 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 09 23:55:35.280777 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:35.280679 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" podUID="159f3497-6873-468e-bf1f-c8837c988d88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 09 23:55:36.279595 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:36.279556 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-58446 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 09 23:55:36.280037 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:36.279639 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" podUID="159f3497-6873-468e-bf1f-c8837c988d88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 09 23:55:36.406496 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:36.406464 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:55:37.279459 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:37.279420 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-58446 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 09 23:55:37.279675 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:37.279476 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" podUID="159f3497-6873-468e-bf1f-c8837c988d88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 09 23:55:38.279579 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:38.279541 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-58446 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 09 23:55:38.279759 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:38.279599 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" podUID="159f3497-6873-468e-bf1f-c8837c988d88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 09 23:55:39.283480 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:39.283448 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:55:39.284531 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:55:39.284511 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-58446" Jun 09 23:56:31.128482 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:56:31.128446 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:56:39.822564 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:56:39.822477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:56:48.424694 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:56:48.424659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:56:57.427322 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:56:57.427289 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:57:07.029567 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:57:07.029534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:57:14.731586 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:57:14.731549 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:58:25.149279 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:25.149247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:58:25.152241 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:25.152218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 09 23:58:25.153263 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:25.153245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:58:25.155944 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:25.155927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 09 23:58:43.936752 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:43.936715 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:58:47.326758 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:47.326725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:58:55.033050 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:58:55.033016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:59:06.031250 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:59:06.031216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:59:14.430070 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:59:14.430034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:59:24.425217 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:59:24.425173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:59:33.825322 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:59:33.825287 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 09 23:59:44.731843 ip-10-0-129-49 kubenswrapper[2576]: I0609 23:59:44.731760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:00:00.136230 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.136188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684160-crt4c"] Jun 10 00:00:00.136748 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.136546 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerName="console" Jun 10 00:00:00.136748 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.136557 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerName="console" Jun 10 00:00:00.136748 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.136634 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="53c7034b-d1f9-4536-a849-ca0dd2324272" containerName="console" Jun 10 00:00:00.139629 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.139599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:00.142206 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.142184 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wlt7g\"" Jun 10 00:00:00.148933 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.148897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684160-crt4c"] Jun 10 00:00:00.229686 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.229645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mvj8\" (UniqueName: \"kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8\") pod \"maas-api-key-cleanup-29684160-crt4c\" (UID: \"60e0e962-db93-46d8-9886-9de08ee12173\") " pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:00.330372 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.330319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvj8\" (UniqueName: \"kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8\") pod \"maas-api-key-cleanup-29684160-crt4c\" (UID: \"60e0e962-db93-46d8-9886-9de08ee12173\") " pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:00.338765 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.338733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mvj8\" (UniqueName: \"kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8\") pod \"maas-api-key-cleanup-29684160-crt4c\" (UID: \"60e0e962-db93-46d8-9886-9de08ee12173\") " pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:00.467954 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.467918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:00.609099 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.609074 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684160-crt4c"] Jun 10 00:00:00.612629 ip-10-0-129-49 kubenswrapper[2576]: W0610 00:00:00.612589 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e0e962_db93_46d8_9886_9de08ee12173.slice/crio-079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305 WatchSource:0}: Error finding container 079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305: Status 404 returned error can't find the container with id 079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305 Jun 10 00:00:00.615145 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:00.615125 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:00:01.383380 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:01.383345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" event={"ID":"60e0e962-db93-46d8-9886-9de08ee12173","Type":"ContainerStarted","Data":"079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305"} Jun 10 00:00:09.425314 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:09.425272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" event={"ID":"60e0e962-db93-46d8-9886-9de08ee12173","Type":"ContainerStarted","Data":"34417b036e54cd2706c51b63f5a1ad142aa6f0375176160c72d851e4842f50a7"} Jun 10 00:00:09.440354 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:09.440305 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" podStartSLOduration=1.440045953 podStartE2EDuration="9.440291172s" totalImagesPullingTime="8.000245219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:00:09.439721677 +0000 UTC m=+1004.798843055" watchObservedRunningTime="2026-06-10 00:00:09.440291172 +0000 UTC m=+1004.799412544" Jun 10 00:00:10.431797 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:10.431761 2576 generic.go:356] "Generic (PLEG): container finished" podID="60e0e962-db93-46d8-9886-9de08ee12173" containerID="34417b036e54cd2706c51b63f5a1ad142aa6f0375176160c72d851e4842f50a7" exitCode=0 Jun 10 00:00:10.432176 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:10.431804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" event={"ID":"60e0e962-db93-46d8-9886-9de08ee12173","Type":"ContainerDied","Data":"34417b036e54cd2706c51b63f5a1ad142aa6f0375176160c72d851e4842f50a7"} Jun 10 00:00:11.569990 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:11.569962 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:11.731215 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:11.731112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mvj8\" (UniqueName: \"kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8\") pod \"60e0e962-db93-46d8-9886-9de08ee12173\" (UID: \"60e0e962-db93-46d8-9886-9de08ee12173\") " Jun 10 00:00:11.733293 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:11.733260 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8" (OuterVolumeSpecName: "kube-api-access-9mvj8") pod "60e0e962-db93-46d8-9886-9de08ee12173" (UID: "60e0e962-db93-46d8-9886-9de08ee12173"). InnerVolumeSpecName "kube-api-access-9mvj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:00:11.831982 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:11.831942 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mvj8\" (UniqueName: \"kubernetes.io/projected/60e0e962-db93-46d8-9886-9de08ee12173-kube-api-access-9mvj8\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:00:12.442247 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:12.442220 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" Jun 10 00:00:12.442424 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:12.442257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684160-crt4c" event={"ID":"60e0e962-db93-46d8-9886-9de08ee12173","Type":"ContainerDied","Data":"079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305"} Jun 10 00:00:12.442424 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:12.442304 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="079e3063293fc209b415c28bf7cce11564a0969b559569970d2decfb7f29e305" Jun 10 00:00:16.024267 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:16.024230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:00:19.922053 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:19.922018 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:00:56.319949 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:00:56.319914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:01:12.028725 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:01:12.028639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:01:50.525920 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:01:50.525888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:02:07.525701 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:02:07.525664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:02:20.931204 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:02:20.931167 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:02:36.425354 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:02:36.425319 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:02:39.724411 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:02:39.724327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:03:15.328939 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:15.328900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:03:18.522236 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:18.522197 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:03:25.178651 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:25.178600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:03:25.182694 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:25.182671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:03:25.183873 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:25.183858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:03:25.187926 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:25.187910 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:03:40.422202 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:40.422164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:03:49.622942 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:03:49.622903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:04:06.225459 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:04:06.225421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:04:14.919666 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:04:14.919541 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:04:31.933462 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:04:31.933423 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:04:40.827631 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:04:40.827590 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:12.722191 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:12.722156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:21.637260 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:21.637214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:29.931993 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:29.931954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:37.828887 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:37.828795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:46.332255 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:46.332217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:54.627794 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:54.627762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:05:57.520137 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:05:57.520102 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:06:03.635041 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:06:03.635005 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:06:15.127592 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:06:15.127556 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:06:51.932531 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:06:51.932491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:06:54.025276 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:06:54.025242 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:01.526286 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:01.526249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:05.233004 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:05.232971 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:13.032414 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:13.032323 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:21.435628 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:21.435583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:31.342105 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:31.342060 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:39.226934 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:39.226887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:48.131482 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:48.131449 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:51.923591 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:51.923552 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:07:56.723846 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:07:56.723806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:05.327231 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:05.327196 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:14.227416 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:14.227371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:23.127468 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:23.127429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:25.211005 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:25.210978 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:08:25.214567 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:25.214538 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:08:25.215435 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:25.215419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:08:25.218563 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:25.218543 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:08:31.429722 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:31.429681 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:40.336762 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:40.336667 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:48.827444 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:48.827405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:08:57.233516 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:08:57.233480 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:09:06.327044 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:09:06.327007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:09:15.732966 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:09:15.732934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:09:23.531077 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:09:23.531039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:11:43.641604 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:11:43.641567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:11:48.727084 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:11:48.727051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:14.126720 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:14.126685 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:18.837063 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:18.837023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:28.224523 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:28.224488 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:37.431694 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:37.431659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:47.634314 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:47.634277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:12:58.133563 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:12:58.133523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:06.724820 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:06.724780 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:17.038718 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:17.038676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:25.239414 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:25.239387 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:13:25.243880 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:25.243857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:13:25.243880 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:25.243875 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:13:25.248258 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:25.248238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:13:26.221422 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:26.221387 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:36.426859 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:36.426821 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:45.224816 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:45.224776 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:13:49.425098 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:13:49.425060 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:14:18.126229 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:14:18.126188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:00.136725 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.136643 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684175-4vmd5"] Jun 10 00:15:00.137181 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.137006 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e0e962-db93-46d8-9886-9de08ee12173" containerName="cleanup" Jun 10 00:15:00.137181 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.137017 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e0e962-db93-46d8-9886-9de08ee12173" containerName="cleanup" Jun 10 00:15:00.137181 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.137080 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e0e962-db93-46d8-9886-9de08ee12173" containerName="cleanup" Jun 10 00:15:00.140059 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.140040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:00.142513 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.142491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wlt7g\"" Jun 10 00:15:00.154211 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.154174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684175-4vmd5"] Jun 10 00:15:00.200991 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.200951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mslb2\" (UniqueName: \"kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2\") pod \"maas-api-key-cleanup-29684175-4vmd5\" (UID: \"cb27263b-7369-440c-baa9-5e57e8c92a7e\") " pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:00.302091 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.302035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mslb2\" (UniqueName: \"kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2\") pod \"maas-api-key-cleanup-29684175-4vmd5\" (UID: \"cb27263b-7369-440c-baa9-5e57e8c92a7e\") " pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:00.310680 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.310641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mslb2\" (UniqueName: \"kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2\") pod \"maas-api-key-cleanup-29684175-4vmd5\" (UID: \"cb27263b-7369-440c-baa9-5e57e8c92a7e\") " pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:00.450953 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.450841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:00.595156 ip-10-0-129-49 kubenswrapper[2576]: W0610 00:15:00.595115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb27263b_7369_440c_baa9_5e57e8c92a7e.slice/crio-d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233 WatchSource:0}: Error finding container d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233: Status 404 returned error can't find the container with id d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233 Jun 10 00:15:00.595334 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.595282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684175-4vmd5"] Jun 10 00:15:00.680701 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:00.680660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" event={"ID":"cb27263b-7369-440c-baa9-5e57e8c92a7e","Type":"ContainerStarted","Data":"d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233"} Jun 10 00:15:01.425185 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:01.425145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:01.687639 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:01.687516 2576 generic.go:356] "Generic (PLEG): container finished" podID="cb27263b-7369-440c-baa9-5e57e8c92a7e" containerID="b94a1ae07e3d85a7aef6f5fb2ed8a94a20365afd5a5357ca8bd0c37de99238e2" exitCode=0 Jun 10 00:15:01.687639 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:01.687599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" event={"ID":"cb27263b-7369-440c-baa9-5e57e8c92a7e","Type":"ContainerDied","Data":"b94a1ae07e3d85a7aef6f5fb2ed8a94a20365afd5a5357ca8bd0c37de99238e2"} Jun 10 00:15:02.820037 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:02.820013 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:02.924927 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:02.924877 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mslb2\" (UniqueName: \"kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2\") pod \"cb27263b-7369-440c-baa9-5e57e8c92a7e\" (UID: \"cb27263b-7369-440c-baa9-5e57e8c92a7e\") " Jun 10 00:15:02.926987 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:02.926960 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2" (OuterVolumeSpecName: "kube-api-access-mslb2") pod "cb27263b-7369-440c-baa9-5e57e8c92a7e" (UID: "cb27263b-7369-440c-baa9-5e57e8c92a7e"). InnerVolumeSpecName "kube-api-access-mslb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:15:03.026755 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:03.026666 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mslb2\" (UniqueName: \"kubernetes.io/projected/cb27263b-7369-440c-baa9-5e57e8c92a7e-kube-api-access-mslb2\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:15:03.698628 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:03.698597 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" Jun 10 00:15:03.698801 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:03.698592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684175-4vmd5" event={"ID":"cb27263b-7369-440c-baa9-5e57e8c92a7e","Type":"ContainerDied","Data":"d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233"} Jun 10 00:15:03.698801 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:03.698747 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d51b62e9c00b6ba695e3887c4b690f10ca7d22a925e34d3bde09dfae847fe233" Jun 10 00:15:09.927592 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:09.927555 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:18.528272 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:18.528240 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:26.332795 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:26.332760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:36.019908 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:36.019859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:47.833494 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:47.833460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:15:57.726746 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:15:57.726706 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:01.741386 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:01.741349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:11.722646 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:11.722532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:20.031676 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:20.031638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:27.531504 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:27.531466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:37.931896 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:37.931850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:16:56.629072 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:16:56.629034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:05.029308 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:05.029265 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:13.628290 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:13.628251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:22.028476 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:22.028438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:39.131911 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:39.131822 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:46.929194 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:46.929160 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:17:56.325152 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:17:56.325112 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:04.668405 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:04.668369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:13.726795 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:13.726759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:22.434593 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:22.434554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:25.268121 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:25.268081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:18:25.272462 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:25.272438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:18:25.275230 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:25.275208 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:18:25.279631 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:25.279600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:18:31.723667 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:31.723603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:43.829121 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:43.829085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:18:53.724391 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:18:53.724353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:04.223527 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:04.223486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:14.338591 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:14.338502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:20.021469 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:20.021432 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:23.021408 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:23.021366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:29.877126 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:29.877088 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:37.125048 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:37.125012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:19:53.526370 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:19:53.526335 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:02.532432 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:02.532392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:11.338882 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:11.338842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:17.238247 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:17.238209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:40.826455 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:40.826373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:54.214135 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.214104 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:20:54.214494 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.214479 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb27263b-7369-440c-baa9-5e57e8c92a7e" containerName="cleanup" Jun 10 00:20:54.214535 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.214493 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb27263b-7369-440c-baa9-5e57e8c92a7e" containerName="cleanup" Jun 10 00:20:54.214579 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.214564 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb27263b-7369-440c-baa9-5e57e8c92a7e" containerName="cleanup" Jun 10 00:20:54.217646 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.217622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.220351 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.220328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fcd86ce8-openshift-default-dockercfg-dx4xz\"" Jun 10 00:20:54.234558 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234689 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234689 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234911 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234911 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234911 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.234911 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.235047 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.235047 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.234963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nbsm\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.236606 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.236583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:20:54.330789 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.330759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kl92n"] Jun 10 00:20:54.335572 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335661 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335661 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335730 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335730 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335820 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nbsm\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335820 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335922 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.335922 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.335860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.336041 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.336018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.336273 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.336044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.336273 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.336245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.336411 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.336285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.336518 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.336499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.338134 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.338114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.338381 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.338360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.343221 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.343196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.343306 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.343254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nbsm\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm\") pod \"e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.530143 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.530057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:54.667019 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.666990 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:20:54.669058 ip-10-0-129-49 kubenswrapper[2576]: W0610 00:20:54.669027 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85395cd_9af2_4400_87b4_af58d068bed7.slice/crio-dafa1fd7364cc31c54bb192bd48a5c9621b07d707f17ec3f7bbe2915eda6265f WatchSource:0}: Error finding container dafa1fd7364cc31c54bb192bd48a5c9621b07d707f17ec3f7bbe2915eda6265f: Status 404 returned error can't find the container with id dafa1fd7364cc31c54bb192bd48a5c9621b07d707f17ec3f7bbe2915eda6265f Jun 10 00:20:54.671201 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.671171 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:20:54.671273 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.671234 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:20:54.671311 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:54.671278 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:20:55.368373 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:55.368336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" event={"ID":"f85395cd-9af2-4400-87b4-af58d068bed7","Type":"ContainerStarted","Data":"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4"} Jun 10 00:20:55.368817 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:55.368389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" event={"ID":"f85395cd-9af2-4400-87b4-af58d068bed7","Type":"ContainerStarted","Data":"dafa1fd7364cc31c54bb192bd48a5c9621b07d707f17ec3f7bbe2915eda6265f"} Jun 10 00:20:55.391112 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:55.391061 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" podStartSLOduration=1.39104323 podStartE2EDuration="1.39104323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:20:55.388377164 +0000 UTC m=+2250.747498538" watchObservedRunningTime="2026-06-10 00:20:55.39104323 +0000 UTC m=+2250.750164606" Jun 10 00:20:55.531276 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:55.531236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:55.536365 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:55.536337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:56.374222 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:56.374195 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:20:56.375196 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:20:56.375176 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:21:00.656262 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:00.656224 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:21:00.656701 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:00.656426 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" podUID="f85395cd-9af2-4400-87b4-af58d068bed7" containerName="istio-proxy" containerID="cri-o://b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4" gracePeriod=30 Jun 10 00:21:05.912933 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.912872 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:21:05.938927 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.938897 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939063 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.938946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939137 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939118 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939179 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939158 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939235 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939181 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939235 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939339 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939226 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:21:05.939391 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939333 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nbsm\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939391 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939556 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939391 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket\") pod \"f85395cd-9af2-4400-87b4-af58d068bed7\" (UID: \"f85395cd-9af2-4400-87b4-af58d068bed7\") " Jun 10 00:21:05.939556 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939417 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:05.939556 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939436 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:05.939772 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939740 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85395cd-9af2-4400-87b4-af58d068bed7-istiod-ca-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:05.939772 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939758 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:05.939864 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939775 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data" (OuterVolumeSpecName: "istio-data") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:05.939864 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939766 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-credential-socket\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:05.939864 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.939818 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-certs\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:05.941446 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.941422 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token" (OuterVolumeSpecName: "istio-token") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:21:05.941704 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.941683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 00:21:05.941785 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.941695 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm" (OuterVolumeSpecName: "kube-api-access-4nbsm") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "kube-api-access-4nbsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:21:05.941920 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:05.941896 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f85395cd-9af2-4400-87b4-af58d068bed7" (UID: "f85395cd-9af2-4400-87b4-af58d068bed7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:06.040960 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040924 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nbsm\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-kube-api-access-4nbsm\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.040960 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040955 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-envoy\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.040960 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040964 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-workload-socket\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.041217 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040975 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85395cd-9af2-4400-87b4-af58d068bed7-istio-data\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.041217 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040983 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85395cd-9af2-4400-87b4-af58d068bed7-istio-token\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.041217 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.040991 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85395cd-9af2-4400-87b4-af58d068bed7-istio-podinfo\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:06.421342 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.421310 2576 generic.go:356] "Generic (PLEG): container finished" podID="f85395cd-9af2-4400-87b4-af58d068bed7" containerID="b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4" exitCode=0 Jun 10 00:21:06.421526 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.421353 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" Jun 10 00:21:06.421526 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.421394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" event={"ID":"f85395cd-9af2-4400-87b4-af58d068bed7","Type":"ContainerDied","Data":"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4"} Jun 10 00:21:06.421526 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.421450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p" event={"ID":"f85395cd-9af2-4400-87b4-af58d068bed7","Type":"ContainerDied","Data":"dafa1fd7364cc31c54bb192bd48a5c9621b07d707f17ec3f7bbe2915eda6265f"} Jun 10 00:21:06.421526 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.421479 2576 scope.go:117] "RemoveContainer" containerID="b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4" Jun 10 00:21:06.432565 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.432500 2576 scope.go:117] "RemoveContainer" containerID="b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4" Jun 10 00:21:06.433014 ip-10-0-129-49 kubenswrapper[2576]: E0610 00:21:06.432994 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4\": container with ID starting with b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4 not found: ID does not exist" containerID="b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4" Jun 10 00:21:06.433071 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.433023 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4"} err="failed to get container status \"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4\": rpc error: code = NotFound desc = could not find container \"b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4\": container with ID starting with b3f5f771bedf6cda8ed5bc9ed4a0972aea2e1dd4b288e8d84baa87f84e4044b4 not found: ID does not exist" Jun 10 00:21:06.456479 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.456442 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:21:06.460344 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.460319 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fcd86ce8-openshift-default-7b647b45dd-9zg6p"] Jun 10 00:21:06.632160 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.632124 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:06.632469 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.632457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85395cd-9af2-4400-87b4-af58d068bed7" containerName="istio-proxy" Jun 10 00:21:06.632517 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.632470 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85395cd-9af2-4400-87b4-af58d068bed7" containerName="istio-proxy" Jun 10 00:21:06.632559 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.632546 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85395cd-9af2-4400-87b4-af58d068bed7" containerName="istio-proxy" Jun 10 00:21:06.636726 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.636709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.639663 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.639634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c25c06b-openshift-default-dockercfg-wzscj\"" Jun 10 00:21:06.646871 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.646811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:06.748165 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748165 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jf7p\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.748660 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.748386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849509 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849509 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jf7p\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849786 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849850 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849850 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849972 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.849972 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.849951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850077 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850077 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850176 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850223 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850329 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850499 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.850608 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.850571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.852286 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.852265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.852502 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.852485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.864013 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.863991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.864122 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.864091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jf7p\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p\") pod \"e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:06.950628 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:06.950592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:07.086838 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.086810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:07.088593 ip-10-0-129-49 kubenswrapper[2576]: W0610 00:21:07.088568 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b651b4_ca5c_4e40_a33a_b468953116db.slice/crio-824263d65b855c170e655f31390226f4b08c4a8a3301f321aa7bf99d81f8a93f WatchSource:0}: Error finding container 824263d65b855c170e655f31390226f4b08c4a8a3301f321aa7bf99d81f8a93f: Status 404 returned error can't find the container with id 824263d65b855c170e655f31390226f4b08c4a8a3301f321aa7bf99d81f8a93f Jun 10 00:21:07.090726 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.090697 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:21:07.090795 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.090761 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:21:07.090840 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.090792 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 00:21:07.138151 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.138126 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85395cd-9af2-4400-87b4-af58d068bed7" path="/var/lib/kubelet/pods/f85395cd-9af2-4400-87b4-af58d068bed7/volumes" Jun 10 00:21:07.428755 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.428707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" event={"ID":"40b651b4-ca5c-4e40-a33a-b468953116db","Type":"ContainerStarted","Data":"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace"} Jun 10 00:21:07.428966 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.428861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" event={"ID":"40b651b4-ca5c-4e40-a33a-b468953116db","Type":"ContainerStarted","Data":"824263d65b855c170e655f31390226f4b08c4a8a3301f321aa7bf99d81f8a93f"} Jun 10 00:21:07.453532 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.453476 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" podStartSLOduration=1.453460175 podStartE2EDuration="1.453460175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:07.452016457 +0000 UTC m=+2262.811137842" watchObservedRunningTime="2026-06-10 00:21:07.453460175 +0000 UTC m=+2262.812581548" Jun 10 00:21:07.951051 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:07.951012 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:08.955920 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:08.955887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:09.444919 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:09.444887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:09.445981 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:09.445964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:13.998376 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:13.998341 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:13.998902 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:13.998536 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" podUID="40b651b4-ca5c-4e40-a33a-b468953116db" containerName="istio-proxy" containerID="cri-o://f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace" gracePeriod=30 Jun 10 00:21:19.252207 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.252182 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:19.372272 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372226 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372455 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372455 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372455 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372368 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372455 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372397 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372688 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372688 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372493 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372688 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372688 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372579 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jf7p\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p\") pod \"40b651b4-ca5c-4e40-a33a-b468953116db\" (UID: \"40b651b4-ca5c-4e40-a33a-b468953116db\") " Jun 10 00:21:19.372893 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372723 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:21:19.372893 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372783 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:19.372893 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372816 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data" (OuterVolumeSpecName: "istio-data") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:19.373049 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.372981 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:19.373139 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373108 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:19.373274 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373253 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-data\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.373274 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373270 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-socket\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.373392 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373279 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-credential-socket\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.373392 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373289 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b651b4-ca5c-4e40-a33a-b468953116db-istiod-ca-cert\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.373392 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.373298 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-workload-certs\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.374515 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.374492 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:21:19.374784 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.374762 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p" (OuterVolumeSpecName: "kube-api-access-7jf7p") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "kube-api-access-7jf7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:21:19.374976 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.374949 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token" (OuterVolumeSpecName: "istio-token") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:21:19.374976 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.374962 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40b651b4-ca5c-4e40-a33a-b468953116db" (UID: "40b651b4-ca5c-4e40-a33a-b468953116db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 00:21:19.473971 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.473933 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b651b4-ca5c-4e40-a33a-b468953116db-istio-envoy\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.473971 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.473963 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-istio-token\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.473971 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.473971 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b651b4-ca5c-4e40-a33a-b468953116db-istio-podinfo\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.473971 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.473981 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jf7p\" (UniqueName: \"kubernetes.io/projected/40b651b4-ca5c-4e40-a33a-b468953116db-kube-api-access-7jf7p\") on node \"ip-10-0-129-49.ec2.internal\" DevicePath \"\"" Jun 10 00:21:19.497378 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.497343 2576 generic.go:356] "Generic (PLEG): container finished" podID="40b651b4-ca5c-4e40-a33a-b468953116db" containerID="f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace" exitCode=0 Jun 10 00:21:19.497511 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.497390 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" Jun 10 00:21:19.497511 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.497430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" event={"ID":"40b651b4-ca5c-4e40-a33a-b468953116db","Type":"ContainerDied","Data":"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace"} Jun 10 00:21:19.497511 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.497477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs" event={"ID":"40b651b4-ca5c-4e40-a33a-b468953116db","Type":"ContainerDied","Data":"824263d65b855c170e655f31390226f4b08c4a8a3301f321aa7bf99d81f8a93f"} Jun 10 00:21:19.497511 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.497498 2576 scope.go:117] "RemoveContainer" containerID="f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace" Jun 10 00:21:19.506868 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.506851 2576 scope.go:117] "RemoveContainer" containerID="f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace" Jun 10 00:21:19.507154 ip-10-0-129-49 kubenswrapper[2576]: E0610 00:21:19.507133 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace\": container with ID starting with f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace not found: ID does not exist" containerID="f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace" Jun 10 00:21:19.507205 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.507163 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace"} err="failed to get container status \"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace\": rpc error: code = NotFound desc = could not find container \"f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace\": container with ID starting with f431159a46637edb62587f0fe89373fd01f29605bbdf08b4cafd404be781dace not found: ID does not exist" Jun 10 00:21:19.518052 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.518029 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:19.522196 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:19.522175 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c25c06b-openshift-default-6c8ffc9fdd-d48qs"] Jun 10 00:21:21.138478 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:21.138438 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b651b4-ca5c-4e40-a33a-b468953116db" path="/var/lib/kubelet/pods/40b651b4-ca5c-4e40-a33a-b468953116db/volumes" Jun 10 00:21:30.375131 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:30.375086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67868bd8d6-blbdq_64e770d5-7439-4677-8800-fd7f2298bb3d/nginx/0.log" Jun 10 00:21:30.913531 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:30.913501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684160-crt4c_60e0e962-db93-46d8-9886-9de08ee12173/cleanup/0.log" Jun 10 00:21:31.019673 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:31.019639 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684175-4vmd5_cb27263b-7369-440c-baa9-5e57e8c92a7e/cleanup/0.log" Jun 10 00:21:31.247563 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:31.247456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nchmp_78cf61bd-5585-4bb8-bacc-0feee19e53de/server/0.log" Jun 10 00:21:31.736747 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:31.736720 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58457dd84-xgbct_6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97/copy-manifests/0.log" Jun 10 00:21:31.742828 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:31.742806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58457dd84-xgbct_6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97/manager/0.log" Jun 10 00:21:31.843841 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:31.843803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-27zq5_008e351a-1e25-4ece-a949-d4b48379fb27/postgres/0.log" Jun 10 00:21:33.367170 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:33.367146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cr5rb_c7925b73-7192-47f9-8271-42ebd04ee287/kuadrant-console-plugin/0.log" Jun 10 00:21:33.480354 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:33.480309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gxvjg_0412219a-1440-43dd-987d-03e09173371e/registry-server/0.log" Jun 10 00:21:33.700182 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:33.700097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kl92n_54a61f40-8124-481a-8692-ba8c86db85ce/limitador/0.log" Jun 10 00:21:34.139582 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:34.139553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv_acef2bb6-a7ef-46ce-9dfb-f4f9776ad456/istio-proxy/0.log" Jun 10 00:21:34.586608 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:34.586579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/1.log" Jun 10 00:21:34.912676 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:34.912566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 10 00:21:40.077582 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.077541 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ftpm/must-gather-w68jf"] Jun 10 00:21:40.078028 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.077942 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b651b4-ca5c-4e40-a33a-b468953116db" containerName="istio-proxy" Jun 10 00:21:40.078028 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.077960 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b651b4-ca5c-4e40-a33a-b468953116db" containerName="istio-proxy" Jun 10 00:21:40.078120 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.078090 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b651b4-ca5c-4e40-a33a-b468953116db" containerName="istio-proxy" Jun 10 00:21:40.082722 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.082701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.085373 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.085351 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ftpm\"/\"kube-root-ca.crt\"" Jun 10 00:21:40.086552 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.086533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ftpm\"/\"openshift-service-ca.crt\"" Jun 10 00:21:40.086699 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.086540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ftpm\"/\"default-dockercfg-zjxzr\"" Jun 10 00:21:40.088790 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.088768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ftpm/must-gather-w68jf"] Jun 10 00:21:40.149800 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.149759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f0c9d750-899b-4d66-b5a3-712ee6c4346d-must-gather-output\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.149983 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.149908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxgx9\" (UniqueName: \"kubernetes.io/projected/f0c9d750-899b-4d66-b5a3-712ee6c4346d-kube-api-access-lxgx9\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.251135 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.251095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxgx9\" (UniqueName: \"kubernetes.io/projected/f0c9d750-899b-4d66-b5a3-712ee6c4346d-kube-api-access-lxgx9\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.251321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.251162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f0c9d750-899b-4d66-b5a3-712ee6c4346d-must-gather-output\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.251478 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.251462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f0c9d750-899b-4d66-b5a3-712ee6c4346d-must-gather-output\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.261955 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.261925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxgx9\" (UniqueName: \"kubernetes.io/projected/f0c9d750-899b-4d66-b5a3-712ee6c4346d-kube-api-access-lxgx9\") pod \"must-gather-w68jf\" (UID: \"f0c9d750-899b-4d66-b5a3-712ee6c4346d\") " pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.393566 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.393516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ftpm/must-gather-w68jf" Jun 10 00:21:40.524991 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.524885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ftpm/must-gather-w68jf"] Jun 10 00:21:40.527790 ip-10-0-129-49 kubenswrapper[2576]: W0610 00:21:40.527762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c9d750_899b_4d66_b5a3_712ee6c4346d.slice/crio-570c7c896ff4d337090891bb88d99bf15575edac10e7487187a10857a1524ad0 WatchSource:0}: Error finding container 570c7c896ff4d337090891bb88d99bf15575edac10e7487187a10857a1524ad0: Status 404 returned error can't find the container with id 570c7c896ff4d337090891bb88d99bf15575edac10e7487187a10857a1524ad0 Jun 10 00:21:40.529589 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.529569 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:21:40.603339 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:40.603300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ftpm/must-gather-w68jf" event={"ID":"f0c9d750-899b-4d66-b5a3-712ee6c4346d","Type":"ContainerStarted","Data":"570c7c896ff4d337090891bb88d99bf15575edac10e7487187a10857a1524ad0"} Jun 10 00:21:41.609989 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:41.609958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ftpm/must-gather-w68jf" event={"ID":"f0c9d750-899b-4d66-b5a3-712ee6c4346d","Type":"ContainerStarted","Data":"dd5a962e6f4a5ccdf8cafe1dacbd5a05b778b659018047269fd599b8f9128b68"} Jun 10 00:21:42.624163 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:42.624116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ftpm/must-gather-w68jf" event={"ID":"f0c9d750-899b-4d66-b5a3-712ee6c4346d","Type":"ContainerStarted","Data":"f99dc7d2dd9b24f777b53cab944e4bbc203e9779ec3ebf871c0738cdd71a983f"} Jun 10 00:21:42.642244 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:42.642194 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ftpm/must-gather-w68jf" podStartSLOduration=1.6614452069999999 podStartE2EDuration="2.642177771s" totalImagesPullingTime="980.732564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:42.640095904 +0000 UTC m=+2297.999217278" watchObservedRunningTime="2026-06-10 00:21:42.642177771 +0000 UTC m=+2298.001299144" Jun 10 00:21:43.221967 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:43.221933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4j6k5_389ad0ef-70b0-44f6-b2a0-7c8bfdcf8d46/global-pull-secret-syncer/0.log" Jun 10 00:21:43.399213 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:43.399159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x57mv_5e20bcd2-f0b6-4100-b093-5dfdd61ad04d/konnectivity-agent/0.log" Jun 10 00:21:43.418182 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:43.418147 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-49.ec2.internal_385455ab1c70eb0efa9ea54b12a6ae04/haproxy/0.log" Jun 10 00:21:47.996585 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:47.996553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cr5rb_c7925b73-7192-47f9-8271-42ebd04ee287/kuadrant-console-plugin/0.log" Jun 10 00:21:48.030227 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:48.030195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gxvjg_0412219a-1440-43dd-987d-03e09173371e/registry-server/0.log" Jun 10 00:21:48.156863 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:48.156829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kl92n_54a61f40-8124-481a-8692-ba8c86db85ce/limitador/0.log" Jun 10 00:21:50.222712 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.222677 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rs4z5_a2452fb8-db43-40c7-acba-17ccfe1c5366/cluster-monitoring-operator/0.log" Jun 10 00:21:50.340804 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.340482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-fvrqq_1b7c8835-b257-4de2-889f-8f1e43618462/monitoring-plugin/0.log" Jun 10 00:21:50.371687 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.371651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jcvf5_59cdeb00-7a69-421c-baa2-2e1dd1bd162c/node-exporter/0.log" Jun 10 00:21:50.393258 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.393211 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jcvf5_59cdeb00-7a69-421c-baa2-2e1dd1bd162c/kube-rbac-proxy/0.log" Jun 10 00:21:50.414523 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.414378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jcvf5_59cdeb00-7a69-421c-baa2-2e1dd1bd162c/init-textfile/0.log" Jun 10 00:21:50.794232 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.794199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-225ll_2679198c-4e84-4da0-bcd4-e13cea5dad31/prometheus-operator/0.log" Jun 10 00:21:50.808120 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.808090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-225ll_2679198c-4e84-4da0-bcd4-e13cea5dad31/kube-rbac-proxy/0.log" Jun 10 00:21:50.827086 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.827053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-4ssb5_6dbe6ab9-e0b3-47b5-a83b-a0a1378efa65/prometheus-operator-admission-webhook/0.log" Jun 10 00:21:50.851635 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.851513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5858c7645d-qjwwq_60a2fbdc-3604-447e-9333-0d7133fcbae8/telemeter-client/0.log" Jun 10 00:21:50.867171 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.867140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5858c7645d-qjwwq_60a2fbdc-3604-447e-9333-0d7133fcbae8/reload/0.log" Jun 10 00:21:50.885924 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:50.885890 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5858c7645d-qjwwq_60a2fbdc-3604-447e-9333-0d7133fcbae8/kube-rbac-proxy/0.log" Jun 10 00:21:53.346760 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:53.346723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/2.log" Jun 10 00:21:53.354199 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:53.354160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-29s68_a11c11a3-ae56-4526-9916-fff7f992d983/console-operator/3.log" Jun 10 00:21:53.883383 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:53.883354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f8f8c5ff7-l8rj6_00d3a62f-d08c-4b5a-aa5e-30d3531e9755/console/0.log" Jun 10 00:21:55.388096 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.388059 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9"] Jun 10 00:21:55.396445 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.396417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.400474 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.400336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9"] Jun 10 00:21:55.506763 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.506370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-sys\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.506763 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.506444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wns\" (UniqueName: \"kubernetes.io/projected/1ff06e03-8b8d-4d2a-878d-a6896644eee7-kube-api-access-k2wns\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.506763 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.506486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-podres\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.506763 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.506576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-proc\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.506763 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.506601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-lib-modules\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608048 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-sys\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608048 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wns\" (UniqueName: \"kubernetes.io/projected/1ff06e03-8b8d-4d2a-878d-a6896644eee7-kube-api-access-k2wns\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-podres\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-proc\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-lib-modules\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-sys\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-podres\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608321 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-proc\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.608697 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.608330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ff06e03-8b8d-4d2a-878d-a6896644eee7-lib-modules\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.616988 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.616952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wns\" (UniqueName: \"kubernetes.io/projected/1ff06e03-8b8d-4d2a-878d-a6896644eee7-kube-api-access-k2wns\") pod \"perf-node-gather-daemonset-p4nn9\" (UID: \"1ff06e03-8b8d-4d2a-878d-a6896644eee7\") " pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.713353 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.713269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:55.801040 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.801007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27fdp_b30d5046-5b10-4a27-9e62-cd8ad139e8bb/dns/0.log" Jun 10 00:21:55.818505 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.818475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27fdp_b30d5046-5b10-4a27-9e62-cd8ad139e8bb/kube-rbac-proxy/0.log" Jun 10 00:21:55.884985 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.884948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9"] Jun 10 00:21:55.927068 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:55.927041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjmnv_556c0f7e-3955-4a32-b08e-7e04de7b4372/dns-node-resolver/0.log" Jun 10 00:21:56.505370 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:56.505330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8slhs_18479d69-08da-4dfd-9cd0-fb4d907b4eea/node-ca/0.log" Jun 10 00:21:56.722715 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:56.722553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" event={"ID":"1ff06e03-8b8d-4d2a-878d-a6896644eee7","Type":"ContainerStarted","Data":"212a86d8d57eca2dd9e52975f4d529e67caaf6979d9333ae9ce3c685d590c5d6"} Jun 10 00:21:56.722715 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:56.722631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" event={"ID":"1ff06e03-8b8d-4d2a-878d-a6896644eee7","Type":"ContainerStarted","Data":"10dc36a72a76e56dacde913f2fa8573462a3a01238e26ae9f41981697f15345c"} Jun 10 00:21:56.722715 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:56.722664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:21:56.741419 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:56.741360 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" podStartSLOduration=1.741338318 podStartE2EDuration="1.741338318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.740271781 +0000 UTC m=+2312.099393155" watchObservedRunningTime="2026-06-10 00:21:56.741338318 +0000 UTC m=+2312.100459755" Jun 10 00:21:57.448892 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:57.448854 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv_acef2bb6-a7ef-46ce-9dfb-f4f9776ad456/istio-proxy/0.log" Jun 10 00:21:57.620286 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:57.620235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/0.log" Jun 10 00:21:57.688769 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:57.688729 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/1.log" Jun 10 00:21:57.850777 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:57.850748 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 10 00:21:58.444764 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:58.444719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2gfb_4441aeec-d2a7-4713-b2f7-a16df9adeea7/serve-healthcheck-canary/0.log" Jun 10 00:21:58.913880 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:58.913847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-vx5mq_a8101261-827c-4dde-adb0-b3541246482d/insights-operator/0.log" Jun 10 00:21:58.915381 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:58.915350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-vx5mq_a8101261-827c-4dde-adb0-b3541246482d/insights-operator/1.log" Jun 10 00:21:59.045481 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:59.045439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7t7x_02807886-6aa1-41ca-844d-3dff80308db2/kube-rbac-proxy/0.log" Jun 10 00:21:59.063791 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:59.063756 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7t7x_02807886-6aa1-41ca-844d-3dff80308db2/exporter/0.log" Jun 10 00:21:59.079765 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:21:59.079734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7t7x_02807886-6aa1-41ca-844d-3dff80308db2/extractor/0.log" Jun 10 00:22:01.247401 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.247368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67868bd8d6-blbdq_64e770d5-7439-4677-8800-fd7f2298bb3d/nginx/0.log" Jun 10 00:22:01.502752 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.502672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684160-crt4c_60e0e962-db93-46d8-9886-9de08ee12173/cleanup/0.log" Jun 10 00:22:01.520594 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.520566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684175-4vmd5_cb27263b-7369-440c-baa9-5e57e8c92a7e/cleanup/0.log" Jun 10 00:22:01.658338 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.658306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nchmp_78cf61bd-5585-4bb8-bacc-0feee19e53de/server/0.log" Jun 10 00:22:01.969719 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.969685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58457dd84-xgbct_6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97/manager/0.log" Jun 10 00:22:01.984690 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:01.984661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58457dd84-xgbct_6ec6b086-3d2c-4114-9dc1-0ce3f71c8e97/copy-manifests/0.log" Jun 10 00:22:02.003223 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:02.003193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-27zq5_008e351a-1e25-4ece-a949-d4b48379fb27/postgres/0.log" Jun 10 00:22:02.743192 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:02.743157 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ftpm/perf-node-gather-daemonset-p4nn9" Jun 10 00:22:03.423690 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:03.423650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6884cb4c8b-skf8x_4cd7c95f-27e0-4630-8b6a-65601969178f/manager/0.log" Jun 10 00:22:03.442805 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:03.442774 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wh9sb_38de7c10-ae1d-46ab-bd28-36f755f9a544/openshift-lws-operator/0.log" Jun 10 00:22:08.613515 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:08.613479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv_acef2bb6-a7ef-46ce-9dfb-f4f9776ad456/istio-proxy/0.log" Jun 10 00:22:08.756518 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:08.756486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/0.log" Jun 10 00:22:08.819332 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:08.819290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/1.log" Jun 10 00:22:08.956587 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:08.956496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 10 00:22:09.004991 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:09.004958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-rmd56_d674e199-e3d2-46ea-a8ed-1d0f52b867b4/kube-storage-version-migrator-operator/0.log" Jun 10 00:22:09.005753 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:09.005727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-rmd56_d674e199-e3d2-46ea-a8ed-1d0f52b867b4/kube-storage-version-migrator-operator/1.log" Jun 10 00:22:10.001681 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.001641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv_acef2bb6-a7ef-46ce-9dfb-f4f9776ad456/istio-proxy/0.log" Jun 10 00:22:10.155292 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.155261 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/0.log" Jun 10 00:22:10.215367 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.215330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/1.log" Jun 10 00:22:10.344706 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.344670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65mjc_77b207e4-a982-46ff-937e-53d11364acf5/kube-multus/0.log" Jun 10 00:22:10.354650 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.354588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 10 00:22:10.505431 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.505404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/kube-multus-additional-cni-plugins/0.log" Jun 10 00:22:10.520798 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.520768 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/egress-router-binary-copy/0.log" Jun 10 00:22:10.536867 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.536829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/cni-plugins/0.log" Jun 10 00:22:10.551896 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.551841 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/bond-cni-plugin/0.log" Jun 10 00:22:10.566882 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.566855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/routeoverride-cni/0.log" Jun 10 00:22:10.582103 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.582009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/whereabouts-cni-bincopy/0.log" Jun 10 00:22:10.596625 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.596542 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9x7j_455627c2-b5fd-4a95-8422-e80284d142ce/whereabouts-cni/0.log" Jun 10 00:22:10.879084 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.879001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tg6jt_5ecb1451-a42f-4114-b21f-345c7226ab22/network-metrics-daemon/0.log" Jun 10 00:22:10.890843 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:10.890810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tg6jt_5ecb1451-a42f-4114-b21f-345c7226ab22/kube-rbac-proxy/0.log" Jun 10 00:22:11.891760 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:11.891732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cvgfkv_acef2bb6-a7ef-46ce-9dfb-f4f9776ad456/istio-proxy/0.log" Jun 10 00:22:12.040919 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.040872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/0.log" Jun 10 00:22:12.111686 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.111604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-58446_159f3497-6873-468e-bf1f-c8837c988d88/istio-proxy/1.log" Jun 10 00:22:12.169845 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.169743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-controller/0.log" Jun 10 00:22:12.181954 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.181924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/0.log" Jun 10 00:22:12.182131 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.181964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovn-acl-logging/1.log" Jun 10 00:22:12.203310 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.203282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/kube-rbac-proxy-node/0.log" Jun 10 00:22:12.226793 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.226766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 00:22:12.239343 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.239316 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/northd/0.log" Jun 10 00:22:12.243595 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.243572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-676f45dfff-vljc7_3fe806b3-e0cf-4af1-91db-853b22790b3c/router/0.log" Jun 10 00:22:12.259683 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.259661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/nbdb/0.log" Jun 10 00:22:12.276361 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.276326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/sbdb/0.log" Jun 10 00:22:12.339054 ip-10-0-129-49 kubenswrapper[2576]: I0610 00:22:12.339016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-np5kc_f9d46f66-24ee-4b59-8b95-68cff3d0f6db/ovnkube-controller/0.log"