Jun 11 21:40:14.521411 ip-10-0-138-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 21:40:14.521422 ip-10-0-138-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 21:40:14.521429 ip-10-0-138-118 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 21:40:14.521695 ip-10-0-138-118 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 21:40:24.217084 ip-10-0-138-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 21:40:24.217099 ip-10-0-138-118 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b861264ddcef4d2d92393eb0dd7b6ee7 -- Jun 11 21:42:32.549582 ip-10-0-138-118 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:42:32.899825 ip-10-0-138-118 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:42:32.899825 ip-10-0-138-118 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:42:32.899825 ip-10-0-138-118 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:42:32.899825 ip-10-0-138-118 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:42:32.899825 ip-10-0-138-118 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:42:32.900716 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.900626 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906469 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906492 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906498 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906502 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906507 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.906500 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906511 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906516 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906520 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906523 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906527 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906531 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906535 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906539 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906542 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906545 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906549 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906553 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906557 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906560 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906563 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906567 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906572 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906575 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906586 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.906865 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906590 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906593 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906597 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906601 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906606 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906610 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906616 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906621 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906625 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906629 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906633 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906637 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906641 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906645 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906649 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906656 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906660 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906665 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906669 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.907711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906673 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906677 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906685 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906690 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906695 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906700 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906705 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906710 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906714 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906721 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906725 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906729 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906733 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906738 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906742 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906747 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906752 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906757 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906761 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906765 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.908547 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906770 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906774 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906778 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906783 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906787 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906791 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906796 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906800 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906806 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906810 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906815 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906821 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906827 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906834 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906840 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906845 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906849 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906854 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906858 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.909374 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906862 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906867 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906871 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906876 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906880 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906884 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906889 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906893 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906898 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906902 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906906 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906911 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906916 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906920 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906924 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906928 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.906932 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908192 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908204 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908209 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.910175 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908213 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908218 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908223 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908227 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908232 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908236 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908240 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908245 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908249 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908254 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908259 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908263 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908267 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908271 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908296 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908302 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908308 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908315 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908320 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908324 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.911042 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908328 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908333 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908337 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908341 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908345 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908350 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908355 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908359 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908364 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908368 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908373 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908377 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908381 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908386 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908390 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908397 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908403 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908408 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908413 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.911832 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908418 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908422 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908426 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908430 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908435 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908439 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908443 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908457 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908463 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908467 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908472 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908477 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908481 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908485 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908490 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908501 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908505 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908510 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.912405 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908515 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908520 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908524 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908528 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908532 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908537 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908541 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908545 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908549 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908553 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908558 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908562 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908566 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908570 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908574 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908579 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908583 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908587 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908592 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.912887 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908596 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908600 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908604 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908610 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908615 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908619 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908623 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908628 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908632 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908637 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908642 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908647 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908652 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908656 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908661 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908665 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908669 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908673 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.908678 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909423 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.913603 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909435 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909441 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909447 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909452 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909457 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909461 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909467 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909472 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909477 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909481 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909485 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909490 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909494 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909498 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909505 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909513 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909518 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909522 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909526 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.914103 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909532 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909538 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909543 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909548 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909552 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909556 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909561 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909565 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909570 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909574 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909578 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909583 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909587 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909592 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909596 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909601 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909605 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909609 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909613 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909617 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.914589 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909622 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909626 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909630 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909634 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909638 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909642 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909647 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909651 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909656 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909662 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909666 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909670 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909674 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909679 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909683 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909689 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909695 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909699 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909704 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909708 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.915162 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909714 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909718 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909722 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909726 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909730 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909735 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909739 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909744 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909748 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909753 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909757 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909762 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909766 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909770 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909775 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909779 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909783 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909787 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909792 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909796 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.915682 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909800 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909804 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909810 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909815 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909819 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909824 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909828 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909836 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909840 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909845 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909852 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909857 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909861 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909866 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909871 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909876 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909880 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909885 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.909889 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910002 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:42:32.916229 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910014 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910023 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910031 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910037 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910043 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910050 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910057 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910062 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910067 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910072 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910078 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910083 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910088 2577 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910093 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910097 2577 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910104 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910109 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910116 2577 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910120 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910128 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910133 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910139 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910145 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:42:32.916743 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910150 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910156 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910163 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910168 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910174 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910178 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910183 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910187 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910194 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910199 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910204 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910208 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910214 2577 flags.go:64] FLAG: --enable-server="true" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910219 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910226 2577 flags.go:64] FLAG: --event-burst="100" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910231 2577 flags.go:64] FLAG: --event-qps="50" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910235 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910241 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910245 2577 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910252 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910258 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910263 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910268 2577 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910273 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910296 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:42:32.917351 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910302 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910306 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910311 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910318 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910323 2577 flags.go:64] FLAG: --feature-gates="" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910329 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910334 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910339 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910344 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910351 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910356 2577 flags.go:64] FLAG: --help="false" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910362 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-138-118.ec2.internal" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910366 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910371 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910376 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910382 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910388 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910393 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910398 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910402 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910407 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910412 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910417 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910422 2577 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:42:32.918080 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910427 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910432 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910437 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910441 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910446 2577 flags.go:64] FLAG: --lock-file="" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910451 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910456 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910461 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910470 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910475 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910480 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910487 2577 flags.go:64] FLAG: --logging-format="text" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910492 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910497 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910502 2577 flags.go:64] FLAG: --manifest-url="" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910507 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910514 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910520 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910546 2577 flags.go:64] FLAG: --max-pods="110" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910551 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910556 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910561 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910566 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910571 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910577 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:42:32.918693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910581 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910593 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910598 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910603 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910608 2577 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910612 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910621 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910625 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910630 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910635 2577 flags.go:64] FLAG: --port="10250" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910640 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910645 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ec7da7cf5389f99" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910650 2577 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910655 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910660 2577 flags.go:64] FLAG: --register-node="true" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910665 2577 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910671 2577 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910677 2577 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910681 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910688 2577 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910695 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910700 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910705 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910710 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910716 2577 flags.go:64] FLAG: --runonce="false" Jun 11 21:42:32.919323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910721 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910726 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910732 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910737 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910742 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910747 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910752 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910758 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910762 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910768 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910773 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910777 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910783 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910788 2577 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910792 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910801 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910806 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910811 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910819 2577 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910825 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910830 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910834 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910839 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910844 2577 flags.go:64] FLAG: --v="2" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910852 2577 flags.go:64] FLAG: --version="false" Jun 11 21:42:32.919958 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910860 2577 flags.go:64] FLAG: --vmodule="" Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910869 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.910874 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911059 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911066 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911071 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911077 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911082 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911087 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911091 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911096 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911100 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911104 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911109 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911113 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911117 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911123 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911128 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911132 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911136 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.920592 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911140 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911145 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911149 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911153 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911161 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911167 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911172 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911177 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911183 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911187 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911191 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911196 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911200 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911208 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911213 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911217 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911221 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911226 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911231 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.921094 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911238 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911244 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911249 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911254 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911259 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911263 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911268 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911272 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911294 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911299 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911303 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911308 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911312 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911316 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911321 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911325 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911330 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911334 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911338 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911342 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.921620 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911347 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911351 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911355 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911359 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911364 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911368 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911374 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911385 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911390 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911394 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911398 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911404 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911408 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911413 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911418 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911424 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911430 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911435 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911439 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.922107 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911444 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911448 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911452 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911457 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911461 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911465 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911469 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911474 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911478 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911482 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911487 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911491 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911495 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911499 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911503 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911508 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911513 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911517 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911521 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911528 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911532 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.922588 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911538 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911542 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.911547 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.912189 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.919560 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.919579 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.919596 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.919605 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919680 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919685 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919688 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919691 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919694 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919697 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919700 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.923105 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919703 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919706 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919709 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919712 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919715 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919718 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919720 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919723 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919725 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919728 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919731 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919733 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919736 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919738 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919741 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919743 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919746 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919756 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919760 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.923502 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919763 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919766 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919770 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919774 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919777 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919780 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919783 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919786 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919789 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919791 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919794 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919797 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919800 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919802 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919805 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919808 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919810 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919813 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919815 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.923972 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919818 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919821 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919823 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919826 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919828 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919831 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919833 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919836 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919838 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919850 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919855 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919857 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919867 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919871 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919874 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919876 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919880 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919883 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919885 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.924455 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919888 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919891 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919894 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919896 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919899 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919901 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919904 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919906 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919909 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919912 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919914 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919917 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919919 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919922 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919925 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919927 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919930 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919932 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919935 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919937 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.924922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919940 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919942 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919945 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919947 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919950 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919952 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919962 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919965 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919968 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919971 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919974 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919978 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919980 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919983 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.919991 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.925541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.919996 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920146 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920150 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920153 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920156 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920158 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920162 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920166 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920169 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920172 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920174 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920177 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920179 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920182 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920184 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920187 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920190 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920192 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920195 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:42:32.925965 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920198 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920200 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920203 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920205 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920208 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920216 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920219 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920221 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920224 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920227 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920230 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920232 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920235 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920237 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920240 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920242 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920245 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920247 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920250 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920253 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:42:32.926540 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920255 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920258 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920260 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920263 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920265 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920268 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920270 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920273 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920275 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920301 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920304 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920307 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920310 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920312 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920316 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920319 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920321 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920324 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920333 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920335 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:42:32.927127 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920338 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920341 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920343 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920346 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920348 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920351 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920353 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920357 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920361 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920364 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920367 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920369 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920372 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920375 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920377 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920379 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920382 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920384 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920387 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920390 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:42:32.927727 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920392 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920394 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920397 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920400 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920402 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920405 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920408 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920410 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920415 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920418 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920421 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920429 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920432 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920434 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920437 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920440 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920442 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920444 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920447 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:42:32.928248 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920449 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:32.920452 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.920457 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.920587 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.922857 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.924208 2577 server.go:1019] "Starting client certificate rotation" Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.924367 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.924432 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:42:32.928718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.926490 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:42:32.929664 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.928393 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:42:32.939978 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.939954 2577 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:42:32.943546 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.943529 2577 log.go:25] "Validated CRI v1 image API" Jun 11 21:42:32.944276 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.944262 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:42:32.946509 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.946490 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8f8a966e-f8d3-4702-b0b2-8e65504eb017:/dev/nvme0n1p4 e4cefd4b-925e-4724-beec-05ed1159153e:/dev/nvme0n1p3] Jun 11 21:42:32.946580 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.946508 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:42:32.952375 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.952237 2577 manager.go:216] Machine: {Timestamp:2026-06-11 21:42:32.950952534 +0000 UTC m=+0.295177637 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108198 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d85cef1eb68d79611175c2ee77ad SystemUUID:ec25d85c-ef1e-b68d-7961-1175c2ee77ad BootID:b861264d-dcef-4d2d-9239-3eb0dd7b6ee7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:53:4a:f3:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:53:4a:f3:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:f6:5c:f8:34:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:42:32.952375 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.952367 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:42:32.952491 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.952454 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:42:32.953808 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.953778 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:42:32.953950 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.953811 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:42:32.954251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.954234 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:42:32.954519 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.954507 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:42:32.954562 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.954522 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:42:32.954562 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.954531 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:42:32.955292 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.955272 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:42:32.956883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.956872 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:42:32.960065 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960053 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:42:32.960179 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960169 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:42:32.960215 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960203 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:42:32.960243 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960221 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:42:32.960243 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960235 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:42:32.960315 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960248 2577 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:42:32.960356 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960347 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:42:32.960740 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960723 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:42:32.960808 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.960748 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:42:32.962705 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.962685 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:42:32.964271 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964257 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:42:32.964363 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964304 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:42:32.964470 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964460 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:42:32.964515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964475 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:42:32.964515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964482 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:42:32.964515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964487 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:42:32.964515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964495 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:42:32.964515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964501 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:42:32.964961 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964953 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:42:32.964991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964961 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:42:32.964991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964969 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:42:32.964991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964975 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:42:32.964991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964983 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:42:32.964991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.964990 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:42:32.966320 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.966308 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:42:32.966320 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.966320 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:42:32.969664 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.969651 2577 server.go:1268] "Started kubelet" Jun 11 21:42:32.969756 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.969709 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:42:32.971796 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.971760 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:42:32.971899 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.971818 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:42:32.972177 ip-10-0-138-118 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:42:32.972547 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.972351 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:42:32.972631 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.972575 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:42:32.973370 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.972879 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:42:32.975128 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.974389 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:42:32.975128 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.974554 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:42:32.979197 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.978521 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-118.ec2.internal.18b824d5b8a72086 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-118.ec2.internal,UID:ip-10-0-138-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-118.ec2.internal,},FirstTimestamp:2026-06-11 21:42:32.969625734 +0000 UTC m=+0.313850816,LastTimestamp:2026-06-11 21:42:32.969625734 +0000 UTC m=+0.313850816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-118.ec2.internal,}" Jun 11 21:42:32.979726 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.979710 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:42:32.979811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.979728 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:42:32.979925 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.979854 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:32.980339 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980325 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:42:32.980431 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980328 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:42:32.980431 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980410 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:42:32.980528 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.980373 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:42:32.980572 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980530 2577 factory.go:55] Registering systemd factory Jun 11 21:42:32.980572 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980551 2577 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:42:32.980653 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980530 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:42:32.980653 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980583 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:42:32.980776 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980760 2577 factory.go:153] Registering CRI-O factory Jun 11 21:42:32.980832 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980781 2577 factory.go:223] Registration of the crio container factory successfully Jun 11 21:42:32.980868 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980834 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:42:32.980868 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980857 2577 factory.go:103] Registering Raw factory Jun 11 21:42:32.980939 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.980874 2577 manager.go:1196] Started watching for new ooms in manager Jun 11 21:42:32.981188 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.981177 2577 manager.go:349] Starting recovery of all containers Jun 11 21:42:32.991099 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.990937 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:42:32.991099 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:32.990974 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:42:32.991704 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.991690 2577 manager.go:354] Recovery completed Jun 11 21:42:32.997211 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.997199 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:32.999131 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999111 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:32.999211 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999151 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:32.999211 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999167 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:32.999723 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999704 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:42:32.999723 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999720 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:42:32.999829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999739 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:42:32.999829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:32.999723 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.000447 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000434 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.000511 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000462 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.000511 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000475 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.000801 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000789 2577 policy_none.go:49] "None policy: Start" Jun 11 21:42:33.000843 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000813 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:42:33.000843 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.000825 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:42:33.001406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.001390 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxn7b" Jun 11 21:42:33.001752 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.001739 2577 policy_none.go:47] "Start" Jun 11 21:42:33.006831 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.006814 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxn7b" Jun 11 21:42:33.011961 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.011898 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-118.ec2.internal.18b824d5ba695f6d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-118.ec2.internal,UID:ip-10-0-138-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-118.ec2.internal,},FirstTimestamp:2026-06-11 21:42:32.999133037 +0000 UTC m=+0.343358139,LastTimestamp:2026-06-11 21:42:32.999133037 +0000 UTC m=+0.343358139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-118.ec2.internal,}" Jun 11 21:42:33.031009 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.030991 2577 manager.go:337] "Starting Device Plugin manager" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.031033 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031048 2577 server.go:87] "Starting device plugin registration server" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031334 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031349 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031443 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031543 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.031553 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.032176 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:42:33.044731 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.032223 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.045086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.044749 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:42:33.045989 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.045976 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:42:33.046057 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.046018 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:42:33.046057 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.046041 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:42:33.046145 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.046085 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:42:33.048497 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.048478 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:42:33.132033 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.131995 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.133239 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.133209 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.133239 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.133243 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.133416 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.133254 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.133416 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.133298 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.143585 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.143565 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.143679 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.143592 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-118.ec2.internal\": node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.146524 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.146499 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal"] Jun 11 21:42:33.146587 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.146567 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.148446 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.148424 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.148555 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.148459 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.148555 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.148474 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.149798 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.149782 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.149985 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.149945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.149985 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.149974 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.150593 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150578 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.150683 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150617 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.150683 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150632 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.150683 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150663 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.150819 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150689 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.150819 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.150705 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.151873 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.151856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.151923 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.151885 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:33.152660 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.152648 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:33.152730 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.152667 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:33.152730 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.152677 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:33.168667 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.168642 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.175104 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.175079 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-118.ec2.internal\" not found" node="ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.179673 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.179650 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-118.ec2.internal\" not found" node="ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.180787 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.180768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.180899 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.180797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.180899 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.180817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/027e16a1fff3398b7e017b3269af3ba3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-118.ec2.internal\" (UID: \"027e16a1fff3398b7e017b3269af3ba3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.268905 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.268856 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.281158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.281158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.281322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.281322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d958082cedce48297d312d20c2e8b9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal\" (UID: \"d958082cedce48297d312d20c2e8b9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.281322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/027e16a1fff3398b7e017b3269af3ba3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-118.ec2.internal\" (UID: \"027e16a1fff3398b7e017b3269af3ba3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.281322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.281252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/027e16a1fff3398b7e017b3269af3ba3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-118.ec2.internal\" (UID: \"027e16a1fff3398b7e017b3269af3ba3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.369339 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.369271 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.470075 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.470005 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.477125 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.477091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.484240 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.484221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:33.571017 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.570976 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.671509 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.671477 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.772046 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.771959 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.872611 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.872577 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.924038 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.924013 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:42:33.924557 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.924159 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:42:33.973531 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:33.973499 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:33.988768 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:33.988740 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:42:34.001556 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.001535 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:42:34.012599 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.012551 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:37:33 +0000 UTC" deadline="2028-01-17 13:25:49.422393547 +0000 UTC" Jun 11 21:42:34.012599 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.012596 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14031h43m15.409801752s" Jun 11 21:42:34.074157 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.074093 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:34.090064 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:34.090026 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027e16a1fff3398b7e017b3269af3ba3.slice/crio-d2e4dd665f48755829638b29796bf990294366d12decf2a36f96eaec1a64f257 WatchSource:0}: Error finding container d2e4dd665f48755829638b29796bf990294366d12decf2a36f96eaec1a64f257: Status 404 returned error can't find the container with id d2e4dd665f48755829638b29796bf990294366d12decf2a36f96eaec1a64f257 Jun 11 21:42:34.090305 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:34.090259 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd958082cedce48297d312d20c2e8b9d2.slice/crio-984d017c30c06e89b8c38706b8e0c81d76669bf4afe38b4264b2bf6bc4ef7aff WatchSource:0}: Error finding container 984d017c30c06e89b8c38706b8e0c81d76669bf4afe38b4264b2bf6bc4ef7aff: Status 404 returned error can't find the container with id 984d017c30c06e89b8c38706b8e0c81d76669bf4afe38b4264b2bf6bc4ef7aff Jun 11 21:42:34.094104 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.094088 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:42:34.138606 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.138570 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:42:34.139877 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.139857 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:42:34.139953 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.139890 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:42:34.139953 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.139901 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:42:34.174409 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.174369 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:34.274840 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.274804 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:34.375364 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.375325 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:34.476159 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.476117 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-118.ec2.internal\" not found" Jun 11 21:42:34.527240 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.527203 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:42:34.580966 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.580765 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" Jun 11 21:42:34.592944 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.592807 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:42:34.593869 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.593842 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" Jun 11 21:42:34.602403 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.602376 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:42:34.961397 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.961361 2577 apiserver.go:52] "Watching apiserver" Jun 11 21:42:34.968758 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.968734 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:42:34.969817 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.969789 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wzh96","openshift-image-registry/node-ca-qjj4n","openshift-multus/multus-additional-cni-plugins-k2nkf","openshift-multus/multus-jjsdm","openshift-multus/network-metrics-daemon-c99vr","openshift-ovn-kubernetes/ovnkube-node-2fpf4","kube-system/global-pull-secret-syncer-5r5p5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz","openshift-cluster-node-tuning-operator/tuned-w5dkf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal","openshift-network-diagnostics/network-check-target-djgg8","openshift-network-operator/iptables-alerter-682xq","kube-system/konnectivity-agent-lnl6j","kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal"] Jun 11 21:42:34.971523 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.971504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:34.971633 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.971585 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:34.972724 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.972701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:34.974222 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.974192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.975064 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.975050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:42:34.975158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.975129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tz5pw\"" Jun 11 21:42:34.975158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.975146 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:42:34.976533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.976512 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.977007 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.976988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.977092 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.977037 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pphj9\"" Jun 11 21:42:34.977233 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.977217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:42:34.977614 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.977465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.977614 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.977524 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:42:34.977614 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.977573 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:42:34.978494 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.978380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:34.978494 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.978466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:34.979644 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.979245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:42:34.979644 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.979501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fds7b\"" Jun 11 21:42:34.979786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.979696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.980198 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.980170 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:42:34.981543 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.981525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.981951 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.981931 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:42:34.982331 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.982314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.982432 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.982314 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzmct\"" Jun 11 21:42:34.982432 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.982316 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:42:34.982718 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.982699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.982901 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.982881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:34.983989 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.983768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:42:34.983989 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.983935 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:42:34.985165 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.984593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wh8w9\"" Jun 11 21:42:34.985165 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.984633 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.985165 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.984666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.985382 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.985246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.985382 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.985353 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.986971 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.985555 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjbm7\"" Jun 11 21:42:34.987760 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.987564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qdvk\" (UniqueName: \"kubernetes.io/projected/d8872af2-fe26-4c54-b863-153203004cd5-kube-api-access-9qdvk\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-bin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-kubelet\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-ovn\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-conf\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a486857e-f78b-4835-aa3a-6f00aae1ba37-agent-certs\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-multus-daemon-config\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.988969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-bin\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-multus-certs\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-etc-kubernetes\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-systemd\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-dbus\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-tmp\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-k8s-cni-cncf-io\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-hostroot\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-slash\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmbnk\" (UniqueName: \"kubernetes.io/projected/83fbe708-adcb-4518-8aff-83413b485aff-kube-api-access-qmbnk\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvmhb\" (UniqueName: \"kubernetes.io/projected/83fdec30-0099-4393-9c79-4fc2edd35a31-kube-api-access-mvmhb\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-socket-dir-parent\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fbe708-adcb-4518-8aff-83413b485aff-ovn-node-metrics-cert\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-cnibin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbqs\" (UniqueName: \"kubernetes.io/projected/964496b6-1b92-4c4d-91db-bb37d54d379b-kube-api-access-4mbqs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-netns\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.989668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-node-log\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pt5x\" (UniqueName: \"kubernetes.io/projected/c9350ece-db35-4c19-9c6b-1a627e183474-kube-api-access-9pt5x\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-netd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-systemd-units\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-lib-modules\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-systemd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-log-socket\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-modprobe-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-system-cni-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-script-lib\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.989984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-sys\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-cnibin\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m97mx\"" Jun 11 21:42:34.990551 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990073 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-multus\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-conf-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a486857e-f78b-4835-aa3a-6f00aae1ba37-konnectivity-ca\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-host\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-tuned\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-system-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-cni-binary-copy\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-etc-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysconfig\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-var-lib-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-config\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-kubernetes\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-run\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.991342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-os-release\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-os-release\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-kubelet\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990735 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-env-overrides\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-var-lib-kubelet\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-kubelet-config\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.990922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-netns\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:34.992260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.991114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:34.992802 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.992388 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:42:34.992802 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.992732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:34.992922 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:34.992797 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:34.993255 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.993205 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:42:34.993508 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.993483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:42:34.993648 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.993534 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.993775 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.993762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rmbhf\"" Jun 11 21:42:34.995449 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.995134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:34.997592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.997426 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:42:34.997592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.997428 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:42:34.997592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.997511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qths2\"" Jun 11 21:42:34.997780 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:34.997731 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:42:35.009922 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.009898 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7rq7" Jun 11 21:42:35.020391 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.020363 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7rq7" Jun 11 21:42:35.051308 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.051228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" event={"ID":"027e16a1fff3398b7e017b3269af3ba3","Type":"ContainerStarted","Data":"d2e4dd665f48755829638b29796bf990294366d12decf2a36f96eaec1a64f257"} Jun 11 21:42:35.055542 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.055511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" event={"ID":"d958082cedce48297d312d20c2e8b9d2","Type":"ContainerStarted","Data":"984d017c30c06e89b8c38706b8e0c81d76669bf4afe38b4264b2bf6bc4ef7aff"} Jun 11 21:42:35.081239 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.081211 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:42:35.091666 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-host\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-tuned\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-system-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-cni-binary-copy\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-etc-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-host\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysconfig\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-system-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.091821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysconfig\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-var-lib-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-config\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-kubernetes\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-etc-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-run\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.091933 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-os-release\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-var-lib-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.091971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-registration-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.092007 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:42:35.591985346 +0000 UTC m=+2.936210420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-os-release\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-kubernetes\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-os-release\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-run\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-os-release\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-kubelet\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.092297 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-env-overrides\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-var-lib-kubelet\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-kubelet-config\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-kubelet\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-kubelet-config\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-var-lib-kubelet\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-device-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092353 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-netns\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qdvk\" (UniqueName: \"kubernetes.io/projected/d8872af2-fe26-4c54-b863-153203004cd5-kube-api-access-9qdvk\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-bin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-config\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-kubelet\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-ovn\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-env-overrides\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-netns\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-conf\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-kubelet\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a486857e-f78b-4835-aa3a-6f00aae1ba37-agent-certs\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-sys-fs\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-conf\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-multus-daemon-config\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-bin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-bin\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-bin\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-cni-binary-copy\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-cni-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.092971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-ovn\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef36db73-b675-4e46-ac28-8ca17deb634f-hosts-file\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef36db73-b675-4e46-ac28-8ca17deb634f-tmp-dir\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.093900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-multus-certs\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-etc-kubernetes\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-multus-certs\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-etc-kubernetes\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8872af2-fe26-4c54-b863-153203004cd5-multus-daemon-config\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-systemd\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-dbus\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-systemd\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-tmp\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-k8s-cni-cncf-io\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-hostroot\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c6444fc-353c-48df-99fa-b18a8063cfaf-dbus\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-slash\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-run-k8s-cni-cncf-io\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmbnk\" (UniqueName: \"kubernetes.io/projected/83fbe708-adcb-4518-8aff-83413b485aff-kube-api-access-qmbnk\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.093522 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:35.094739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvmhb\" (UniqueName: \"kubernetes.io/projected/83fdec30-0099-4393-9c79-4fc2edd35a31-kube-api-access-mvmhb\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-socket-dir-parent\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fbe708-adcb-4518-8aff-83413b485aff-ovn-node-metrics-cert\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.093622 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:42:35.593598556 +0000 UTC m=+2.937823628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-cnibin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbqs\" (UniqueName: \"kubernetes.io/projected/964496b6-1b92-4c4d-91db-bb37d54d379b-kube-api-access-4mbqs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-netns\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-node-log\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pt5x\" (UniqueName: \"kubernetes.io/projected/c9350ece-db35-4c19-9c6b-1a627e183474-kube-api-access-9pt5x\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9350ece-db35-4c19-9c6b-1a627e183474-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d229d-d145-4296-9aee-1b3db31964f7-iptables-alerter-script\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-485n5\" (UniqueName: \"kubernetes.io/projected/ef36db73-b675-4e46-ac28-8ca17deb634f-kube-api-access-485n5\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-netns\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-node-log\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-hostroot\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.093982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-host\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.095682 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-netd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d229d-d145-4296-9aee-1b3db31964f7-host-slash\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn79j\" (UniqueName: \"kubernetes.io/projected/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-kube-api-access-hn79j\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-systemd-units\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-lib-modules\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-socket-dir-parent\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-socket-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-systemd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-slash\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-cnibin\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-systemd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-log-socket\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-modprobe-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-lib-modules\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-system-cni-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.096482 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-run-openvswitch\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-cni-netd\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094577 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-log-socket\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-systemd-units\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-script-lib\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-system-cni-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-modprobe-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-sys\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-cnibin\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv2zk\" (UniqueName: \"kubernetes.io/projected/430d229d-d145-4296-9aee-1b3db31964f7-kube-api-access-nv2zk\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-cnibin\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-serviceca\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-multus\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-sys\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.097269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.094980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-sysctl-d\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-conf-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-host-var-lib-cni-multus\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8872af2-fe26-4c54-b863-153203004cd5-multus-conf-dir\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a486857e-f78b-4835-aa3a-6f00aae1ba37-konnectivity-ca\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kube-api-access-tn9sm\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83fbe708-adcb-4518-8aff-83413b485aff-ovnkube-script-lib\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9350ece-db35-4c19-9c6b-1a627e183474-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83fbe708-adcb-4518-8aff-83413b485aff-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.095760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a486857e-f78b-4835-aa3a-6f00aae1ba37-konnectivity-ca\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.096185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-etc-tuned\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.096368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83fdec30-0099-4393-9c79-4fc2edd35a31-tmp\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.096414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fbe708-adcb-4518-8aff-83413b485aff-ovn-node-metrics-cert\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.098134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.096654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a486857e-f78b-4835-aa3a-6f00aae1ba37-agent-certs\") pod \"konnectivity-agent-lnl6j\" (UID: \"a486857e-f78b-4835-aa3a-6f00aae1ba37\") " pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:35.102341 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.102259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pt5x\" (UniqueName: \"kubernetes.io/projected/c9350ece-db35-4c19-9c6b-1a627e183474-kube-api-access-9pt5x\") pod \"multus-additional-cni-plugins-k2nkf\" (UID: \"c9350ece-db35-4c19-9c6b-1a627e183474\") " pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.103850 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.103375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvmhb\" (UniqueName: \"kubernetes.io/projected/83fdec30-0099-4393-9c79-4fc2edd35a31-kube-api-access-mvmhb\") pod \"tuned-w5dkf\" (UID: \"83fdec30-0099-4393-9c79-4fc2edd35a31\") " pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.103850 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.103645 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qdvk\" (UniqueName: \"kubernetes.io/projected/d8872af2-fe26-4c54-b863-153203004cd5-kube-api-access-9qdvk\") pod \"multus-jjsdm\" (UID: \"d8872af2-fe26-4c54-b863-153203004cd5\") " pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.103850 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.103801 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbqs\" (UniqueName: \"kubernetes.io/projected/964496b6-1b92-4c4d-91db-bb37d54d379b-kube-api-access-4mbqs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:35.105049 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.105023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmbnk\" (UniqueName: \"kubernetes.io/projected/83fbe708-adcb-4518-8aff-83413b485aff-kube-api-access-qmbnk\") pod \"ovnkube-node-2fpf4\" (UID: \"83fbe708-adcb-4518-8aff-83413b485aff\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.105736 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.105718 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:42:35.196142 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d229d-d145-4296-9aee-1b3db31964f7-iptables-alerter-script\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.196142 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-485n5\" (UniqueName: \"kubernetes.io/projected/ef36db73-b675-4e46-ac28-8ca17deb634f-kube-api-access-485n5\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.196408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-host\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.196408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d229d-d145-4296-9aee-1b3db31964f7-host-slash\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.196408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn79j\" (UniqueName: \"kubernetes.io/projected/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-kube-api-access-hn79j\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.196408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-host\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.196408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/430d229d-d145-4296-9aee-1b3db31964f7-host-slash\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-socket-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv2zk\" (UniqueName: \"kubernetes.io/projected/430d229d-d145-4296-9aee-1b3db31964f7-kube-api-access-nv2zk\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-serviceca\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kube-api-access-tn9sm\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:35.196611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-socket-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-registration-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/430d229d-d145-4296-9aee-1b3db31964f7-iptables-alerter-script\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-device-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-registration-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196856 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-device-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-sys-fs\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.196938 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef36db73-b675-4e46-ac28-8ca17deb634f-hosts-file\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-sys-fs\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.197001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef36db73-b675-4e46-ac28-8ca17deb634f-tmp-dir\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.197032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef36db73-b675-4e46-ac28-8ca17deb634f-hosts-file\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.196987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-serviceca\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.197246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.197226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef36db73-b675-4e46-ac28-8ca17deb634f-tmp-dir\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.202366 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.202216 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:35.202366 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.202243 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:35.202366 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.202257 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:35.206450 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.202860 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:42:35.702819156 +0000 UTC m=+3.047044251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:35.206450 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.204582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn79j\" (UniqueName: \"kubernetes.io/projected/9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed-kube-api-access-hn79j\") pod \"node-ca-qjj4n\" (UID: \"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed\") " pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.206450 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.204618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-485n5\" (UniqueName: \"kubernetes.io/projected/ef36db73-b675-4e46-ac28-8ca17deb634f-kube-api-access-485n5\") pod \"node-resolver-wzh96\" (UID: \"ef36db73-b675-4e46-ac28-8ca17deb634f\") " pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.206450 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.206026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/18b9b6f6-3aaa-4873-9f28-61a600fb1c00-kube-api-access-tn9sm\") pod \"aws-ebs-csi-driver-node-h7bzz\" (UID: \"18b9b6f6-3aaa-4873-9f28-61a600fb1c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.208470 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.208422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv2zk\" (UniqueName: \"kubernetes.io/projected/430d229d-d145-4296-9aee-1b3db31964f7-kube-api-access-nv2zk\") pod \"iptables-alerter-682xq\" (UID: \"430d229d-d145-4296-9aee-1b3db31964f7\") " pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.293964 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.293939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:35.300832 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.300811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" Jun 11 21:42:35.301811 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.301778 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda486857e_f78b_4835_aa3a_6f00aae1ba37.slice/crio-c6c1a8ff145794fa4ee896c120a48534c295c6c5a4f5edb3f15e7a562dca9349 WatchSource:0}: Error finding container c6c1a8ff145794fa4ee896c120a48534c295c6c5a4f5edb3f15e7a562dca9349: Status 404 returned error can't find the container with id c6c1a8ff145794fa4ee896c120a48534c295c6c5a4f5edb3f15e7a562dca9349 Jun 11 21:42:35.307393 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.307371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjsdm" Jun 11 21:42:35.309075 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.309053 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9350ece_db35_4c19_9c6b_1a627e183474.slice/crio-8842dffb64c114d6d9e9c910e51df0eb87d6c5ff5181d8095ae18f748572c16c WatchSource:0}: Error finding container 8842dffb64c114d6d9e9c910e51df0eb87d6c5ff5181d8095ae18f748572c16c: Status 404 returned error can't find the container with id 8842dffb64c114d6d9e9c910e51df0eb87d6c5ff5181d8095ae18f748572c16c Jun 11 21:42:35.313902 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.313884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:42:35.314316 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.314296 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8872af2_fe26_4c54_b863_153203004cd5.slice/crio-7de10097b18dae0959c79127ce85564c6e9266ad2c9000878c1838c4406982dc WatchSource:0}: Error finding container 7de10097b18dae0959c79127ce85564c6e9266ad2c9000878c1838c4406982dc: Status 404 returned error can't find the container with id 7de10097b18dae0959c79127ce85564c6e9266ad2c9000878c1838c4406982dc Jun 11 21:42:35.321407 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.321383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" Jun 11 21:42:35.321711 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.321660 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fbe708_adcb_4518_8aff_83413b485aff.slice/crio-362f19367cd22dbe6068ebaf28fd367cc00fd00356c72f2d0619dd17c7864936 WatchSource:0}: Error finding container 362f19367cd22dbe6068ebaf28fd367cc00fd00356c72f2d0619dd17c7864936: Status 404 returned error can't find the container with id 362f19367cd22dbe6068ebaf28fd367cc00fd00356c72f2d0619dd17c7864936 Jun 11 21:42:35.327501 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.327479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzh96" Jun 11 21:42:35.328936 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.328895 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fdec30_0099_4393_9c79_4fc2edd35a31.slice/crio-0da091a40f0b7b9b9056f3f79e861cdd7c341f057cdf751a691b20234674f887 WatchSource:0}: Error finding container 0da091a40f0b7b9b9056f3f79e861cdd7c341f057cdf751a691b20234674f887: Status 404 returned error can't find the container with id 0da091a40f0b7b9b9056f3f79e861cdd7c341f057cdf751a691b20234674f887 Jun 11 21:42:35.333541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.333523 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjj4n" Jun 11 21:42:35.334722 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.334703 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef36db73_b675_4e46_ac28_8ca17deb634f.slice/crio-4f787d17853eac2de44b1ca9402f1691b3443b1f07ae1cf283d000e95ad1eae4 WatchSource:0}: Error finding container 4f787d17853eac2de44b1ca9402f1691b3443b1f07ae1cf283d000e95ad1eae4: Status 404 returned error can't find the container with id 4f787d17853eac2de44b1ca9402f1691b3443b1f07ae1cf283d000e95ad1eae4 Jun 11 21:42:35.340806 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.340787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" Jun 11 21:42:35.341364 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.341343 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9a49cd_fd3f_4507_81d0_07d8c0ec98ed.slice/crio-89f23ffed54aa4eb8309fe77e3285cb614205b33659699f94a5b83df60c9e922 WatchSource:0}: Error finding container 89f23ffed54aa4eb8309fe77e3285cb614205b33659699f94a5b83df60c9e922: Status 404 returned error can't find the container with id 89f23ffed54aa4eb8309fe77e3285cb614205b33659699f94a5b83df60c9e922 Jun 11 21:42:35.347377 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.347356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-682xq" Jun 11 21:42:35.349397 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.349373 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b9b6f6_3aaa_4873_9f28_61a600fb1c00.slice/crio-9465ffdb7a9b377a3d5f8e62a3bda393da1460cd3851f453db04b2ada9b90676 WatchSource:0}: Error finding container 9465ffdb7a9b377a3d5f8e62a3bda393da1460cd3851f453db04b2ada9b90676: Status 404 returned error can't find the container with id 9465ffdb7a9b377a3d5f8e62a3bda393da1460cd3851f453db04b2ada9b90676 Jun 11 21:42:35.355584 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:42:35.355565 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430d229d_d145_4296_9aee_1b3db31964f7.slice/crio-fd2c3ad69ee2da593453b185c4921fb0b46502742185d91a49b84bcd1ac84b2d WatchSource:0}: Error finding container fd2c3ad69ee2da593453b185c4921fb0b46502742185d91a49b84bcd1ac84b2d: Status 404 returned error can't find the container with id fd2c3ad69ee2da593453b185c4921fb0b46502742185d91a49b84bcd1ac84b2d Jun 11 21:42:35.599193 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.598980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:35.599348 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.599119 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:35.599348 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.599233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:35.599348 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.599317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:42:36.599276774 +0000 UTC m=+3.943501845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:35.599348 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.599321 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:35.599527 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.599361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:42:36.599348689 +0000 UTC m=+3.943573759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:35.800831 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:35.800739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:35.801002 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.800914 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:35.801002 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.800935 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:35.801002 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.800948 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:35.801130 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:35.801015 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:42:36.800996359 +0000 UTC m=+4.145221437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:36.022494 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.022438 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:37:35 +0000 UTC" deadline="2028-01-16 13:39:18.966529187 +0000 UTC" Jun 11 21:42:36.022494 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.022486 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14007h56m42.944045905s" Jun 11 21:42:36.059887 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.059706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" event={"ID":"83fdec30-0099-4393-9c79-4fc2edd35a31","Type":"ContainerStarted","Data":"0da091a40f0b7b9b9056f3f79e861cdd7c341f057cdf751a691b20234674f887"} Jun 11 21:42:36.061774 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.061683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjsdm" event={"ID":"d8872af2-fe26-4c54-b863-153203004cd5","Type":"ContainerStarted","Data":"7de10097b18dae0959c79127ce85564c6e9266ad2c9000878c1838c4406982dc"} Jun 11 21:42:36.063472 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.063439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerStarted","Data":"8842dffb64c114d6d9e9c910e51df0eb87d6c5ff5181d8095ae18f748572c16c"} Jun 11 21:42:36.064992 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.064956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnl6j" event={"ID":"a486857e-f78b-4835-aa3a-6f00aae1ba37","Type":"ContainerStarted","Data":"c6c1a8ff145794fa4ee896c120a48534c295c6c5a4f5edb3f15e7a562dca9349"} Jun 11 21:42:36.067318 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.067290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" event={"ID":"18b9b6f6-3aaa-4873-9f28-61a600fb1c00","Type":"ContainerStarted","Data":"9465ffdb7a9b377a3d5f8e62a3bda393da1460cd3851f453db04b2ada9b90676"} Jun 11 21:42:36.070296 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.070248 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"362f19367cd22dbe6068ebaf28fd367cc00fd00356c72f2d0619dd17c7864936"} Jun 11 21:42:36.075367 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.075328 2577 generic.go:356] "Generic (PLEG): container finished" podID="d958082cedce48297d312d20c2e8b9d2" containerID="204d15e72c048ed26aed206ad7c83f1cf6fbe8ee2e632cd301c26906255dbea2" exitCode=0 Jun 11 21:42:36.075485 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.075431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" event={"ID":"d958082cedce48297d312d20c2e8b9d2","Type":"ContainerDied","Data":"204d15e72c048ed26aed206ad7c83f1cf6fbe8ee2e632cd301c26906255dbea2"} Jun 11 21:42:36.079047 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.079019 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-682xq" event={"ID":"430d229d-d145-4296-9aee-1b3db31964f7","Type":"ContainerStarted","Data":"fd2c3ad69ee2da593453b185c4921fb0b46502742185d91a49b84bcd1ac84b2d"} Jun 11 21:42:36.081335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.081252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjj4n" event={"ID":"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed","Type":"ContainerStarted","Data":"89f23ffed54aa4eb8309fe77e3285cb614205b33659699f94a5b83df60c9e922"} Jun 11 21:42:36.083064 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.083013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzh96" event={"ID":"ef36db73-b675-4e46-ac28-8ca17deb634f","Type":"ContainerStarted","Data":"4f787d17853eac2de44b1ca9402f1691b3443b1f07ae1cf283d000e95ad1eae4"} Jun 11 21:42:36.607598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.607563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:36.607733 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.607638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:36.607794 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.607778 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:36.607858 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.607839 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:42:38.607821025 +0000 UTC m=+5.952046112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:36.608308 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.608271 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:36.608413 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.608361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:42:38.608342178 +0000 UTC m=+5.952567265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:36.810636 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:36.809888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:36.810636 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.810104 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:36.810636 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.810123 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:36.810636 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.810136 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:36.810636 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:36.810194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:42:38.810176371 +0000 UTC m=+6.154401442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:37.023685 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.023639 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:37:35 +0000 UTC" deadline="2027-11-05 06:00:46.450215508 +0000 UTC" Jun 11 21:42:37.023685 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.023685 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12272h18m9.426536232s" Jun 11 21:42:37.047416 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.047388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:37.047596 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:37.047525 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:37.048132 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.047967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:37.048132 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:37.048057 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:37.048572 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.048426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:37.048572 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:37.048539 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:37.095421 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.094613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" event={"ID":"d958082cedce48297d312d20c2e8b9d2","Type":"ContainerStarted","Data":"f96fd40f5f6fcd323745acff94d8589b6ddfa7ea40c92913c6f382539a1183d6"} Jun 11 21:42:37.108813 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.108340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" event={"ID":"027e16a1fff3398b7e017b3269af3ba3","Type":"ContainerStarted","Data":"94a9f14ce1f62c90f9063290c6a810ef607c90368017f5bd8c64a576d8ce8b02"} Jun 11 21:42:37.126062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:37.125408 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-118.ec2.internal" podStartSLOduration=3.12538617 podStartE2EDuration="3.12538617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:37.112272863 +0000 UTC m=+4.456497956" watchObservedRunningTime="2026-06-11 21:42:37.12538617 +0000 UTC m=+4.469611264" Jun 11 21:42:38.626001 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:38.625961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:38.626505 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:38.626060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:38.626505 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.626202 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:38.626505 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.626265 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:42:42.626247334 +0000 UTC m=+9.970472427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:38.626694 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.626672 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:38.626748 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.626735 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:42:42.626720305 +0000 UTC m=+9.970945380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:38.828549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:38.827997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:38.828549 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.828119 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:38.828549 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.828140 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:38.828549 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.828154 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:38.828549 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:38.828209 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:42:42.828195144 +0000 UTC m=+10.172420214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:39.046767 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:39.046684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:39.046922 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:39.046687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:39.046922 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:39.046821 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:39.047028 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:39.046936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:39.047028 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:39.046687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:39.047140 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:39.047052 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:41.046903 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:41.046836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:41.046903 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:41.046869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:41.047503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:41.046836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:41.047503 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:41.046968 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:41.047503 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:41.047051 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:41.047503 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:41.047136 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:42.660858 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:42.660805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:42.661352 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:42.660904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:42.661352 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.660948 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:42.661352 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.661029 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:42:50.661007376 +0000 UTC m=+18.005232457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:42.661352 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.661029 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:42.661352 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.661068 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:42:50.661058887 +0000 UTC m=+18.005283960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:42.862584 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:42.862530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:42.862757 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.862713 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:42.862757 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.862734 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:42.862757 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.862747 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:42.862906 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:42.862810 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:42:50.862792681 +0000 UTC m=+18.207017758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:43.048365 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:43.048333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:43.048735 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:43.048595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:43.048862 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:43.048835 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:43.048930 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:43.048840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:43.048930 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:43.048633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:43.049038 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:43.048955 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:45.046906 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:45.046872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:45.047381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:45.046880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:45.047381 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:45.047006 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:45.047381 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:45.047081 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:45.047381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:45.046876 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:45.047381 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:45.047174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:46.131647 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.131475 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="3ed98c27f0e4191720d528b1765ce826bd876dab382ae4872bc086eb5c42056d" exitCode=0 Jun 11 21:42:46.132155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.131564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"3ed98c27f0e4191720d528b1765ce826bd876dab382ae4872bc086eb5c42056d"} Jun 11 21:42:46.133623 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.133597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnl6j" event={"ID":"a486857e-f78b-4835-aa3a-6f00aae1ba37","Type":"ContainerStarted","Data":"d155c496a6836e6675274ae76595a0c1338dc1242ff70d329f4381f1a95ff5f6"} Jun 11 21:42:46.135387 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.135362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" event={"ID":"18b9b6f6-3aaa-4873-9f28-61a600fb1c00","Type":"ContainerStarted","Data":"740937253ff0372e9edd33e242fe9477c3d1df9bc2cf97b19f498e2936fb2546"} Jun 11 21:42:46.137223 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.137027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjj4n" event={"ID":"9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed","Type":"ContainerStarted","Data":"3b2568dd1a55851da8bc62f708b6092c60169628cd1cd28d812963adcc3d737e"} Jun 11 21:42:46.139880 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.139855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzh96" event={"ID":"ef36db73-b675-4e46-ac28-8ca17deb634f","Type":"ContainerStarted","Data":"4d59e4cb6c493906b10c37b2bc86abf30a1d4a71d6e37e6786c987292177c849"} Jun 11 21:42:46.142560 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.142504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" event={"ID":"83fdec30-0099-4393-9c79-4fc2edd35a31","Type":"ContainerStarted","Data":"c36189f28065a2272a06b6d510fd176090043896ad263d0a420ce299da14f7af"} Jun 11 21:42:46.154334 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.154265 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-118.ec2.internal" podStartSLOduration=12.154248018 podStartE2EDuration="12.154248018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:37.126042168 +0000 UTC m=+4.470267263" watchObservedRunningTime="2026-06-11 21:42:46.154248018 +0000 UTC m=+13.498473111" Jun 11 21:42:46.169798 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.169735 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnl6j" podStartSLOduration=3.289481875 podStartE2EDuration="13.169720675s" totalImagesPullingTime="9.8802388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:46.169026031 +0000 UTC m=+13.513251124" watchObservedRunningTime="2026-06-11 21:42:46.169720675 +0000 UTC m=+13.513945767" Jun 11 21:42:46.183550 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.183496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qjj4n" podStartSLOduration=3.336434537 podStartE2EDuration="13.183480477s" totalImagesPullingTime="9.84704594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:46.183444132 +0000 UTC m=+13.527669225" watchObservedRunningTime="2026-06-11 21:42:46.183480477 +0000 UTC m=+13.527705571" Jun 11 21:42:46.203172 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.203130 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w5dkf" podStartSLOduration=3.276025193 podStartE2EDuration="13.203116598s" totalImagesPullingTime="9.927091405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:46.202989997 +0000 UTC m=+13.547215090" watchObservedRunningTime="2026-06-11 21:42:46.203116598 +0000 UTC m=+13.547341689" Jun 11 21:42:46.709538 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:46.709499 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:42:47.038567 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.038448 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:42:46.709520301Z","UUID":"bf7fe4aa-9201-4124-911c-a700e39621b9","Handler":null,"Name":"","Endpoint":""} Jun 11 21:42:47.040611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.040570 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:42:47.040611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.040617 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:42:47.047245 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.047214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:47.047395 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.047260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:47.047395 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.047218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:47.047395 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:47.047375 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:47.047560 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:47.047518 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:47.047624 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:47.047605 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:47.147537 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.147496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" event={"ID":"18b9b6f6-3aaa-4873-9f28-61a600fb1c00","Type":"ContainerStarted","Data":"d36a8c66cb266ebb5aa7be00797a7f559ab8981034f6f785bac24afd98a80c3d"} Jun 11 21:42:47.150701 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.150669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-682xq" event={"ID":"430d229d-d145-4296-9aee-1b3db31964f7","Type":"ContainerStarted","Data":"55ae7c4e071a4d160b3260b55856101c09830ae489506a7567ec05bbd5490a48"} Jun 11 21:42:47.164155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.164096 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wzh96" podStartSLOduration=4.286818471 podStartE2EDuration="14.164075071s" totalImagesPullingTime="9.8772566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:46.21943378 +0000 UTC m=+13.563658897" watchObservedRunningTime="2026-06-11 21:42:47.164075071 +0000 UTC m=+14.508300166" Jun 11 21:42:47.164963 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:47.164920 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-682xq" podStartSLOduration=4.331400939 podStartE2EDuration="14.164907978s" totalImagesPullingTime="9.833507039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:47.163856049 +0000 UTC m=+14.508081163" watchObservedRunningTime="2026-06-11 21:42:47.164907978 +0000 UTC m=+14.509133071" Jun 11 21:42:48.290629 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:48.290589 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:48.291431 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:48.291406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:49.046404 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:49.046360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:49.046594 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:49.046360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:49.046594 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:49.046497 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:49.046728 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:49.046603 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:49.046728 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:49.046360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:49.046819 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:49.046737 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:50.727995 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:50.727948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:50.728638 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:50.728039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:50.728638 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.728107 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:50.728638 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.728171 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:50.728638 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.728191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:43:06.728169716 +0000 UTC m=+34.072394789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:42:50.728638 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.728223 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:43:06.728206332 +0000 UTC m=+34.072431425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:42:50.929613 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:50.929358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:50.929792 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.929498 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:42:50.929792 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.929699 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:42:50.929792 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.929714 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:50.929792 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:50.929773 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:43:06.929755766 +0000 UTC m=+34.273980849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:42:51.047507 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:51.047407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:51.047507 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:51.047437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:51.047722 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:51.047594 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:51.047779 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:51.047411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:51.047779 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:51.047753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:51.047890 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:51.047862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:53.047859 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:53.047810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:53.048357 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:53.047942 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:53.048357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:53.047983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:53.048357 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:53.048150 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:53.048357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:53.048169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:53.049105 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:53.048269 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:55.046374 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:55.046333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:55.046374 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:55.046367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:55.046957 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:55.046338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:55.046957 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:55.046469 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:55.046957 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:55.046560 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:55.046957 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:55.046664 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:57.047121 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:57.047058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:57.047121 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:57.047104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:57.047694 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:57.047167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:57.047694 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:57.047186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:57.047694 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:57.047260 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:57.047694 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:57.047368 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:58.174972 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.174559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjsdm" event={"ID":"d8872af2-fe26-4c54-b863-153203004cd5","Type":"ContainerStarted","Data":"f53e4657ecea6e9361bb21c6e4a9c5dc677fb33671de34697bab56a64985bc55"} Jun 11 21:42:58.176615 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.176586 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="5ccfd111736779b0812252c1a4f7d2a93c1ded51b0a40e7e43990b66cea3c46a" exitCode=0 Jun 11 21:42:58.176755 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.176664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"5ccfd111736779b0812252c1a4f7d2a93c1ded51b0a40e7e43990b66cea3c46a"} Jun 11 21:42:58.179216 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.179046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" event={"ID":"18b9b6f6-3aaa-4873-9f28-61a600fb1c00","Type":"ContainerStarted","Data":"814e842f4708cc027c32000d8190d0f9765b609fcfa6d24b5eff0b63f437529b"} Jun 11 21:42:58.181608 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.181582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"15b15ef000c487ae7beaf544f25de4b79a5b31e9e48bc7a95daf0f2732426a44"} Jun 11 21:42:58.181720 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.181641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"f45d8503a880343bf82b31296f223bf78626d9bace9fad8cd7a038d47eb0263a"} Jun 11 21:42:58.198225 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.198181 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jjsdm" podStartSLOduration=2.608116791 podStartE2EDuration="25.19816694s" totalImagesPullingTime="22.590050149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:58.197598478 +0000 UTC m=+25.541823570" watchObservedRunningTime="2026-06-11 21:42:58.19816694 +0000 UTC m=+25.542392031" Jun 11 21:42:58.223725 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:58.223681 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h7bzz" podStartSLOduration=2.9691195759999998 podStartE2EDuration="25.223666039s" totalImagesPullingTime="22.254546463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:58.222941518 +0000 UTC m=+25.567166637" watchObservedRunningTime="2026-06-11 21:42:58.223666039 +0000 UTC m=+25.567891168" Jun 11 21:42:59.046383 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.046342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:42:59.046590 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.046342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:42:59.046590 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:59.046469 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:42:59.046590 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:59.046521 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:42:59.046590 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.046349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:42:59.046798 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:42:59.046619 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:42:59.186993 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.186907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"878f482a108b2902ee532847c7b028284aac57b649118ce5881187a16e273fc5"} Jun 11 21:42:59.186993 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.186992 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"a245abaeaa9b8634c315d8d12fca4524610665945d23dcefac458b1f8c8bb6f7"} Jun 11 21:42:59.187554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.187032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"b6481917e1579e0a9869fbf0346b0598bebdf76083ab847cfb3d32c6d72e7ec9"} Jun 11 21:42:59.187554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.187065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"f19483e439d603fef0ed29f8af53ecdb09dd1873c3fbacbf0dfc8cb52d946fc8"} Jun 11 21:42:59.188870 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.188843 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="6e3649332539ac734afa03ff10c7b5cff7694ee47635530fe719a88c8fe9235b" exitCode=0 Jun 11 21:42:59.188978 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.188925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"6e3649332539ac734afa03ff10c7b5cff7694ee47635530fe719a88c8fe9235b"} Jun 11 21:42:59.433135 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.433093 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:42:59.433353 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.433232 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:42:59.433672 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:42:59.433655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnl6j" Jun 11 21:43:00.193387 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:00.193296 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="5ee7107c7c21b8f920ad140250a6a85b8b55a4a98ebb8a6dcd5682c486a6efe8" exitCode=0 Jun 11 21:43:00.193387 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:00.193372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"5ee7107c7c21b8f920ad140250a6a85b8b55a4a98ebb8a6dcd5682c486a6efe8"} Jun 11 21:43:01.046912 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:01.046878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:01.047083 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:01.046878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:01.047083 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:01.047011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:01.047083 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:01.046879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:01.047232 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:01.047092 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:01.047232 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:01.047157 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:01.199825 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:01.199792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"301d2c390e4ebe5e6891bcfd8b289a0e17a840832865ac1fa342029f759e2a15"} Jun 11 21:43:03.048217 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.048184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:03.048789 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.048318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:03.048789 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.048337 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:03.048789 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:03.048328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:03.048789 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:03.048422 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:03.048789 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:03.048515 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:03.207365 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.207325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" event={"ID":"83fbe708-adcb-4518-8aff-83413b485aff","Type":"ContainerStarted","Data":"f02ae7132333916b23045f8dbe023984f8e65cee45c4a01b4ae0e7b16c3e8d32"} Jun 11 21:43:03.207627 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.207606 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:03.207710 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.207688 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:03.207824 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.207738 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:03.224621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.224593 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:03.224771 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.224748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:03.233511 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:03.233443 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" podStartSLOduration=7.649154719 podStartE2EDuration="30.23342852s" totalImagesPullingTime="22.584273801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:03.232602196 +0000 UTC m=+30.576827308" watchObservedRunningTime="2026-06-11 21:43:03.23342852 +0000 UTC m=+30.577653611" Jun 11 21:43:04.643692 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.643661 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r5p5"] Jun 11 21:43:04.644157 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.643778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:04.644157 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:04.643854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:04.646223 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.646199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-djgg8"] Jun 11 21:43:04.646355 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.646319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:04.646415 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:04.646398 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:04.654529 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.654503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c99vr"] Jun 11 21:43:04.654633 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:04.654607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:04.654702 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:04.654685 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:06.047248 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:06.047214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:06.047700 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:06.047223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:06.047700 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.047390 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:06.047700 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.047505 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:06.743397 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:06.743356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:06.743576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:06.743446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:06.743576 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.743517 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:06.743576 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.743571 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:06.743717 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.743600 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:43:38.74357859 +0000 UTC m=+66.087803662 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:06.743717 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.743624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret podName:6c6444fc-353c-48df-99fa-b18a8063cfaf nodeName:}" failed. No retries permitted until 2026-06-11 21:43:38.743608725 +0000 UTC m=+66.087833812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret") pod "global-pull-secret-syncer-5r5p5" (UID: "6c6444fc-353c-48df-99fa-b18a8063cfaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:06.945092 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:06.945008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:06.945252 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.945187 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:06.945252 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.945208 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:06.945252 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.945218 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4rm87 for pod openshift-network-diagnostics/network-check-target-djgg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:06.945409 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:06.945274 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87 podName:57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c nodeName:}" failed. No retries permitted until 2026-06-11 21:43:38.945254968 +0000 UTC m=+66.289480037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rm87" (UniqueName: "kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87") pod "network-check-target-djgg8" (UID: "57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:07.046328 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:07.046296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:07.046484 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:07.046419 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:08.046527 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:08.046352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:08.046950 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:08.046401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:08.046950 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:08.046603 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:08.046950 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:08.046664 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:08.222219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:08.222175 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="ab48a83c142abbe0fd387f68def6c692888ff694ab0f4f4332ca93d3c9b4ca7d" exitCode=0 Jun 11 21:43:08.222406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:08.222235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"ab48a83c142abbe0fd387f68def6c692888ff694ab0f4f4332ca93d3c9b4ca7d"} Jun 11 21:43:09.047221 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:09.047179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:09.047842 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:09.047312 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:09.230237 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:09.230201 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9350ece-db35-4c19-9c6b-1a627e183474" containerID="80fc02897d780d826de389316e07fcafbbaa00f466fc39be59a39bbee1447aeb" exitCode=0 Jun 11 21:43:09.230396 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:09.230260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerDied","Data":"80fc02897d780d826de389316e07fcafbbaa00f466fc39be59a39bbee1447aeb"} Jun 11 21:43:10.046326 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:10.046291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:10.046534 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:10.046301 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:10.046534 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:10.046397 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r5p5" podUID="6c6444fc-353c-48df-99fa-b18a8063cfaf" Jun 11 21:43:10.046534 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:10.046480 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:43:10.235802 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:10.235771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" event={"ID":"c9350ece-db35-4c19-9c6b-1a627e183474","Type":"ContainerStarted","Data":"6f035f07964b427d9e3c85d2c13ab8c1e10e005677eb564390ed5cc6486c1593"} Jun 11 21:43:10.259403 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:10.259349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k2nkf" podStartSLOduration=6.828268623 podStartE2EDuration="37.25933212s" totalImagesPullingTime="30.431063497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:10.259107011 +0000 UTC m=+37.603332102" watchObservedRunningTime="2026-06-11 21:43:10.25933212 +0000 UTC m=+37.603557212" Jun 11 21:43:11.046744 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.046701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:11.046917 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.046839 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djgg8" podUID="57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c" Jun 11 21:43:11.467724 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.467697 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-118.ec2.internal" event="NodeReady" Jun 11 21:43:11.468100 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.467818 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:43:11.500366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.500333 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:43:11.521575 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.521536 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vmzgt"] Jun 11 21:43:11.521722 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.521692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.524245 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.524218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 21:43:11.524245 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.524238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2qw2b\"" Jun 11 21:43:11.524245 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.524241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 21:43:11.524485 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.524229 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 21:43:11.533468 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.533442 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 21:43:11.533468 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.533456 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m975x"] Jun 11 21:43:11.533619 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.533588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.535820 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.535798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:43:11.535934 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.535898 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:43:11.536025 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.536010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td5zs\"" Jun 11 21:43:11.551731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.551709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:43:11.551821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.551739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vmzgt"] Jun 11 21:43:11.551821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.551756 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m975x"] Jun 11 21:43:11.551902 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.551819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.554114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.554097 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:43:11.554114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.554107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:43:11.554233 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.554152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:43:11.554233 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.554152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qvtk\"" Jun 11 21:43:11.680044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3784790e-e24d-498d-9418-bd0aec3373e9-cert\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.680252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwkr\" (UniqueName: \"kubernetes.io/projected/d6f082b2-cb1f-42a0-b672-cca04700b7a4-kube-api-access-8xwkr\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6f082b2-cb1f-42a0-b672-cca04700b7a4-config-volume\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrc2\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f082b2-cb1f-42a0-b672-cca04700b7a4-tmp-dir\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.680441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.680407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5ww\" (UniqueName: \"kubernetes.io/projected/3784790e-e24d-498d-9418-bd0aec3373e9-kube-api-access-fs5ww\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.781393 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3784790e-e24d-498d-9418-bd0aec3373e9-cert\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.781393 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwkr\" (UniqueName: \"kubernetes.io/projected/d6f082b2-cb1f-42a0-b672-cca04700b7a4-kube-api-access-8xwkr\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.781598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6f082b2-cb1f-42a0-b672-cca04700b7a4-config-volume\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.781598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.781598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrc2\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.781737 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.781737 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f082b2-cb1f-42a0-b672-cca04700b7a4-tmp-dir\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.781737 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.781737 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.781724 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:11.781737 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5ww\" (UniqueName: \"kubernetes.io/projected/3784790e-e24d-498d-9418-bd0aec3373e9-kube-api-access-fs5ww\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.781940 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.781815 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:12.281793168 +0000 UTC m=+39.626018258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:11.781940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781847 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.781940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.781940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.781975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.781995 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.782008 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f082b2-cb1f-42a0-b672-cca04700b7a4-tmp-dir\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.782111 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:11.782045 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:12.2820335 +0000 UTC m=+39.626258574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:11.782450 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6f082b2-cb1f-42a0-b672-cca04700b7a4-config-volume\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.782589 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.782824 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.782797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.785760 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.785735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.785861 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.785808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.785900 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.785887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3784790e-e24d-498d-9418-bd0aec3373e9-cert\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.790054 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.790023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.790600 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.790572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrc2\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:11.790769 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.790750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5ww\" (UniqueName: \"kubernetes.io/projected/3784790e-e24d-498d-9418-bd0aec3373e9-kube-api-access-fs5ww\") pod \"ingress-canary-m975x\" (UID: \"3784790e-e24d-498d-9418-bd0aec3373e9\") " pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:11.790924 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.790893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwkr\" (UniqueName: \"kubernetes.io/projected/d6f082b2-cb1f-42a0-b672-cca04700b7a4-kube-api-access-8xwkr\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:11.859933 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:11.859877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m975x" Jun 11 21:43:12.046940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.046906 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:12.046940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.046936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:12.050081 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.050053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:43:12.050200 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.050118 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrlsh\"" Jun 11 21:43:12.050200 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.050122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:43:12.079234 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.079035 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m975x"] Jun 11 21:43:12.083190 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:43:12.083165 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3784790e_e24d_498d_9418_bd0aec3373e9.slice/crio-c6b8a4b9e643b917124c8d3ae7dd9d4a901ce08e951893c367ff2e2a93fa374f WatchSource:0}: Error finding container c6b8a4b9e643b917124c8d3ae7dd9d4a901ce08e951893c367ff2e2a93fa374f: Status 404 returned error can't find the container with id c6b8a4b9e643b917124c8d3ae7dd9d4a901ce08e951893c367ff2e2a93fa374f Jun 11 21:43:12.241051 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.240944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m975x" event={"ID":"3784790e-e24d-498d-9418-bd0aec3373e9","Type":"ContainerStarted","Data":"c6b8a4b9e643b917124c8d3ae7dd9d4a901ce08e951893c367ff2e2a93fa374f"} Jun 11 21:43:12.286304 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.286260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:12.286428 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:12.286409 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:12.286463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.286418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:12.286463 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:12.286431 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:12.286520 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:12.286473 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:12.286520 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:12.286508 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:13.286494975 +0000 UTC m=+40.630720046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:12.286520 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:12.286521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:13.286515215 +0000 UTC m=+40.630740285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:12.640085 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.640049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:12.766381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.766333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:12.847147 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:12.847116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:13.048138 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.048062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:13.050712 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.050688 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:43:13.051818 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.051797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:43:13.051928 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.051821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvwg4\"" Jun 11 21:43:13.295016 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.294977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:13.295183 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.295065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:13.295183 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:13.295142 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:13.295183 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:13.295157 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:13.295183 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:13.295159 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:13.295356 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:13.295242 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:15.295222982 +0000 UTC m=+42.639448057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:13.295356 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:13.295258 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:15.295252412 +0000 UTC m=+42.639477482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:13.562555 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.562524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:13.608517 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.608473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:13.959582 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:13.959548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:14.059734 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:14.059658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:15.249414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:15.249381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m975x" event={"ID":"3784790e-e24d-498d-9418-bd0aec3373e9","Type":"ContainerStarted","Data":"4257e15e624b1d2ffe568b7bd62786944153ee7c64dea6cb2ccdf727cff05e70"} Jun 11 21:43:15.265069 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:15.265017 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m975x" podStartSLOduration=1.725938986 podStartE2EDuration="4.264996192s" totalImagesPullingTime="2.539057206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:15.264209245 +0000 UTC m=+42.608434357" watchObservedRunningTime="2026-06-11 21:43:15.264996192 +0000 UTC m=+42.609221278" Jun 11 21:43:15.311303 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:15.311254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:15.311481 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:15.311362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:15.311481 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:15.311428 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:15.311481 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:15.311450 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:15.311481 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:15.311453 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:15.311661 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:15.311508 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:19.311493322 +0000 UTC m=+46.655718393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:15.311661 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:15.311524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:19.311517777 +0000 UTC m=+46.655742847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:19.314221 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:19.314173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:19.339266 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:19.339221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:19.339419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:19.339333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:19.339419 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:19.339397 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:19.339419 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:19.339415 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:19.339574 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:19.339423 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:19.339574 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:19.339473 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:27.339460172 +0000 UTC m=+54.683685245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:19.339574 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:19.339488 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:27.339482675 +0000 UTC m=+54.683707745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:19.415096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:19.415035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:20.190257 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:20.190221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:20.239801 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:20.239769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:21.200340 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:21.200298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:21.249693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:21.249655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:22.128105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:22.128064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:22.753981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:22.753945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:22.816829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:22.816791 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:27.402366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:27.402299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:27.402366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:27.402376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:27.402894 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:27.402460 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:27.402894 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:27.402507 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:27.402894 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:27.402525 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:43.402508538 +0000 UTC m=+70.746733613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:27.402894 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:27.402527 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:27.402894 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:27.402586 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:43:43.40256944 +0000 UTC m=+70.746794524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:32.492148 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:32.492112 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:32.593171 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:32.593138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:35.222981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:35.222948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fpf4" Jun 11 21:43:35.376901 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:35.376867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:35.425501 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:35.425472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:38.779377 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.779340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:43:38.779804 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.779410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:38.782120 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.782099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:43:38.782198 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.782162 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:43:38.790158 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:38.790133 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:43:38.790244 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:38.790213 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:44:42.790187737 +0000 UTC m=+130.134412808 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : secret "metrics-daemon-secret" not found Jun 11 21:43:38.793397 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.793376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c6444fc-353c-48df-99fa-b18a8063cfaf-original-pull-secret\") pod \"global-pull-secret-syncer-5r5p5\" (UID: \"6c6444fc-353c-48df-99fa-b18a8063cfaf\") " pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:38.980815 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.980776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:38.983695 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.983672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:43:38.994626 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:38.994601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:43:39.004927 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.004893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rm87\" (UniqueName: \"kubernetes.io/projected/57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c-kube-api-access-4rm87\") pod \"network-check-target-djgg8\" (UID: \"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c\") " pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:39.058859 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.058769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r5p5" Jun 11 21:43:39.159230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.159201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvwg4\"" Jun 11 21:43:39.167952 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.167909 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:39.181419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.181263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r5p5"] Jun 11 21:43:39.291817 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.291683 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-djgg8"] Jun 11 21:43:39.294123 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:43:39.294098 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d4c7d8_8f4d_4af1_8f7f_2750d3acb84c.slice/crio-4de778367093a0e90d16cb9695806919442bb8a29a14def3452163e9dd8775a2 WatchSource:0}: Error finding container 4de778367093a0e90d16cb9695806919442bb8a29a14def3452163e9dd8775a2: Status 404 returned error can't find the container with id 4de778367093a0e90d16cb9695806919442bb8a29a14def3452163e9dd8775a2 Jun 11 21:43:39.307516 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.307484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-djgg8" event={"ID":"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c","Type":"ContainerStarted","Data":"4de778367093a0e90d16cb9695806919442bb8a29a14def3452163e9dd8775a2"} Jun 11 21:43:39.308471 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:39.308446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r5p5" event={"ID":"6c6444fc-353c-48df-99fa-b18a8063cfaf","Type":"ContainerStarted","Data":"84d13f3aff5ea0fc40bf0063e95183cf0dfd3d61015ce78a82caa2444ea879f8"} Jun 11 21:43:43.418336 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:43.418291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:43.418378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:43.418422 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:43.418500 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:15.418482522 +0000 UTC m=+102.762707596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:43.418540 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:43.418560 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:43:43.418846 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:43:43.418622 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:44:15.418604711 +0000 UTC m=+102.762829798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:43:45.332177 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:45.332146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-djgg8" event={"ID":"57d4c7d8-8f4d-4af1-8f7f-2750d3acb84c","Type":"ContainerStarted","Data":"e939ba757d36b6de5954d9c0d42ec6677f6e7d9832a3a63ff6e7acf444b691b6"} Jun 11 21:43:45.332616 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:45.332251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:43:45.333735 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:45.333700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r5p5" event={"ID":"6c6444fc-353c-48df-99fa-b18a8063cfaf","Type":"ContainerStarted","Data":"d12e63565995fe809dfc4f13d4b7238cd600e7df5b79aa0416577ec12f12aece"} Jun 11 21:43:45.346430 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:45.346380 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-djgg8" podStartSLOduration=67.376979977 podStartE2EDuration="1m12.346365378s" totalImagesPullingTime="4.969385401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:45.346261058 +0000 UTC m=+72.690486170" watchObservedRunningTime="2026-06-11 21:43:45.346365378 +0000 UTC m=+72.690590470" Jun 11 21:43:45.360366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:45.360320 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5r5p5" podStartSLOduration=67.278796796 podStartE2EDuration="1m12.360304971s" totalImagesPullingTime="5.081508175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:45.360110218 +0000 UTC m=+72.704335335" watchObservedRunningTime="2026-06-11 21:43:45.360304971 +0000 UTC m=+72.704530062" Jun 11 21:43:53.810193 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.810074 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c"] Jun 11 21:43:53.813114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.813090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:53.816661 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.816634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xbwxg\"" Jun 11 21:43:53.816786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.816639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 21:43:53.816786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.816688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 21:43:53.816786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.816689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 21:43:53.816920 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.816689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 21:43:53.820248 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.820229 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c"] Jun 11 21:43:53.896569 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.896529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr86p\" (UniqueName: \"kubernetes.io/projected/84fa49f0-7e3b-415d-9cf5-00700d366f02-kube-api-access-wr86p\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:53.896757 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.896617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84fa49f0-7e3b-415d-9cf5-00700d366f02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:53.997242 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.997192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr86p\" (UniqueName: \"kubernetes.io/projected/84fa49f0-7e3b-415d-9cf5-00700d366f02-kube-api-access-wr86p\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:53.997426 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.997266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84fa49f0-7e3b-415d-9cf5-00700d366f02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:53.999763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:53.999741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84fa49f0-7e3b-415d-9cf5-00700d366f02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:54.004887 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:54.004865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr86p\" (UniqueName: \"kubernetes.io/projected/84fa49f0-7e3b-415d-9cf5-00700d366f02-kube-api-access-wr86p\") pod \"managed-serviceaccount-addon-agent-5b85bff66-zvj9c\" (UID: \"84fa49f0-7e3b-415d-9cf5-00700d366f02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:54.132095 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:54.132066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" Jun 11 21:43:54.252608 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:54.252579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c"] Jun 11 21:43:54.255659 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:43:54.255632 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84fa49f0_7e3b_415d_9cf5_00700d366f02.slice/crio-67dfaf4eb061a668d8ae0118f52c825357b4b355a70b539515dd635fbaaeb7bd WatchSource:0}: Error finding container 67dfaf4eb061a668d8ae0118f52c825357b4b355a70b539515dd635fbaaeb7bd: Status 404 returned error can't find the container with id 67dfaf4eb061a668d8ae0118f52c825357b4b355a70b539515dd635fbaaeb7bd Jun 11 21:43:54.355855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:54.355816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" event={"ID":"84fa49f0-7e3b-415d-9cf5-00700d366f02","Type":"ContainerStarted","Data":"67dfaf4eb061a668d8ae0118f52c825357b4b355a70b539515dd635fbaaeb7bd"} Jun 11 21:43:57.366458 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:57.366418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" event={"ID":"84fa49f0-7e3b-415d-9cf5-00700d366f02","Type":"ContainerStarted","Data":"b00dae92d9bf6eade31db130c836439e24442645f53f9e57b5ed6a88c8da8df1"} Jun 11 21:43:57.381937 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:43:57.381891 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" podStartSLOduration=1.896023427 podStartE2EDuration="4.381876405s" totalImagesPullingTime="2.485852978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:57.380759146 +0000 UTC m=+84.724984239" watchObservedRunningTime="2026-06-11 21:43:57.381876405 +0000 UTC m=+84.726101496" Jun 11 21:44:15.459512 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:44:15.459463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:44:15.459531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:15.459618 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:15.459624 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:15.459643 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:15.459699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:45:19.459683137 +0000 UTC m=+166.803908207 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:44:15.459995 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:15.459711 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:45:19.459705523 +0000 UTC m=+166.803930593 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:44:16.337821 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:44:16.337789 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-djgg8" Jun 11 21:44:42.847219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:44:42.847177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:44:42.847730 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:42.847383 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:44:42.847730 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:44:42.847463 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs podName:964496b6-1b92-4c4d-91db-bb37d54d379b nodeName:}" failed. No retries permitted until 2026-06-11 21:46:44.84744645 +0000 UTC m=+252.191671520 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs") pod "network-metrics-daemon-c99vr" (UID: "964496b6-1b92-4c4d-91db-bb37d54d379b") : secret "metrics-daemon-secret" not found Jun 11 21:45:14.537444 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:14.537341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" Jun 11 21:45:14.543535 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:14.543502 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vmzgt" podUID="d6f082b2-cb1f-42a0-b672-cca04700b7a4" Jun 11 21:45:14.548292 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:14.548267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:45:14.548388 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:14.548271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:45:15.064323 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:15.064276 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c99vr" podUID="964496b6-1b92-4c4d-91db-bb37d54d379b" Jun 11 21:45:19.497019 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:19.496915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:45:19.497019 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:19.496987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:45:19.497557 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:19.497067 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:45:19.497557 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:19.497101 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:45:19.497557 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:19.497117 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6547485f57-h4j6n: secret "image-registry-tls" not found Jun 11 21:45:19.497557 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:19.497145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls podName:d6f082b2-cb1f-42a0-b672-cca04700b7a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:47:21.497127213 +0000 UTC m=+288.841352304 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls") pod "dns-default-vmzgt" (UID: "d6f082b2-cb1f-42a0-b672-cca04700b7a4") : secret "dns-default-metrics-tls" not found Jun 11 21:45:19.497557 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:45:19.497179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls podName:dca48a26-4139-4513-b0e8-7f20be8e567f nodeName:}" failed. No retries permitted until 2026-06-11 21:47:21.497163083 +0000 UTC m=+288.841388155 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls") pod "image-registry-6547485f57-h4j6n" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f") : secret "image-registry-tls" not found Jun 11 21:45:27.046987 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:27.046948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:45:57.656865 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:57.656832 2577 generic.go:356] "Generic (PLEG): container finished" podID="84fa49f0-7e3b-415d-9cf5-00700d366f02" containerID="b00dae92d9bf6eade31db130c836439e24442645f53f9e57b5ed6a88c8da8df1" exitCode=255 Jun 11 21:45:57.657266 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:57.656884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" event={"ID":"84fa49f0-7e3b-415d-9cf5-00700d366f02","Type":"ContainerDied","Data":"b00dae92d9bf6eade31db130c836439e24442645f53f9e57b5ed6a88c8da8df1"} Jun 11 21:45:57.662328 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:57.662307 2577 scope.go:117] "RemoveContainer" containerID="b00dae92d9bf6eade31db130c836439e24442645f53f9e57b5ed6a88c8da8df1" Jun 11 21:45:58.660680 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:45:58.660642 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b85bff66-zvj9c" event={"ID":"84fa49f0-7e3b-415d-9cf5-00700d366f02","Type":"ContainerStarted","Data":"175905701cc74e16fb78c41489478bb49244cd569f13cc24ddf33aebe8f98f76"} Jun 11 21:46:10.364456 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.364422 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h"] Jun 11 21:46:10.367340 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.367324 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.370804 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.370782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 21:46:10.370924 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.370786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nt6gk\"" Jun 11 21:46:10.371929 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.371911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.372021 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.371961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.386698 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.386668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h"] Jun 11 21:46:10.456327 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.456276 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z"] Jun 11 21:46:10.456541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.456516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.456604 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.456551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggxq\" (UniqueName: \"kubernetes.io/projected/41fe6b49-328c-4fea-95e4-facd35d1e4f8-kube-api-access-8ggxq\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.459142 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.459121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" Jun 11 21:46:10.462015 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.461985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rxbdv\"" Jun 11 21:46:10.462015 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.462006 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.462492 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.462030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.463444 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.463421 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh"] Jun 11 21:46:10.466241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.466221 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt"] Jun 11 21:46:10.466403 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.466384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.468836 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.468815 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 21:46:10.469162 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469143 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-j95d8"] Jun 11 21:46:10.469258 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469167 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.469343 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469306 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.469398 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.469398 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469188 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 21:46:10.469498 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.469167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wmkfm\"" Jun 11 21:46:10.472096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472077 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.472224 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 21:46:10.472335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" Jun 11 21:46:10.472335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.472335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lxw9d\"" Jun 11 21:46:10.472555 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.472156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z"] Jun 11 21:46:10.474346 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.474329 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 21:46:10.475907 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.475885 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6bl5l\"" Jun 11 21:46:10.477333 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.477311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-j95d8"] Jun 11 21:46:10.479001 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.478924 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt"] Jun 11 21:46:10.487018 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.486992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh"] Jun 11 21:46:10.556984 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.556948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmc8h\" (UniqueName: \"kubernetes.io/projected/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-kube-api-access-pmc8h\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.556984 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.556988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/348a1396-20d4-4189-9a92-bcc70b6ce8ba-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.557204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.557204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggxq\" (UniqueName: \"kubernetes.io/projected/41fe6b49-328c-4fea-95e4-facd35d1e4f8-kube-api-access-8ggxq\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.557204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.557204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9n9t\" (UniqueName: \"kubernetes.io/projected/30795e89-a653-4844-a266-9397a0e47230-kube-api-access-d9n9t\") pod \"network-check-source-6947749cfc-j95d8\" (UID: \"30795e89-a653-4844-a266-9397a0e47230\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" Jun 11 21:46:10.557204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9t8f\" (UniqueName: \"kubernetes.io/projected/348a1396-20d4-4189-9a92-bcc70b6ce8ba-kube-api-access-w9t8f\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.557408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6n9g\" (UniqueName: \"kubernetes.io/projected/610fce85-3eb6-4c03-a491-16e48f5fb92c-kube-api-access-f6n9g\") pod \"volume-data-source-validator-bd4ccd799-h9s4z\" (UID: \"610fce85-3eb6-4c03-a491-16e48f5fb92c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" Jun 11 21:46:10.557408 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:10.557355 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:46:10.557476 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:10.557410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls podName:41fe6b49-328c-4fea-95e4-facd35d1e4f8 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.057395674 +0000 UTC m=+218.401620747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-p6b8h" (UID: "41fe6b49-328c-4fea-95e4-facd35d1e4f8") : secret "samples-operator-tls" not found Jun 11 21:46:10.557476 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.557476 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.557454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.571967 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.571932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggxq\" (UniqueName: \"kubernetes.io/projected/41fe6b49-328c-4fea-95e4-facd35d1e4f8-kube-api-access-8ggxq\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:10.658399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.658399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9n9t\" (UniqueName: \"kubernetes.io/projected/30795e89-a653-4844-a266-9397a0e47230-kube-api-access-d9n9t\") pod \"network-check-source-6947749cfc-j95d8\" (UID: \"30795e89-a653-4844-a266-9397a0e47230\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" Jun 11 21:46:10.658399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9t8f\" (UniqueName: \"kubernetes.io/projected/348a1396-20d4-4189-9a92-bcc70b6ce8ba-kube-api-access-w9t8f\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.658399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6n9g\" (UniqueName: \"kubernetes.io/projected/610fce85-3eb6-4c03-a491-16e48f5fb92c-kube-api-access-f6n9g\") pod \"volume-data-source-validator-bd4ccd799-h9s4z\" (UID: \"610fce85-3eb6-4c03-a491-16e48f5fb92c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" Jun 11 21:46:10.658399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.658785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.658785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmc8h\" (UniqueName: \"kubernetes.io/projected/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-kube-api-access-pmc8h\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.658785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/348a1396-20d4-4189-9a92-bcc70b6ce8ba-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.658785 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:10.658587 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:10.658785 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:10.658680 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls podName:348a1396-20d4-4189-9a92-bcc70b6ce8ba nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.15865846 +0000 UTC m=+218.502883535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fw4lt" (UID: "348a1396-20d4-4189-9a92-bcc70b6ce8ba") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:10.658999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.658920 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.659162 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.659144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/348a1396-20d4-4189-9a92-bcc70b6ce8ba-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.660757 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.660734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.667060 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.667031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9t8f\" (UniqueName: \"kubernetes.io/projected/348a1396-20d4-4189-9a92-bcc70b6ce8ba-kube-api-access-w9t8f\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:10.667060 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.667054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmc8h\" (UniqueName: \"kubernetes.io/projected/70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3-kube-api-access-pmc8h\") pod \"kube-storage-version-migrator-operator-7c578b78fc-nfczh\" (UID: \"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.667255 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.667174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9n9t\" (UniqueName: \"kubernetes.io/projected/30795e89-a653-4844-a266-9397a0e47230-kube-api-access-d9n9t\") pod \"network-check-source-6947749cfc-j95d8\" (UID: \"30795e89-a653-4844-a266-9397a0e47230\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" Jun 11 21:46:10.667335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.667319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6n9g\" (UniqueName: \"kubernetes.io/projected/610fce85-3eb6-4c03-a491-16e48f5fb92c-kube-api-access-f6n9g\") pod \"volume-data-source-validator-bd4ccd799-h9s4z\" (UID: \"610fce85-3eb6-4c03-a491-16e48f5fb92c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" Jun 11 21:46:10.769322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.769261 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" Jun 11 21:46:10.781607 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.781585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" Jun 11 21:46:10.794563 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.794538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" Jun 11 21:46:10.913169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.912865 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z"] Jun 11 21:46:10.916381 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:10.916353 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610fce85_3eb6_4c03_a491_16e48f5fb92c.slice/crio-bab3f37f8a1c769c94351b87eca8ed39ef17e7524177fc2e39fbfe51d957e150 WatchSource:0}: Error finding container bab3f37f8a1c769c94351b87eca8ed39ef17e7524177fc2e39fbfe51d957e150: Status 404 returned error can't find the container with id bab3f37f8a1c769c94351b87eca8ed39ef17e7524177fc2e39fbfe51d957e150 Jun 11 21:46:10.928013 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.927982 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh"] Jun 11 21:46:10.929906 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:10.929882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b7ea98_b1e8_47d5_b5a5_6b422f3e4de3.slice/crio-237c359db3dac6f0823149429d8b988708af65835661f02fd1a740285c89fea1 WatchSource:0}: Error finding container 237c359db3dac6f0823149429d8b988708af65835661f02fd1a740285c89fea1: Status 404 returned error can't find the container with id 237c359db3dac6f0823149429d8b988708af65835661f02fd1a740285c89fea1 Jun 11 21:46:10.940915 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:10.940893 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-j95d8"] Jun 11 21:46:10.943068 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:10.943030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30795e89_a653_4844_a266_9397a0e47230.slice/crio-071da633984844c772756eef9cd71b0c908f5cff19cb11468a81171afe22bb12 WatchSource:0}: Error finding container 071da633984844c772756eef9cd71b0c908f5cff19cb11468a81171afe22bb12: Status 404 returned error can't find the container with id 071da633984844c772756eef9cd71b0c908f5cff19cb11468a81171afe22bb12 Jun 11 21:46:11.061507 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.061480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:11.061674 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:11.061630 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:46:11.061757 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:11.061705 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls podName:41fe6b49-328c-4fea-95e4-facd35d1e4f8 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.061681891 +0000 UTC m=+219.405906987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-p6b8h" (UID: "41fe6b49-328c-4fea-95e4-facd35d1e4f8") : secret "samples-operator-tls" not found Jun 11 21:46:11.162843 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.162805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:11.163003 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:11.162942 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:11.163003 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:11.163001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls podName:348a1396-20d4-4189-9a92-bcc70b6ce8ba nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.162985536 +0000 UTC m=+219.507210626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fw4lt" (UID: "348a1396-20d4-4189-9a92-bcc70b6ce8ba") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:11.696143 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.696098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" event={"ID":"610fce85-3eb6-4c03-a491-16e48f5fb92c","Type":"ContainerStarted","Data":"bab3f37f8a1c769c94351b87eca8ed39ef17e7524177fc2e39fbfe51d957e150"} Jun 11 21:46:11.697868 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.697797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" event={"ID":"30795e89-a653-4844-a266-9397a0e47230","Type":"ContainerStarted","Data":"8244106708a74d694c65104a369afc9c73ac310663a904f1e9a281bfd3e39013"} Jun 11 21:46:11.697868 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.697846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" event={"ID":"30795e89-a653-4844-a266-9397a0e47230","Type":"ContainerStarted","Data":"071da633984844c772756eef9cd71b0c908f5cff19cb11468a81171afe22bb12"} Jun 11 21:46:11.699019 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.698995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" event={"ID":"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3","Type":"ContainerStarted","Data":"237c359db3dac6f0823149429d8b988708af65835661f02fd1a740285c89fea1"} Jun 11 21:46:11.715526 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:11.715473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-j95d8" podStartSLOduration=1.71545396 podStartE2EDuration="1.71545396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:11.71468458 +0000 UTC m=+219.058909672" watchObservedRunningTime="2026-06-11 21:46:11.71545396 +0000 UTC m=+219.059679052" Jun 11 21:46:12.071442 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:12.071353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:12.071609 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:12.071539 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:46:12.071668 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:12.071620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls podName:41fe6b49-328c-4fea-95e4-facd35d1e4f8 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.071597551 +0000 UTC m=+221.415822625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-p6b8h" (UID: "41fe6b49-328c-4fea-95e4-facd35d1e4f8") : secret "samples-operator-tls" not found Jun 11 21:46:12.172854 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:12.172813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:12.173017 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:12.172975 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:12.173055 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:12.173045 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls podName:348a1396-20d4-4189-9a92-bcc70b6ce8ba nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.173027036 +0000 UTC m=+221.517252106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fw4lt" (UID: "348a1396-20d4-4189-9a92-bcc70b6ce8ba") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:12.704086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:12.704045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" event={"ID":"610fce85-3eb6-4c03-a491-16e48f5fb92c","Type":"ContainerStarted","Data":"685ebeefd661d76d153beb436ad801fb82a853d0a78f2ce9b2c1c9a066426129"} Jun 11 21:46:12.718818 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:12.718768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-h9s4z" podStartSLOduration=1.409131805 podStartE2EDuration="2.718751509s" totalImagesPullingTime="1.309619704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:12.718073878 +0000 UTC m=+220.062298977" watchObservedRunningTime="2026-06-11 21:46:12.718751509 +0000 UTC m=+220.062976613" Jun 11 21:46:13.709801 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:13.709756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" event={"ID":"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3","Type":"ContainerStarted","Data":"6bafc9bca02b0f60a4d878cf847d292a9876f005e5ff8d44e765c306a6992eff"} Jun 11 21:46:13.724922 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:13.724872 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" podStartSLOduration=1.5141159709999998 podStartE2EDuration="3.724859744s" totalImagesPullingTime="2.210743773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:13.723461261 +0000 UTC m=+221.067686353" watchObservedRunningTime="2026-06-11 21:46:13.724859744 +0000 UTC m=+221.069084835" Jun 11 21:46:14.088875 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.088772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:14.089022 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:14.088917 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:46:14.089022 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:14.088993 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls podName:41fe6b49-328c-4fea-95e4-facd35d1e4f8 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.088977558 +0000 UTC m=+225.433202628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-p6b8h" (UID: "41fe6b49-328c-4fea-95e4-facd35d1e4f8") : secret "samples-operator-tls" not found Jun 11 21:46:14.189678 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.189632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:14.189858 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:14.189750 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:14.189858 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:14.189802 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls podName:348a1396-20d4-4189-9a92-bcc70b6ce8ba nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.18978816 +0000 UTC m=+225.534013230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fw4lt" (UID: "348a1396-20d4-4189-9a92-bcc70b6ce8ba") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:14.664949 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.664910 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs"] Jun 11 21:46:14.668107 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.668090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" Jun 11 21:46:14.670437 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.670413 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 21:46:14.671455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.671434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2v8m2\"" Jun 11 21:46:14.671529 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.671479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 21:46:14.677405 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.677382 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs"] Jun 11 21:46:14.795028 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.794992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ls9m\" (UniqueName: \"kubernetes.io/projected/b70d5f2b-fecc-43a1-a805-6b5acbc59d18-kube-api-access-6ls9m\") pod \"migrator-d4bcd4867-zvbxs\" (UID: \"b70d5f2b-fecc-43a1-a805-6b5acbc59d18\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" Jun 11 21:46:14.896088 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.896038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ls9m\" (UniqueName: \"kubernetes.io/projected/b70d5f2b-fecc-43a1-a805-6b5acbc59d18-kube-api-access-6ls9m\") pod \"migrator-d4bcd4867-zvbxs\" (UID: \"b70d5f2b-fecc-43a1-a805-6b5acbc59d18\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" Jun 11 21:46:14.903293 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.903263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ls9m\" (UniqueName: \"kubernetes.io/projected/b70d5f2b-fecc-43a1-a805-6b5acbc59d18-kube-api-access-6ls9m\") pod \"migrator-d4bcd4867-zvbxs\" (UID: \"b70d5f2b-fecc-43a1-a805-6b5acbc59d18\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" Jun 11 21:46:14.977582 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:14.977502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" Jun 11 21:46:15.034312 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.034071 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7nf"] Jun 11 21:46:15.037611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.037586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.040321 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.040211 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:46:15.040321 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.040234 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:46:15.040607 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.040584 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:46:15.041031 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.041010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gx8d\"" Jun 11 21:46:15.041179 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.041162 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:46:15.050352 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.050323 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7nf"] Jun 11 21:46:15.099794 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.099766 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs"] Jun 11 21:46:15.103498 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:15.103464 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70d5f2b_fecc_43a1_a805_6b5acbc59d18.slice/crio-eaccf057961902f7cc6cb08dc74f2fc56dda09b4a397b154891657608ba02e22 WatchSource:0}: Error finding container eaccf057961902f7cc6cb08dc74f2fc56dda09b4a397b154891657608ba02e22: Status 404 returned error can't find the container with id eaccf057961902f7cc6cb08dc74f2fc56dda09b4a397b154891657608ba02e22 Jun 11 21:46:15.199419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.199372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f68t\" (UniqueName: \"kubernetes.io/projected/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-api-access-4f68t\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.199419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.199427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-data-volume\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.199621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.199511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-crio-socket\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.199621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.199548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.199684 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.199658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.300844 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.300844 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f68t\" (UniqueName: \"kubernetes.io/projected/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-api-access-4f68t\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.300844 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-data-volume\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-crio-socket\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.300905 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300921 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-crio-socket\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.300965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.300986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:15.800966479 +0000 UTC m=+223.145191572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : configmap "kube-rbac-proxy" not found Jun 11 21:46:15.301075 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.301050 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.301373 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.301090 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:15.801076878 +0000 UTC m=+223.145301948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.301373 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.301186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-data-volume\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.308761 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.308735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f68t\" (UniqueName: \"kubernetes.io/projected/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-api-access-4f68t\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.717153 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.717116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" event={"ID":"b70d5f2b-fecc-43a1-a805-6b5acbc59d18","Type":"ContainerStarted","Data":"eaccf057961902f7cc6cb08dc74f2fc56dda09b4a397b154891657608ba02e22"} Jun 11 21:46:15.804300 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.804241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.804763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:15.804328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:15.804763 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.804357 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:15.804763 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.804421 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:16.804404802 +0000 UTC m=+224.148629872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : configmap "kube-rbac-proxy" not found Jun 11 21:46:15.804763 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.804433 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.804763 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:15.804512 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:16.804493561 +0000 UTC m=+224.148718643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:16.721963 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:16.721924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" event={"ID":"b70d5f2b-fecc-43a1-a805-6b5acbc59d18","Type":"ContainerStarted","Data":"8b6118b797c37356f39d63e723729a866d96535bf5f24410701534892d0d9a65"} Jun 11 21:46:16.722127 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:16.721985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" event={"ID":"b70d5f2b-fecc-43a1-a805-6b5acbc59d18","Type":"ContainerStarted","Data":"d368cc119d4a1eb24fd8e76cdabd0f0157bc433c7eef7ff8f04ecc2b4efe1e4d"} Jun 11 21:46:16.739618 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:16.739496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-zvbxs" podStartSLOduration=1.369298983 podStartE2EDuration="2.739481509s" totalImagesPullingTime="1.370182526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:16.737820942 +0000 UTC m=+224.082046055" watchObservedRunningTime="2026-06-11 21:46:16.739481509 +0000 UTC m=+224.083706600" Jun 11 21:46:16.813062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:16.813017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:16.813546 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:16.813174 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:16.813546 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:16.813205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:16.813546 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:16.813241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.813224341 +0000 UTC m=+226.157449410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : configmap "kube-rbac-proxy" not found Jun 11 21:46:16.813546 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:16.813323 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:16.813546 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:16.813370 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.813358132 +0000 UTC m=+226.157583207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:17.826969 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:17.826943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzh96_ef36db73-b675-4e46-ac28-8ca17deb634f/dns-node-resolver/0.log" Jun 11 21:46:18.123580 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:18.123537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:18.123736 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.123682 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:46:18.123800 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.123747 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls podName:41fe6b49-328c-4fea-95e4-facd35d1e4f8 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.123731156 +0000 UTC m=+233.467956225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls") pod "cluster-samples-operator-9547488fd-p6b8h" (UID: "41fe6b49-328c-4fea-95e4-facd35d1e4f8") : secret "samples-operator-tls" not found Jun 11 21:46:18.224012 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:18.223976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:18.224178 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.224133 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:18.224224 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.224197 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls podName:348a1396-20d4-4189-9a92-bcc70b6ce8ba nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.224180546 +0000 UTC m=+233.568405616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fw4lt" (UID: "348a1396-20d4-4189-9a92-bcc70b6ce8ba") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:46:18.827332 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:18.827296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:18.827803 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:18.827383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:18.827803 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.827401 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:18.827803 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.827450 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:18.827803 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.827482 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:22.827457356 +0000 UTC m=+230.171682443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:18.827803 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:18.827503 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:22.827493382 +0000 UTC m=+230.171718460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : configmap "kube-rbac-proxy" not found Jun 11 21:46:19.026746 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:19.026717 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjj4n_9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed/node-ca/0.log" Jun 11 21:46:19.627450 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:19.627421 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m975x_3784790e-e24d-498d-9418-bd0aec3373e9/serve-healthcheck-canary/0.log" Jun 11 21:46:20.027473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:20.027396 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-zvbxs_b70d5f2b-fecc-43a1-a805-6b5acbc59d18/migrator/0.log" Jun 11 21:46:20.227463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:20.227435 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-zvbxs_b70d5f2b-fecc-43a1-a805-6b5acbc59d18/graceful-termination/0.log" Jun 11 21:46:20.429185 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:20.429133 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-nfczh_70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3/kube-storage-version-migrator-operator/0.log" Jun 11 21:46:22.856777 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:22.856743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:22.857158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:22.856833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:22.857158 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:22.856882 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:22.857158 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:22.856897 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:22.857158 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:22.856946 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:30.856928432 +0000 UTC m=+238.201153505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:22.857158 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:22.856984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm podName:10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e nodeName:}" failed. No retries permitted until 2026-06-11 21:46:30.856958209 +0000 UTC m=+238.201183290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7nf" (UID: "10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e") : configmap "kube-rbac-proxy" not found Jun 11 21:46:26.182043 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.182000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:26.184434 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.184412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41fe6b49-328c-4fea-95e4-facd35d1e4f8-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-p6b8h\" (UID: \"41fe6b49-328c-4fea-95e4-facd35d1e4f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:26.275635 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.275599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" Jun 11 21:46:26.283078 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.283039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:26.285623 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.285590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/348a1396-20d4-4189-9a92-bcc70b6ce8ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fw4lt\" (UID: \"348a1396-20d4-4189-9a92-bcc70b6ce8ba\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:26.391379 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.391346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" Jun 11 21:46:26.399197 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.399157 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h"] Jun 11 21:46:26.519811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.519653 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt"] Jun 11 21:46:26.521802 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:26.521774 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348a1396_20d4_4189_9a92_bcc70b6ce8ba.slice/crio-9567a7b8ae9dd65037940e42ba597b8cb25a24d6c0dcf7e1a2393f3fb5d2ca97 WatchSource:0}: Error finding container 9567a7b8ae9dd65037940e42ba597b8cb25a24d6c0dcf7e1a2393f3fb5d2ca97: Status 404 returned error can't find the container with id 9567a7b8ae9dd65037940e42ba597b8cb25a24d6c0dcf7e1a2393f3fb5d2ca97 Jun 11 21:46:26.753836 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.753752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" event={"ID":"348a1396-20d4-4189-9a92-bcc70b6ce8ba","Type":"ContainerStarted","Data":"9567a7b8ae9dd65037940e42ba597b8cb25a24d6c0dcf7e1a2393f3fb5d2ca97"} Jun 11 21:46:26.754814 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:26.754785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" event={"ID":"41fe6b49-328c-4fea-95e4-facd35d1e4f8","Type":"ContainerStarted","Data":"959d7c8f1321a485adabe2f8af695ce336c0888e72d937ed58273840fb72bf8f"} Jun 11 21:46:28.763566 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:28.763531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" event={"ID":"41fe6b49-328c-4fea-95e4-facd35d1e4f8","Type":"ContainerStarted","Data":"dd5ed4808aab5b25ebf0b01c90b10ac441e78e8da58d24c11adf508bf1edd598"} Jun 11 21:46:28.764062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:28.763593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" event={"ID":"41fe6b49-328c-4fea-95e4-facd35d1e4f8","Type":"ContainerStarted","Data":"2dd86e4360bcaa36087fea65501711761428cd8b94d2503fa4fbb943be599d8f"} Jun 11 21:46:28.765104 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:28.765079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" event={"ID":"348a1396-20d4-4189-9a92-bcc70b6ce8ba","Type":"ContainerStarted","Data":"b92402b717c18c4d99c8ba5aa446cb047cf22ebda5331b8e3d7447cee4946bb9"} Jun 11 21:46:28.782017 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:28.781964 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-p6b8h" podStartSLOduration=16.651138215 podStartE2EDuration="18.7819485s" totalImagesPullingTime="2.130810285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:28.781549196 +0000 UTC m=+236.125774310" watchObservedRunningTime="2026-06-11 21:46:28.7819485 +0000 UTC m=+236.126173594" Jun 11 21:46:28.796366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:28.796311 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fw4lt" podStartSLOduration=16.736615088 podStartE2EDuration="18.796275786s" totalImagesPullingTime="2.059660698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:28.794467396 +0000 UTC m=+236.138692490" watchObservedRunningTime="2026-06-11 21:46:28.796275786 +0000 UTC m=+236.140500880" Jun 11 21:46:30.920406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:30.920347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:30.920406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:30.920420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:30.921035 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:30.921010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:30.922866 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:30.922835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7nf\" (UID: \"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e\") " pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:30.949466 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:30.949434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5r7nf" Jun 11 21:46:31.077798 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:31.077772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7nf"] Jun 11 21:46:31.080228 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:31.080199 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ab0c06_1cd4_47ab_8bc4_ef9a5e574b6e.slice/crio-417e36964ad1821fb8c54228852fc175037cb73e44da8f31f9337e2453cbd132 WatchSource:0}: Error finding container 417e36964ad1821fb8c54228852fc175037cb73e44da8f31f9337e2453cbd132: Status 404 returned error can't find the container with id 417e36964ad1821fb8c54228852fc175037cb73e44da8f31f9337e2453cbd132 Jun 11 21:46:31.777194 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:31.777143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7nf" event={"ID":"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e","Type":"ContainerStarted","Data":"417e36964ad1821fb8c54228852fc175037cb73e44da8f31f9337e2453cbd132"} Jun 11 21:46:34.793949 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:34.793917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7nf" event={"ID":"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e","Type":"ContainerStarted","Data":"fdf0a40921667fe1ba08ad0dbb9e683a0e3c4b4fdaed6b986d91cc9c11569fc1"} Jun 11 21:46:35.799305 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:35.799245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7nf" event={"ID":"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e","Type":"ContainerStarted","Data":"4ba9f280665128049f43fd925a6d091ba6e1a3dcbdaed05a1c46eab91e36f633"} Jun 11 21:46:36.808158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.808128 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c"] Jun 11 21:46:36.816811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.816785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:36.820174 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.820148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lfp6k\"" Jun 11 21:46:36.821243 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.821223 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 21:46:36.824365 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.824271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c"] Jun 11 21:46:36.868953 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.868910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/614aa11d-868a-41d7-aeb0-96327af7899b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rpc5c\" (UID: \"614aa11d-868a-41d7-aeb0-96327af7899b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:36.970036 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.970004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/614aa11d-868a-41d7-aeb0-96327af7899b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rpc5c\" (UID: \"614aa11d-868a-41d7-aeb0-96327af7899b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:36.972778 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:36.972742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/614aa11d-868a-41d7-aeb0-96327af7899b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rpc5c\" (UID: \"614aa11d-868a-41d7-aeb0-96327af7899b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:37.128464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:37.128426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:37.250791 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:37.250767 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c"] Jun 11 21:46:37.253015 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:37.252987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614aa11d_868a_41d7_aeb0_96327af7899b.slice/crio-656480cca063da0e1e3ba396e9c0a852672e4522091255bfd1f5d04a749d5fb2 WatchSource:0}: Error finding container 656480cca063da0e1e3ba396e9c0a852672e4522091255bfd1f5d04a749d5fb2: Status 404 returned error can't find the container with id 656480cca063da0e1e3ba396e9c0a852672e4522091255bfd1f5d04a749d5fb2 Jun 11 21:46:37.809421 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:37.809383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7nf" event={"ID":"10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e","Type":"ContainerStarted","Data":"6d9404be622787376fbb55acf664065654d99461b8c7c31590ae73976f1c770b"} Jun 11 21:46:37.810813 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:37.810787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" event={"ID":"614aa11d-868a-41d7-aeb0-96327af7899b","Type":"ContainerStarted","Data":"656480cca063da0e1e3ba396e9c0a852672e4522091255bfd1f5d04a749d5fb2"} Jun 11 21:46:37.828237 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:37.828181 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5r7nf" podStartSLOduration=17.078050494 podStartE2EDuration="22.828164736s" totalImagesPullingTime="5.750114242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:46:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:37.8268459 +0000 UTC m=+245.171070993" watchObservedRunningTime="2026-06-11 21:46:37.828164736 +0000 UTC m=+245.172389825" Jun 11 21:46:38.815837 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:38.815792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" event={"ID":"614aa11d-868a-41d7-aeb0-96327af7899b","Type":"ContainerStarted","Data":"3e92a9e3e005595786ffbf1fd5d040ee635218d54f88aca5e9b71273fc0cc8a9"} Jun 11 21:46:38.816237 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:38.815862 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:38.820496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:38.820454 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" Jun 11 21:46:38.831830 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:38.831759 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rpc5c" podStartSLOduration=1.827476114 podStartE2EDuration="2.83174413s" totalImagesPullingTime="1.004268016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:38.829597629 +0000 UTC m=+246.173822742" watchObservedRunningTime="2026-06-11 21:46:38.83174413 +0000 UTC m=+246.175969221" Jun 11 21:46:43.445529 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.445487 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5"] Jun 11 21:46:43.448956 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.448931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.452623 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.452586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 21:46:43.452791 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.452598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n28sm\"" Jun 11 21:46:43.452791 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.452598 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:46:43.452791 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.452598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:46:43.456337 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.456317 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lcblm"] Jun 11 21:46:43.459480 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.459460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.459631 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.459525 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5"] Jun 11 21:46:43.462099 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.461908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:46:43.462099 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.461959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sv95p\"" Jun 11 21:46:43.462099 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.461984 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 21:46:43.462099 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.462009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 21:46:43.468327 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.468306 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d7zzl"] Jun 11 21:46:43.471586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.471568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lcblm"] Jun 11 21:46:43.471684 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.471668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.474472 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.474447 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:46:43.474576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.474476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xczvw\"" Jun 11 21:46:43.474576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.474504 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:46:43.474576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.474458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:46:43.522491 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-root\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522672 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-metrics-client-ca\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522672 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522672 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.522672 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-wtmp\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/821f0dfb-db8d-43db-a135-f6eb76cc83e9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-textfile\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb6x5\" (UniqueName: \"kubernetes.io/projected/d6864066-a78c-4ada-8b91-0408ad00cead-kube-api-access-hb6x5\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.522883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.523204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.523204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.522948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kk5\" (UniqueName: \"kubernetes.io/projected/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-kube-api-access-q2kk5\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.523204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.523000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxvj\" (UniqueName: \"kubernetes.io/projected/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-api-access-8vxvj\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.523204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.523022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-sys\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.523204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.523056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.624171 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-wtmp\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624171 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/821f0dfb-db8d-43db-a135-f6eb76cc83e9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-textfile\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb6x5\" (UniqueName: \"kubernetes.io/projected/d6864066-a78c-4ada-8b91-0408ad00cead-kube-api-access-hb6x5\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-wtmp\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kk5\" (UniqueName: \"kubernetes.io/projected/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-kube-api-access-q2kk5\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.624389 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxvj\" (UniqueName: \"kubernetes.io/projected/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-api-access-8vxvj\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.624455 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.624459 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls podName:b6c399c9-e0c9-4e20-aeb5-08eb3a429a93 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:44.124436746 +0000 UTC m=+251.468661818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-7pnx5" (UID: "b6c399c9-e0c9-4e20-aeb5-08eb3a429a93") : secret "openshift-state-metrics-tls" not found Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.624532 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.624581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls podName:d6864066-a78c-4ada-8b91-0408ad00cead nodeName:}" failed. No retries permitted until 2026-06-11 21:46:44.124563228 +0000 UTC m=+251.468788302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls") pod "node-exporter-d7zzl" (UID: "d6864066-a78c-4ada-8b91-0408ad00cead") : secret "node-exporter-tls" not found Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-sys\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-textfile\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624662 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/821f0dfb-db8d-43db-a135-f6eb76cc83e9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-root\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-sys\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-metrics-client-ca\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6864066-a78c-4ada-8b91-0408ad00cead-root\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.625039 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.624947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.625174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.625254 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.625321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6864066-a78c-4ada-8b91-0408ad00cead-metrics-client-ca\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.625344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:46:43.625330 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls podName:821f0dfb-db8d-43db-a135-f6eb76cc83e9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:44.125313589 +0000 UTC m=+251.469538662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-lcblm" (UID: "821f0dfb-db8d-43db-a135-f6eb76cc83e9") : secret "kube-state-metrics-tls" not found Jun 11 21:46:43.625811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.625658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.626125 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.625901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.626881 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.626856 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.627035 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.627020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.627188 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.627171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:43.632778 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.632753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kk5\" (UniqueName: \"kubernetes.io/projected/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-kube-api-access-q2kk5\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:43.632879 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.632763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb6x5\" (UniqueName: \"kubernetes.io/projected/d6864066-a78c-4ada-8b91-0408ad00cead-kube-api-access-hb6x5\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:43.632879 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:43.632812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxvj\" (UniqueName: \"kubernetes.io/projected/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-api-access-8vxvj\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:44.129893 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.129856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:44.130105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.129916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:44.130105 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.129941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:44.132423 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.132394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6864066-a78c-4ada-8b91-0408ad00cead-node-exporter-tls\") pod \"node-exporter-d7zzl\" (UID: \"d6864066-a78c-4ada-8b91-0408ad00cead\") " pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:44.132586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.132563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/821f0dfb-db8d-43db-a135-f6eb76cc83e9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-lcblm\" (UID: \"821f0dfb-db8d-43db-a135-f6eb76cc83e9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:44.132586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.132562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c399c9-e0c9-4e20-aeb5-08eb3a429a93-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-7pnx5\" (UID: \"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:44.358431 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.358394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" Jun 11 21:46:44.368692 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.368663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" Jun 11 21:46:44.380897 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.380836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7zzl" Jun 11 21:46:44.393234 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:44.393207 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6864066_a78c_4ada_8b91_0408ad00cead.slice/crio-af57247157cf91b8bb503f401114ef539eb5966456126e7607d8d69ea28249b9 WatchSource:0}: Error finding container af57247157cf91b8bb503f401114ef539eb5966456126e7607d8d69ea28249b9: Status 404 returned error can't find the container with id af57247157cf91b8bb503f401114ef539eb5966456126e7607d8d69ea28249b9 Jun 11 21:46:44.514465 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.511601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5"] Jun 11 21:46:44.517116 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:44.517087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c399c9_e0c9_4e20_aeb5_08eb3a429a93.slice/crio-6b67a9ff3a1a082e44ec864706992e42d24b1b549ae190257a80c3a500f4a1da WatchSource:0}: Error finding container 6b67a9ff3a1a082e44ec864706992e42d24b1b549ae190257a80c3a500f4a1da: Status 404 returned error can't find the container with id 6b67a9ff3a1a082e44ec864706992e42d24b1b549ae190257a80c3a500f4a1da Jun 11 21:46:44.530515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.530490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-lcblm"] Jun 11 21:46:44.532873 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:44.532798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821f0dfb_db8d_43db_a135_f6eb76cc83e9.slice/crio-40f681cd41e7fba9c623ba5a52a61d4d4b2181099927c003e805e29518b3d154 WatchSource:0}: Error finding container 40f681cd41e7fba9c623ba5a52a61d4d4b2181099927c003e805e29518b3d154: Status 404 returned error can't find the container with id 40f681cd41e7fba9c623ba5a52a61d4d4b2181099927c003e805e29518b3d154 Jun 11 21:46:44.836595 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.836555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7zzl" event={"ID":"d6864066-a78c-4ada-8b91-0408ad00cead","Type":"ContainerStarted","Data":"af57247157cf91b8bb503f401114ef539eb5966456126e7607d8d69ea28249b9"} Jun 11 21:46:44.838463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.838437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" event={"ID":"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93","Type":"ContainerStarted","Data":"c75fbc85b51ebc46eb60c563d0d57362b94672beb79f123902bc6a561cc27123"} Jun 11 21:46:44.838599 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.838502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" event={"ID":"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93","Type":"ContainerStarted","Data":"711495b1c6f25f974cd613e976dfde55b92a70cb0417bfebf54f85b734dac749"} Jun 11 21:46:44.838599 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.838534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" event={"ID":"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93","Type":"ContainerStarted","Data":"6b67a9ff3a1a082e44ec864706992e42d24b1b549ae190257a80c3a500f4a1da"} Jun 11 21:46:44.839529 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.839508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" event={"ID":"821f0dfb-db8d-43db-a135-f6eb76cc83e9","Type":"ContainerStarted","Data":"40f681cd41e7fba9c623ba5a52a61d4d4b2181099927c003e805e29518b3d154"} Jun 11 21:46:44.938947 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.938842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:46:44.941214 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:44.941187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964496b6-1b92-4c4d-91db-bb37d54d379b-metrics-certs\") pod \"network-metrics-daemon-c99vr\" (UID: \"964496b6-1b92-4c4d-91db-bb37d54d379b\") " pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:46:45.049730 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:45.049696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrlsh\"" Jun 11 21:46:45.057790 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:45.057750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c99vr" Jun 11 21:46:45.233193 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:45.233162 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c99vr"] Jun 11 21:46:45.237899 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:45.237397 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964496b6_1b92_4c4d_91db_bb37d54d379b.slice/crio-aaf3e6f690229bce1baa4dd350cee41ef86cfc7a2552b9af43dcedcf00338e59 WatchSource:0}: Error finding container aaf3e6f690229bce1baa4dd350cee41ef86cfc7a2552b9af43dcedcf00338e59: Status 404 returned error can't find the container with id aaf3e6f690229bce1baa4dd350cee41ef86cfc7a2552b9af43dcedcf00338e59 Jun 11 21:46:45.844573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:45.844540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c99vr" event={"ID":"964496b6-1b92-4c4d-91db-bb37d54d379b","Type":"ContainerStarted","Data":"aaf3e6f690229bce1baa4dd350cee41ef86cfc7a2552b9af43dcedcf00338e59"} Jun 11 21:46:46.853745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.850339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" event={"ID":"821f0dfb-db8d-43db-a135-f6eb76cc83e9","Type":"ContainerStarted","Data":"4d019b68388ea83c5a9d198a8454348440e56fd5483d65a6df2344adc8a8aa73"} Jun 11 21:46:46.853745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.850410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" event={"ID":"821f0dfb-db8d-43db-a135-f6eb76cc83e9","Type":"ContainerStarted","Data":"252842b088d6c76ad14d7217413dc38a67dc824af4f6b84b8ae319ca263f3eb4"} Jun 11 21:46:46.853745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.850439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" event={"ID":"821f0dfb-db8d-43db-a135-f6eb76cc83e9","Type":"ContainerStarted","Data":"96eccd531e3435f5458ac56b147e3cf89be14215959d29336a919f58bca489d1"} Jun 11 21:46:46.855544 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.855515 2577 generic.go:356] "Generic (PLEG): container finished" podID="d6864066-a78c-4ada-8b91-0408ad00cead" containerID="a86388da2f798c64a24437ae89b4f79364df786bfb7ba4a7a64da0947f4ae891" exitCode=0 Jun 11 21:46:46.855693 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.855617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7zzl" event={"ID":"d6864066-a78c-4ada-8b91-0408ad00cead","Type":"ContainerDied","Data":"a86388da2f798c64a24437ae89b4f79364df786bfb7ba4a7a64da0947f4ae891"} Jun 11 21:46:46.858193 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.858168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" event={"ID":"b6c399c9-e0c9-4e20-aeb5-08eb3a429a93","Type":"ContainerStarted","Data":"412dba51f47d874ab115137ad2634a4a62fcafe6e09f1f5b3e5ed07323227ca0"} Jun 11 21:46:46.872477 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.872425 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-lcblm" podStartSLOduration=2.17660847 podStartE2EDuration="3.87240755s" totalImagesPullingTime="1.69579908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:46.871231603 +0000 UTC m=+254.215456739" watchObservedRunningTime="2026-06-11 21:46:46.87240755 +0000 UTC m=+254.216632641" Jun 11 21:46:46.888954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:46.888901 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-7pnx5" podStartSLOduration=2.305335974 podStartE2EDuration="3.888880013s" totalImagesPullingTime="1.583544039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:46.887265046 +0000 UTC m=+254.231490179" watchObservedRunningTime="2026-06-11 21:46:46.888880013 +0000 UTC m=+254.233105107" Jun 11 21:46:47.765421 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.765388 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65454dd745-czktk"] Jun 11 21:46:47.768582 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.768566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.771032 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.771007 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5mpbp\"" Jun 11 21:46:47.771175 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.771042 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 21:46:47.771994 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.771979 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 21:46:47.772078 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.772030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 21:46:47.772078 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.772066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8tt5sels19qqc\"" Jun 11 21:46:47.772148 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.772129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 21:46:47.777870 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.777845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65454dd745-czktk"] Jun 11 21:46:47.864006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.863969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c99vr" event={"ID":"964496b6-1b92-4c4d-91db-bb37d54d379b","Type":"ContainerStarted","Data":"20e94ca9271e9a083a38cf5ad4edb8f15224ed303bb7fcecf9fefd501f7b928e"} Jun 11 21:46:47.864502 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c99vr" event={"ID":"964496b6-1b92-4c4d-91db-bb37d54d379b","Type":"ContainerStarted","Data":"d5424b9eefc1b4c64f601e8a89807488c02f066170f3f387f2fe0c5eedecb0b4"} Jun 11 21:46:47.864559 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-tls\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864559 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-metrics-server-audit-profiles\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864656 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-client-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864656 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864764 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/16d9a130-6079-4c4c-8cec-d3d480f3b52a-audit-log\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864812 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-client-certs\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.864846 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.864827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrxl\" (UniqueName: \"kubernetes.io/projected/16d9a130-6079-4c4c-8cec-d3d480f3b52a-kube-api-access-nlrxl\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.866098 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.866072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7zzl" event={"ID":"d6864066-a78c-4ada-8b91-0408ad00cead","Type":"ContainerStarted","Data":"1233dd8071fa3c9f2b6d3a0e4635e44a1524f3ca015769842572696e7e735fb5"} Jun 11 21:46:47.866201 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.866123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7zzl" event={"ID":"d6864066-a78c-4ada-8b91-0408ad00cead","Type":"ContainerStarted","Data":"1a16fdc712e54b1927c7539fd71b414725db4f06eddaa6d1e305d5c373974d93"} Jun 11 21:46:47.879825 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.879777 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c99vr" podStartSLOduration=253.347175474 podStartE2EDuration="4m14.879760722s" totalImagesPullingTime="1.532585248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:47.877980476 +0000 UTC m=+255.222205568" watchObservedRunningTime="2026-06-11 21:46:47.879760722 +0000 UTC m=+255.223985814" Jun 11 21:46:47.895374 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.895310 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d7zzl" podStartSLOduration=2.9752310189999998 podStartE2EDuration="4.895266104s" totalImagesPullingTime="1.832645133s" totalInitContainerRuntime="87.389952ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:47.893956396 +0000 UTC m=+255.238181511" watchObservedRunningTime="2026-06-11 21:46:47.895266104 +0000 UTC m=+255.239491196" Jun 11 21:46:47.965195 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-client-certs\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.965408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrxl\" (UniqueName: \"kubernetes.io/projected/16d9a130-6079-4c4c-8cec-d3d480f3b52a-kube-api-access-nlrxl\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.965472 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-tls\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.965472 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-metrics-server-audit-profiles\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.965814 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-client-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.965997 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.965978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.966422 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.966397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/16d9a130-6079-4c4c-8cec-d3d480f3b52a-audit-log\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.966649 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.966620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-metrics-server-audit-profiles\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.966763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.966743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/16d9a130-6079-4c4c-8cec-d3d480f3b52a-audit-log\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.966837 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.966814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16d9a130-6079-4c4c-8cec-d3d480f3b52a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.968121 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.968095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-tls\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.968433 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.968415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-client-ca-bundle\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.968491 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.968448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/16d9a130-6079-4c4c-8cec-d3d480f3b52a-secret-metrics-server-client-certs\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:47.974648 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:47.974627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrxl\" (UniqueName: \"kubernetes.io/projected/16d9a130-6079-4c4c-8cec-d3d480f3b52a-kube-api-access-nlrxl\") pod \"metrics-server-65454dd745-czktk\" (UID: \"16d9a130-6079-4c4c-8cec-d3d480f3b52a\") " pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:48.079677 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:48.079588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:46:48.207004 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:48.206952 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65454dd745-czktk"] Jun 11 21:46:48.210824 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:48.210796 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d9a130_6079_4c4c_8cec_d3d480f3b52a.slice/crio-91a7c1ed028ac812e4f8fd6397d96d8356e0193965f1329b9eeaf564b790342a WatchSource:0}: Error finding container 91a7c1ed028ac812e4f8fd6397d96d8356e0193965f1329b9eeaf564b790342a: Status 404 returned error can't find the container with id 91a7c1ed028ac812e4f8fd6397d96d8356e0193965f1329b9eeaf564b790342a Jun 11 21:46:48.870857 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:48.870804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65454dd745-czktk" event={"ID":"16d9a130-6079-4c4c-8cec-d3d480f3b52a","Type":"ContainerStarted","Data":"91a7c1ed028ac812e4f8fd6397d96d8356e0193965f1329b9eeaf564b790342a"} Jun 11 21:46:49.875491 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:49.875458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65454dd745-czktk" event={"ID":"16d9a130-6079-4c4c-8cec-d3d480f3b52a","Type":"ContainerStarted","Data":"6bf899fc1e7aadc1d0dffae2fc690a66543118b6f7f89c9b05f0df9ca2664fd8"} Jun 11 21:46:49.893581 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:49.893473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65454dd745-czktk" podStartSLOduration=1.465427448 podStartE2EDuration="2.893455139s" totalImagesPullingTime="1.428027691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:49.891519159 +0000 UTC m=+257.235744264" watchObservedRunningTime="2026-06-11 21:46:49.893455139 +0000 UTC m=+257.237680293" Jun 11 21:46:52.115811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.115770 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:46:52.119269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.119247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.121759 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.121730 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 21:46:52.121885 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.121813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 21:46:52.123011 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.122989 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 21:46:52.123011 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.123002 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 21:46:52.123174 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.123054 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 21:46:52.123174 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.123048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xbnws\"" Jun 11 21:46:52.123174 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.123107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 21:46:52.123396 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.123260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 21:46:52.127166 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.127146 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 21:46:52.129620 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.129595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:46:52.203029 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.202991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203029 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rx2\" (UniqueName: \"kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.203251 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.203222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rx2\" (UniqueName: \"kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.304414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.305002 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.304977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.305127 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.305108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.305219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.305195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.305303 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.305218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.306808 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.306784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.307215 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.307198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.312102 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.312065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rx2\" (UniqueName: \"kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2\") pod \"console-54f9b76885-h4frb\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.429062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.428979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:46:52.561252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.561225 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:46:52.563758 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:46:52.563725 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c07172_3e60_4176_8a95_fd0d7abb0081.slice/crio-84a33fd1dc4bb2858c9136b51f5e9e17c34784541b2a4b1bd3cd5b20b209aa77 WatchSource:0}: Error finding container 84a33fd1dc4bb2858c9136b51f5e9e17c34784541b2a4b1bd3cd5b20b209aa77: Status 404 returned error can't find the container with id 84a33fd1dc4bb2858c9136b51f5e9e17c34784541b2a4b1bd3cd5b20b209aa77 Jun 11 21:46:52.887571 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:52.887534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9b76885-h4frb" event={"ID":"79c07172-3e60-4176-8a95-fd0d7abb0081","Type":"ContainerStarted","Data":"84a33fd1dc4bb2858c9136b51f5e9e17c34784541b2a4b1bd3cd5b20b209aa77"} Jun 11 21:46:55.900914 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:55.900873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9b76885-h4frb" event={"ID":"79c07172-3e60-4176-8a95-fd0d7abb0081","Type":"ContainerStarted","Data":"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71"} Jun 11 21:46:55.918117 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:46:55.918068 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f9b76885-h4frb" podStartSLOduration=1.231532838 podStartE2EDuration="3.918049726s" totalImagesPullingTime="2.686516888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:55.916843395 +0000 UTC m=+263.261068520" watchObservedRunningTime="2026-06-11 21:46:55.918049726 +0000 UTC m=+263.262274886" Jun 11 21:47:02.429584 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:02.429529 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:47:02.429986 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:02.429609 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:47:02.431060 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:02.431036 2577 patch_prober.go:28] interesting pod/console-54f9b76885-h4frb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 21:47:02.431115 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:02.431094 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54f9b76885-h4frb" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 21:47:08.080237 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:08.080202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:47:08.080628 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:08.080266 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:47:12.429875 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:12.429840 2577 patch_prober.go:28] interesting pod/console-54f9b76885-h4frb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 21:47:12.430477 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:12.429914 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54f9b76885-h4frb" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 21:47:17.549336 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:47:17.549264 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" Jun 11 21:47:17.549336 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:47:17.549264 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vmzgt" podUID="d6f082b2-cb1f-42a0-b672-cca04700b7a4" Jun 11 21:47:17.979549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:17.979513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:17.979549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:17.979546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:21.547553 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.547515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:21.547553 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.547565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:21.550070 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.550031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6f082b2-cb1f-42a0-b672-cca04700b7a4-metrics-tls\") pod \"dns-default-vmzgt\" (UID: \"d6f082b2-cb1f-42a0-b672-cca04700b7a4\") " pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:21.550187 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.550143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"image-registry-6547485f57-h4j6n\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:21.585135 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.585103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2qw2b\"" Jun 11 21:47:21.585313 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.585104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td5zs\"" Jun 11 21:47:21.590365 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.590344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:21.590463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.590381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:21.748217 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.748181 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:47:21.751394 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:47:21.751362 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca48a26_4139_4513_b0e8_7f20be8e567f.slice/crio-6f6cd95011f927146df9a637a7ef1c4aac50b8e6a7b132e2233f8b88ff0bed4b WatchSource:0}: Error finding container 6f6cd95011f927146df9a637a7ef1c4aac50b8e6a7b132e2233f8b88ff0bed4b: Status 404 returned error can't find the container with id 6f6cd95011f927146df9a637a7ef1c4aac50b8e6a7b132e2233f8b88ff0bed4b Jun 11 21:47:21.759140 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.759114 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vmzgt"] Jun 11 21:47:21.764045 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:47:21.764009 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f082b2_cb1f_42a0_b672_cca04700b7a4.slice/crio-24684732824a68804658272feb1790c14e9e0ef34b5989bb2179dae9dc76478f WatchSource:0}: Error finding container 24684732824a68804658272feb1790c14e9e0ef34b5989bb2179dae9dc76478f: Status 404 returned error can't find the container with id 24684732824a68804658272feb1790c14e9e0ef34b5989bb2179dae9dc76478f Jun 11 21:47:21.995855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.995805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" event={"ID":"dca48a26-4139-4513-b0e8-7f20be8e567f","Type":"ContainerStarted","Data":"fd5f46033a0f583a537cacc03260c1720ce7d683fa4c7e27a8b7e601db477589"} Jun 11 21:47:21.996224 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.995876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" event={"ID":"dca48a26-4139-4513-b0e8-7f20be8e567f","Type":"ContainerStarted","Data":"6f6cd95011f927146df9a637a7ef1c4aac50b8e6a7b132e2233f8b88ff0bed4b"} Jun 11 21:47:21.996224 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.996030 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:21.997173 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:21.997143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmzgt" event={"ID":"d6f082b2-cb1f-42a0-b672-cca04700b7a4","Type":"ContainerStarted","Data":"24684732824a68804658272feb1790c14e9e0ef34b5989bb2179dae9dc76478f"} Jun 11 21:47:22.430368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:22.430328 2577 patch_prober.go:28] interesting pod/console-54f9b76885-h4frb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 21:47:22.430532 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:22.430394 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54f9b76885-h4frb" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 21:47:24.006576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.006484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmzgt" event={"ID":"d6f082b2-cb1f-42a0-b672-cca04700b7a4","Type":"ContainerStarted","Data":"a3c4e345338c3ee7903c5ac1916d875f60f6af23a2c28860ba5ed4008dd5e769"} Jun 11 21:47:24.006576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.006569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmzgt" event={"ID":"d6f082b2-cb1f-42a0-b672-cca04700b7a4","Type":"ContainerStarted","Data":"fd997c088251221b070b82ba551ef58efc1c99a9e6f2c741981083f6b5dbf206"} Jun 11 21:47:24.006969 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.006634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:24.022754 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.022692 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vmzgt" podStartSLOduration=251.115247398 podStartE2EDuration="4m13.022671978s" totalImagesPullingTime="1.90742458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:24.022007099 +0000 UTC m=+291.366232192" watchObservedRunningTime="2026-06-11 21:47:24.022671978 +0000 UTC m=+291.366897094" Jun 11 21:47:24.023385 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.023351 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" podStartSLOduration=291.023341679 podStartE2EDuration="4m51.023341679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:22.016714983 +0000 UTC m=+289.360940099" watchObservedRunningTime="2026-06-11 21:47:24.023341679 +0000 UTC m=+291.367566771" Jun 11 21:47:24.462573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.462541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-fw4lt_348a1396-20d4-4189-9a92-bcc70b6ce8ba/cluster-monitoring-operator/0.log" Jun 11 21:47:24.660311 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.660228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-state-metrics/0.log" Jun 11 21:47:24.860130 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:24.860100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-rbac-proxy-main/0.log" Jun 11 21:47:25.059828 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:25.059781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-rbac-proxy-self/0.log" Jun 11 21:47:25.260402 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:25.260324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65454dd745-czktk_16d9a130-6079-4c4c-8cec-d3d480f3b52a/metrics-server/0.log" Jun 11 21:47:26.859716 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:26.859690 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/init-textfile/0.log" Jun 11 21:47:27.061225 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:27.061194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/node-exporter/0.log" Jun 11 21:47:27.260134 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:27.260053 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/kube-rbac-proxy/0.log" Jun 11 21:47:27.459906 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:27.459863 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/kube-rbac-proxy-main/0.log" Jun 11 21:47:27.661116 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:27.661086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/kube-rbac-proxy-self/0.log" Jun 11 21:47:27.860549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:27.860519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/openshift-state-metrics/0.log" Jun 11 21:47:28.085396 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:28.085320 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:47:28.089170 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:28.089146 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65454dd745-czktk" Jun 11 21:47:29.860184 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:29.860153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rpc5c_614aa11d-868a-41d7-aeb0-96327af7899b/prometheus-operator-admission-webhook/0.log" Jun 11 21:47:31.861156 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:31.861125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54f9b76885-h4frb_79c07172-3e60-4176-8a95-fd0d7abb0081/console/0.log" Jun 11 21:47:32.429852 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:32.429810 2577 patch_prober.go:28] interesting pod/console-54f9b76885-h4frb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 21:47:32.430056 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:32.429879 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54f9b76885-h4frb" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 21:47:33.010754 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:33.010728 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:47:33.261064 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:33.260981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmzgt_d6f082b2-cb1f-42a0-b672-cca04700b7a4/dns/0.log" Jun 11 21:47:33.460352 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:33.460320 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmzgt_d6f082b2-cb1f-42a0-b672-cca04700b7a4/kube-rbac-proxy/0.log" Jun 11 21:47:33.860438 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:33.860409 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzh96_ef36db73-b675-4e46-ac28-8ca17deb634f/dns-node-resolver/0.log" Jun 11 21:47:34.012595 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:34.012562 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vmzgt" Jun 11 21:47:34.261101 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:34.261016 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6547485f57-h4j6n_dca48a26-4139-4513-b0e8-7f20be8e567f/registry/0.log" Jun 11 21:47:35.060437 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:35.060408 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjj4n_9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed/node-ca/0.log" Jun 11 21:47:35.660067 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:35.660031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m975x_3784790e-e24d-498d-9418-bd0aec3373e9/serve-healthcheck-canary/0.log" Jun 11 21:47:41.595345 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:41.595306 2577 patch_prober.go:28] interesting pod/image-registry-6547485f57-h4j6n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:47:41.595720 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:41.595384 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:47:42.433659 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:42.433625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:47:42.437531 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:42.437502 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:47:43.006115 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:43.006083 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:47:44.092605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:44.092512 2577 generic.go:356] "Generic (PLEG): container finished" podID="70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3" containerID="6bafc9bca02b0f60a4d878cf847d292a9876f005e5ff8d44e765c306a6992eff" exitCode=0 Jun 11 21:47:44.092605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:44.092592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" event={"ID":"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3","Type":"ContainerDied","Data":"6bafc9bca02b0f60a4d878cf847d292a9876f005e5ff8d44e765c306a6992eff"} Jun 11 21:47:44.093020 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:44.092923 2577 scope.go:117] "RemoveContainer" containerID="6bafc9bca02b0f60a4d878cf847d292a9876f005e5ff8d44e765c306a6992eff" Jun 11 21:47:45.098172 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:47:45.098137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-nfczh" event={"ID":"70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3","Type":"ContainerStarted","Data":"d6ca5cca64463ea9fee8f3179d133638ec1f6a94ebfab7023bebb7b8fa2d6cc2"} Jun 11 21:48:05.025046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:05.025005 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:48:11.743786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.743747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:48:11.748739 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.748715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.759172 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.759146 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:48:11.766310 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.766598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.766539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phq7c\" (UniqueName: \"kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867054 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867235 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867235 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867235 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867235 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phq7c\" (UniqueName: \"kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867824 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867941 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.867941 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.867906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.868426 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.868407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.869810 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.869788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.869888 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.869815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:11.876725 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:11.876699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phq7c\" (UniqueName: \"kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c\") pod \"console-6d98489b9c-ck8wq\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:12.059732 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:12.059647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:12.187759 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:12.187735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:48:12.190337 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:48:12.190306 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e70811_02ce_4bc9_80f9_3174c4ef0d0d.slice/crio-2b467816775a49937a8e7fce2f68739eb0798082ee4ff6578e4b2bc598198c6c WatchSource:0}: Error finding container 2b467816775a49937a8e7fce2f68739eb0798082ee4ff6578e4b2bc598198c6c: Status 404 returned error can't find the container with id 2b467816775a49937a8e7fce2f68739eb0798082ee4ff6578e4b2bc598198c6c Jun 11 21:48:12.199496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:12.199459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98489b9c-ck8wq" event={"ID":"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d","Type":"ContainerStarted","Data":"2b467816775a49937a8e7fce2f68739eb0798082ee4ff6578e4b2bc598198c6c"} Jun 11 21:48:13.204501 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:13.204462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98489b9c-ck8wq" event={"ID":"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d","Type":"ContainerStarted","Data":"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba"} Jun 11 21:48:13.225009 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:13.224952 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d98489b9c-ck8wq" podStartSLOduration=2.224936018 podStartE2EDuration="2.224936018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:48:13.222706107 +0000 UTC m=+340.566931224" watchObservedRunningTime="2026-06-11 21:48:13.224936018 +0000 UTC m=+340.569161104" Jun 11 21:48:22.060361 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:22.060302 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:22.060789 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:22.060393 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:22.065696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:22.065666 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:22.242353 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:22.242318 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:48:22.283825 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:22.283782 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:48:30.045183 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.045133 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerName="registry" containerID="cri-o://fd5f46033a0f583a537cacc03260c1720ce7d683fa4c7e27a8b7e601db477589" gracePeriod=30 Jun 11 21:48:30.278038 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.278007 2577 generic.go:356] "Generic (PLEG): container finished" podID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerID="fd5f46033a0f583a537cacc03260c1720ce7d683fa4c7e27a8b7e601db477589" exitCode=0 Jun 11 21:48:30.278124 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.278089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" event={"ID":"dca48a26-4139-4513-b0e8-7f20be8e567f","Type":"ContainerDied","Data":"fd5f46033a0f583a537cacc03260c1720ce7d683fa4c7e27a8b7e601db477589"} Jun 11 21:48:30.293141 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.293116 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:48:30.419711 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419676 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419725 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419754 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rrc2\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419779 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419828 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.419916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419898 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.420232 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.419944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token\") pod \"dca48a26-4139-4513-b0e8-7f20be8e567f\" (UID: \"dca48a26-4139-4513-b0e8-7f20be8e567f\") " Jun 11 21:48:30.420438 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.420403 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:30.420757 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.420729 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:30.422590 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.422562 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:30.422710 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.422589 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2" (OuterVolumeSpecName: "kube-api-access-4rrc2") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "kube-api-access-4rrc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:30.422710 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.422568 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:30.422823 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.422786 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:30.423007 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.422985 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:30.429040 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.429007 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dca48a26-4139-4513-b0e8-7f20be8e567f" (UID: "dca48a26-4139-4513-b0e8-7f20be8e567f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:48:30.521435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521385 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-tls\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521427 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-bound-sa-token\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521437 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dca48a26-4139-4513-b0e8-7f20be8e567f-ca-trust-extracted\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521447 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-installation-pull-secrets\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521456 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rrc2\" (UniqueName: \"kubernetes.io/projected/dca48a26-4139-4513-b0e8-7f20be8e567f-kube-api-access-4rrc2\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521727 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521465 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-registry-certificates\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521727 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521475 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dca48a26-4139-4513-b0e8-7f20be8e567f-image-registry-private-configuration\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:30.521727 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:30.521484 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dca48a26-4139-4513-b0e8-7f20be8e567f-trusted-ca\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:31.283707 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:31.283677 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" Jun 11 21:48:31.284155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:31.283673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6547485f57-h4j6n" event={"ID":"dca48a26-4139-4513-b0e8-7f20be8e567f","Type":"ContainerDied","Data":"6f6cd95011f927146df9a637a7ef1c4aac50b8e6a7b132e2233f8b88ff0bed4b"} Jun 11 21:48:31.284155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:31.283815 2577 scope.go:117] "RemoveContainer" containerID="fd5f46033a0f583a537cacc03260c1720ce7d683fa4c7e27a8b7e601db477589" Jun 11 21:48:31.301632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:31.301604 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:48:31.304509 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:31.304485 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6547485f57-h4j6n"] Jun 11 21:48:33.051165 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:33.051131 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" path="/var/lib/kubelet/pods/dca48a26-4139-4513-b0e8-7f20be8e567f/volumes" Jun 11 21:48:47.305751 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.305688 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f9b76885-h4frb" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" containerID="cri-o://6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71" gracePeriod=15 Jun 11 21:48:47.563701 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.563630 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:48:47.659465 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659430 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659465 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659466 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659530 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659562 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659607 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82rx2\" (UniqueName: \"kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659631 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert\") pod \"79c07172-3e60-4176-8a95-fd0d7abb0081\" (UID: \"79c07172-3e60-4176-8a95-fd0d7abb0081\") " Jun 11 21:48:47.659925 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.659895 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca" (OuterVolumeSpecName: "service-ca") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:47.660059 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.660031 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config" (OuterVolumeSpecName: "console-config") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:47.660178 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.660147 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:47.660223 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.660184 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:47.661913 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.661885 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2" (OuterVolumeSpecName: "kube-api-access-82rx2") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "kube-api-access-82rx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:47.662121 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.662095 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:47.662207 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.662116 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79c07172-3e60-4176-8a95-fd0d7abb0081" (UID: "79c07172-3e60-4176-8a95-fd0d7abb0081"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:47.760406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760365 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82rx2\" (UniqueName: \"kubernetes.io/projected/79c07172-3e60-4176-8a95-fd0d7abb0081-kube-api-access-82rx2\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760396 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-oauth-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760407 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-service-ca\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760415 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760666 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760423 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-console-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760666 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760431 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c07172-3e60-4176-8a95-fd0d7abb0081-console-oauth-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:47.760666 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:47.760439 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c07172-3e60-4176-8a95-fd0d7abb0081-trusted-ca-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:48:48.350809 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.350777 2577 generic.go:356] "Generic (PLEG): container finished" podID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerID="6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71" exitCode=0 Jun 11 21:48:48.351228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.350825 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9b76885-h4frb" Jun 11 21:48:48.351228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.350833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9b76885-h4frb" event={"ID":"79c07172-3e60-4176-8a95-fd0d7abb0081","Type":"ContainerDied","Data":"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71"} Jun 11 21:48:48.351228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.350872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9b76885-h4frb" event={"ID":"79c07172-3e60-4176-8a95-fd0d7abb0081","Type":"ContainerDied","Data":"84a33fd1dc4bb2858c9136b51f5e9e17c34784541b2a4b1bd3cd5b20b209aa77"} Jun 11 21:48:48.351228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.350890 2577 scope.go:117] "RemoveContainer" containerID="6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71" Jun 11 21:48:48.359674 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.359654 2577 scope.go:117] "RemoveContainer" containerID="6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71" Jun 11 21:48:48.360002 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:48:48.359975 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71\": container with ID starting with 6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71 not found: ID does not exist" containerID="6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71" Jun 11 21:48:48.360096 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.360009 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71"} err="failed to get container status \"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71\": rpc error: code = NotFound desc = could not find container \"6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71\": container with ID starting with 6c003150186816a95b55d95a7c99c2fa608c201965406a315e4f3db193deed71 not found: ID does not exist" Jun 11 21:48:48.370829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.370792 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:48:48.374448 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:48.374425 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f9b76885-h4frb"] Jun 11 21:48:49.051554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:48:49.051519 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" path="/var/lib/kubelet/pods/79c07172-3e60-4176-8a95-fd0d7abb0081/volumes" Jun 11 21:49:20.032609 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.032568 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.032986 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerName="registry" Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.033007 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerName="registry" Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.033030 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.033038 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.033131 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c07172-3e60-4176-8a95-fd0d7abb0081" containerName="console" Jun 11 21:49:20.033189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.033145 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca48a26-4139-4513-b0e8-7f20be8e567f" containerName="registry" Jun 11 21:49:20.036063 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.036040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.047425 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.047400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:49:20.110728 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.110728 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.110954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.110954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.110954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.110954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqsp\" (UniqueName: \"kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.111101 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.110973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.211598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.211598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.211855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.211855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.211855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.211908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqsp\" (UniqueName: \"kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212439 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.212408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212562 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.212488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212610 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.212573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.212645 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.212621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.214339 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.214308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.214443 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.214423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.219127 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.219101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqsp\" (UniqueName: \"kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp\") pod \"console-798f55fdb9-krr5h\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.345385 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.345259 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:20.474051 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:20.474025 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:49:20.476632 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:49:20.476608 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa24895_463e_4666_a5ae_f64c6769e031.slice/crio-86031c7097fdedfb2ea155b5d5ac1cc0d7fb97c1e12b11f6206f42ccf03a4f75 WatchSource:0}: Error finding container 86031c7097fdedfb2ea155b5d5ac1cc0d7fb97c1e12b11f6206f42ccf03a4f75: Status 404 returned error can't find the container with id 86031c7097fdedfb2ea155b5d5ac1cc0d7fb97c1e12b11f6206f42ccf03a4f75 Jun 11 21:49:21.484398 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:21.484366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f55fdb9-krr5h" event={"ID":"2fa24895-463e-4666-a5ae-f64c6769e031","Type":"ContainerStarted","Data":"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94"} Jun 11 21:49:21.484784 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:21.484410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f55fdb9-krr5h" event={"ID":"2fa24895-463e-4666-a5ae-f64c6769e031","Type":"ContainerStarted","Data":"86031c7097fdedfb2ea155b5d5ac1cc0d7fb97c1e12b11f6206f42ccf03a4f75"} Jun 11 21:49:21.501320 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:21.501256 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798f55fdb9-krr5h" podStartSLOduration=1.501238568 podStartE2EDuration="1.501238568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:49:21.500642671 +0000 UTC m=+408.844867790" watchObservedRunningTime="2026-06-11 21:49:21.501238568 +0000 UTC m=+408.845463661" Jun 11 21:49:30.346238 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:30.346180 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:30.346238 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:30.346255 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:30.351168 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:30.351145 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:30.522624 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:30.522588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:49:30.564895 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:30.564858 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:49:55.585328 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.585226 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d98489b9c-ck8wq" podUID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" containerName="console" containerID="cri-o://104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba" gracePeriod=15 Jun 11 21:49:55.820808 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.820785 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:49:55.899986 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.899952 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900152 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900000 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900152 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900041 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900152 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900076 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900152 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900103 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phq7c\" (UniqueName: \"kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900331 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900216 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900331 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900254 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config\") pod \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\" (UID: \"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d\") " Jun 11 21:49:55.900489 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config" (OuterVolumeSpecName: "console-config") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:49:55.900574 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900554 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:55.900690 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900581 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:49:55.900762 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900683 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:49:55.900762 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.900728 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:49:55.902520 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.902484 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:49:55.902616 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.902570 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:49:55.902677 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:55.902659 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c" (OuterVolumeSpecName: "kube-api-access-phq7c") pod "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" (UID: "a6e70811-02ce-4bc9-80f9-3174c4ef0d0d"). InnerVolumeSpecName "kube-api-access-phq7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:49:56.001093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001045 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-oauth-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.001093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001087 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.001093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001097 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phq7c\" (UniqueName: \"kubernetes.io/projected/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-kube-api-access-phq7c\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.001093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001106 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-trusted-ca-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.001093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001114 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-console-oauth-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.001426 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.001123 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d-service-ca\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:49:56.618014 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.617979 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" containerID="104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba" exitCode=0 Jun 11 21:49:56.618464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.618024 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98489b9c-ck8wq" Jun 11 21:49:56.618464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.618038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98489b9c-ck8wq" event={"ID":"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d","Type":"ContainerDied","Data":"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba"} Jun 11 21:49:56.618464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.618078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98489b9c-ck8wq" event={"ID":"a6e70811-02ce-4bc9-80f9-3174c4ef0d0d","Type":"ContainerDied","Data":"2b467816775a49937a8e7fce2f68739eb0798082ee4ff6578e4b2bc598198c6c"} Jun 11 21:49:56.618464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.618097 2577 scope.go:117] "RemoveContainer" containerID="104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba" Jun 11 21:49:56.626906 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.626886 2577 scope.go:117] "RemoveContainer" containerID="104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba" Jun 11 21:49:56.627145 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:49:56.627128 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba\": container with ID starting with 104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba not found: ID does not exist" containerID="104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba" Jun 11 21:49:56.627192 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.627152 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba"} err="failed to get container status \"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba\": rpc error: code = NotFound desc = could not find container \"104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba\": container with ID starting with 104ea7f2749bf77b78b23d070764db743580c4148d7bb10c3e637274157e65ba not found: ID does not exist" Jun 11 21:49:56.638275 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.638249 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:49:56.640186 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:56.640165 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d98489b9c-ck8wq"] Jun 11 21:49:57.051366 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:49:57.051260 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" path="/var/lib/kubelet/pods/a6e70811-02ce-4bc9-80f9-3174c4ef0d0d/volumes" Jun 11 21:50:01.668199 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.668164 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x"] Jun 11 21:50:01.668668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.668481 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" containerName="console" Jun 11 21:50:01.668668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.668495 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" containerName="console" Jun 11 21:50:01.668668 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.668541 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e70811-02ce-4bc9-80f9-3174c4ef0d0d" containerName="console" Jun 11 21:50:01.672859 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.672842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.675329 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.675311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:50:01.676248 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.676234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:50:01.676316 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.676247 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:50:01.685023 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.680427 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x"] Jun 11 21:50:01.846393 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.846352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bppfc\" (UniqueName: \"kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.846565 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.846401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.846565 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.846429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.947799 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.947710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bppfc\" (UniqueName: \"kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.947799 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.947757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.947799 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.947783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.948195 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.948171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.948195 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.948189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.956600 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.956578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bppfc\" (UniqueName: \"kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:01.987190 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:01.987152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:02.117250 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:02.117220 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x"] Jun 11 21:50:02.120034 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:02.120008 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbd3725_058a_4ebe_8b07_172851afff54.slice/crio-27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b WatchSource:0}: Error finding container 27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b: Status 404 returned error can't find the container with id 27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b Jun 11 21:50:02.122122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:02.122101 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:50:02.643769 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:02.643729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerStarted","Data":"27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b"} Jun 11 21:50:07.668766 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:07.667918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerStarted","Data":"a06180e5e71790105cb9ceef09777a5994c5e90713cf9f7fea9ef67ab17dfac4"} Jun 11 21:50:08.673751 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:08.673718 2577 generic.go:356] "Generic (PLEG): container finished" podID="adbd3725-058a-4ebe-8b07-172851afff54" containerID="a06180e5e71790105cb9ceef09777a5994c5e90713cf9f7fea9ef67ab17dfac4" exitCode=0 Jun 11 21:50:08.674120 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:08.673787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerDied","Data":"a06180e5e71790105cb9ceef09777a5994c5e90713cf9f7fea9ef67ab17dfac4"} Jun 11 21:50:11.689110 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:11.689076 2577 generic.go:356] "Generic (PLEG): container finished" podID="adbd3725-058a-4ebe-8b07-172851afff54" containerID="3011d065e7886c504d6d7fe4c0ace4e3f23bc238ea39b17db971bafe68ea87b8" exitCode=0 Jun 11 21:50:11.689520 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:11.689124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerDied","Data":"3011d065e7886c504d6d7fe4c0ace4e3f23bc238ea39b17db971bafe68ea87b8"} Jun 11 21:50:18.719352 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:18.719319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerStarted","Data":"e9ad31d4c01b0b1ab10d90cf3a6bc9693e83fe20386751daa09cdc2808d1893b"} Jun 11 21:50:18.736632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:18.736581 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" podStartSLOduration=3.064833476 podStartE2EDuration="17.736563307s" totalImagesPullingTime="14.671729831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:50:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:50:18.735215233 +0000 UTC m=+466.079440380" watchObservedRunningTime="2026-06-11 21:50:18.736563307 +0000 UTC m=+466.080788396" Jun 11 21:50:19.730124 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:19.730089 2577 generic.go:356] "Generic (PLEG): container finished" podID="adbd3725-058a-4ebe-8b07-172851afff54" containerID="e9ad31d4c01b0b1ab10d90cf3a6bc9693e83fe20386751daa09cdc2808d1893b" exitCode=0 Jun 11 21:50:19.730524 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:19.730133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerDied","Data":"e9ad31d4c01b0b1ab10d90cf3a6bc9693e83fe20386751daa09cdc2808d1893b"} Jun 11 21:50:20.867844 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.867815 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:20.900592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.900561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util\") pod \"adbd3725-058a-4ebe-8b07-172851afff54\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " Jun 11 21:50:20.900763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.900602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bppfc\" (UniqueName: \"kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc\") pod \"adbd3725-058a-4ebe-8b07-172851afff54\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " Jun 11 21:50:20.900763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.900643 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle\") pod \"adbd3725-058a-4ebe-8b07-172851afff54\" (UID: \"adbd3725-058a-4ebe-8b07-172851afff54\") " Jun 11 21:50:20.902916 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.902885 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc" (OuterVolumeSpecName: "kube-api-access-bppfc") pod "adbd3725-058a-4ebe-8b07-172851afff54" (UID: "adbd3725-058a-4ebe-8b07-172851afff54"). InnerVolumeSpecName "kube-api-access-bppfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:50:20.904999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.904977 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util" (OuterVolumeSpecName: "util") pod "adbd3725-058a-4ebe-8b07-172851afff54" (UID: "adbd3725-058a-4ebe-8b07-172851afff54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:20.911168 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:20.911145 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle" (OuterVolumeSpecName: "bundle") pod "adbd3725-058a-4ebe-8b07-172851afff54" (UID: "adbd3725-058a-4ebe-8b07-172851afff54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:21.001512 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.001429 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:21.001512 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.001460 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bppfc\" (UniqueName: \"kubernetes.io/projected/adbd3725-058a-4ebe-8b07-172851afff54-kube-api-access-bppfc\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:21.001512 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.001470 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adbd3725-058a-4ebe-8b07-172851afff54-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:21.739342 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.739305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" event={"ID":"adbd3725-058a-4ebe-8b07-172851afff54","Type":"ContainerDied","Data":"27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b"} Jun 11 21:50:21.739486 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.739362 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27e6d2c165154b5418daf2ee990764bc61a612887d880ce2ef88a5979532b73b" Jun 11 21:50:21.739486 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:21.739318 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7vw7x" Jun 11 21:50:24.389745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.389711 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx"] Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.389993 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="extract" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390005 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="extract" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390018 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="util" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390023 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="util" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390034 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="pull" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390040 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="pull" Jun 11 21:50:24.390169 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.390086 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="adbd3725-058a-4ebe-8b07-172851afff54" containerName="extract" Jun 11 21:50:24.391860 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.391844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.394754 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.394729 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 21:50:24.394867 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.394759 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:50:24.394867 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.394729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8rzw8\"" Jun 11 21:50:24.407156 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.407134 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx"] Jun 11 21:50:24.422719 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.422691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.422847 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.422722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tz7n\" (UniqueName: \"kubernetes.io/projected/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-kube-api-access-5tz7n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.523460 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.523417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.523637 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.523469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tz7n\" (UniqueName: \"kubernetes.io/projected/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-kube-api-access-5tz7n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.523823 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.523802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.538583 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.538549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tz7n\" (UniqueName: \"kubernetes.io/projected/629ec7ef-05a6-4e3d-a316-4eb13a8ba00a-kube-api-access-5tz7n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vc2dx\" (UID: \"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.701062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.700954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" Jun 11 21:50:24.829414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:24.829390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx"] Jun 11 21:50:24.831723 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:24.831700 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629ec7ef_05a6_4e3d_a316_4eb13a8ba00a.slice/crio-7e4de6d0d333ac76dc7e8a5bc7665085fa39026479e4ec7350fc16c04d543cb5 WatchSource:0}: Error finding container 7e4de6d0d333ac76dc7e8a5bc7665085fa39026479e4ec7350fc16c04d543cb5: Status 404 returned error can't find the container with id 7e4de6d0d333ac76dc7e8a5bc7665085fa39026479e4ec7350fc16c04d543cb5 Jun 11 21:50:25.757632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:25.757596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" event={"ID":"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a","Type":"ContainerStarted","Data":"7e4de6d0d333ac76dc7e8a5bc7665085fa39026479e4ec7350fc16c04d543cb5"} Jun 11 21:50:26.763575 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:26.763531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" event={"ID":"629ec7ef-05a6-4e3d-a316-4eb13a8ba00a","Type":"ContainerStarted","Data":"29714841bd3448c7efe96e48ddab59a4956a63c60ae646a4331dc18414eca0ea"} Jun 11 21:50:26.785817 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:26.785764 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vc2dx" podStartSLOduration=0.938955708 podStartE2EDuration="2.785746197s" totalImagesPullingTime="1.846790489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:50:26.783296751 +0000 UTC m=+474.127521836" watchObservedRunningTime="2026-06-11 21:50:26.785746197 +0000 UTC m=+474.129971288" Jun 11 21:50:28.050022 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.049983 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c"] Jun 11 21:50:28.052379 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.052352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.054720 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.054689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:50:28.054828 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.054735 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:50:28.055676 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.055657 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:50:28.063362 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.063342 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c"] Jun 11 21:50:28.152016 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.151979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.152185 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.152025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.152185 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.152060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcbqz\" (UniqueName: \"kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.252726 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.252689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.252726 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.252727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.252932 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.252797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcbqz\" (UniqueName: \"kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.253127 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.253105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.253220 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.253140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.260197 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.260169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcbqz\" (UniqueName: \"kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.361159 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.361123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:28.488061 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.488035 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c"] Jun 11 21:50:28.490330 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:28.490293 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5cbbe8_c6e1_4972_bb34_f0152250d2e5.slice/crio-a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa WatchSource:0}: Error finding container a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa: Status 404 returned error can't find the container with id a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa Jun 11 21:50:28.774157 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.774074 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerID="88432de23edffb6a743b1efb7f7ccfa482465cf61ddef85f3b1aeb535802ea15" exitCode=0 Jun 11 21:50:28.774324 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.774157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" event={"ID":"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5","Type":"ContainerDied","Data":"88432de23edffb6a743b1efb7f7ccfa482465cf61ddef85f3b1aeb535802ea15"} Jun 11 21:50:28.774324 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:28.774196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" event={"ID":"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5","Type":"ContainerStarted","Data":"a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa"} Jun 11 21:50:30.320139 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.320096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-26c8l"] Jun 11 21:50:30.322573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.322550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.325253 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.325223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 21:50:30.326219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.326193 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z9hrp\"" Jun 11 21:50:30.326356 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.326193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 21:50:30.332213 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.332186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-26c8l"] Jun 11 21:50:30.366001 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.365973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhglb\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-kube-api-access-bhglb\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.366151 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.366018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.467149 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.467110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhglb\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-kube-api-access-bhglb\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.467316 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.467177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.475303 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.475237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.475632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.475609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhglb\" (UniqueName: \"kubernetes.io/projected/fd79bec4-a96d-446e-9178-10f0e888cf2d-kube-api-access-bhglb\") pod \"cert-manager-webhook-7dc76cbb94-26c8l\" (UID: \"fd79bec4-a96d-446e-9178-10f0e888cf2d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.634147 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.634096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:30.777357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:30.777325 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-26c8l"] Jun 11 21:50:30.779874 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:30.779832 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd79bec4_a96d_446e_9178_10f0e888cf2d.slice/crio-9c0a03ab8b5ce0f8d32d611224c9bb7d31ace29494928c46546dc56307fff1e5 WatchSource:0}: Error finding container 9c0a03ab8b5ce0f8d32d611224c9bb7d31ace29494928c46546dc56307fff1e5: Status 404 returned error can't find the container with id 9c0a03ab8b5ce0f8d32d611224c9bb7d31ace29494928c46546dc56307fff1e5 Jun 11 21:50:31.790904 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:31.790866 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerID="1292d8467098fe6489d1fb653a7871261f7f05c71e5e6a61a0b2a9b20a8eec35" exitCode=0 Jun 11 21:50:31.791716 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:31.790985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" event={"ID":"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5","Type":"ContainerDied","Data":"1292d8467098fe6489d1fb653a7871261f7f05c71e5e6a61a0b2a9b20a8eec35"} Jun 11 21:50:31.792763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:31.792724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" event={"ID":"fd79bec4-a96d-446e-9178-10f0e888cf2d","Type":"ContainerStarted","Data":"9c0a03ab8b5ce0f8d32d611224c9bb7d31ace29494928c46546dc56307fff1e5"} Jun 11 21:50:32.799598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:32.799560 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerID="a43d64ae9507c12a19c883f9f2e777e3ab35b73179e5354431f4b362d14efb0d" exitCode=0 Jun 11 21:50:32.800048 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:32.799643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" event={"ID":"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5","Type":"ContainerDied","Data":"a43d64ae9507c12a19c883f9f2e777e3ab35b73179e5354431f4b362d14efb0d"} Jun 11 21:50:33.806209 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.806114 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" event={"ID":"fd79bec4-a96d-446e-9178-10f0e888cf2d","Type":"ContainerStarted","Data":"ce802f4d8932ff22f80752e594b2f474c2955a0cfe9946a4a25336e03e0c761b"} Jun 11 21:50:33.823588 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.823541 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" podStartSLOduration=1.068251358 podStartE2EDuration="3.823524356s" totalImagesPullingTime="2.755272998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:50:33.822407506 +0000 UTC m=+481.166632598" watchObservedRunningTime="2026-06-11 21:50:33.823524356 +0000 UTC m=+481.167749447" Jun 11 21:50:33.935303 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.935264 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:33.993749 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.993723 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util\") pod \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " Jun 11 21:50:33.993936 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.993784 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle\") pod \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " Jun 11 21:50:33.993936 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.993806 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcbqz\" (UniqueName: \"kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz\") pod \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\" (UID: \"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5\") " Jun 11 21:50:33.994150 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.994129 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle" (OuterVolumeSpecName: "bundle") pod "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" (UID: "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:33.995785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.995762 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz" (OuterVolumeSpecName: "kube-api-access-dcbqz") pod "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" (UID: "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5"). InnerVolumeSpecName "kube-api-access-dcbqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:50:33.998231 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:33.998194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util" (OuterVolumeSpecName: "util") pod "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" (UID: "8b5cbbe8-c6e1-4972-bb34-f0152250d2e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:34.094996 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.094899 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:34.094996 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.094940 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:34.094996 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.094953 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcbqz\" (UniqueName: \"kubernetes.io/projected/8b5cbbe8-c6e1-4972-bb34-f0152250d2e5-kube-api-access-dcbqz\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:34.812113 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.812077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" event={"ID":"8b5cbbe8-c6e1-4972-bb34-f0152250d2e5","Type":"ContainerDied","Data":"a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa"} Jun 11 21:50:34.812113 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.812105 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsn6c" Jun 11 21:50:34.812583 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.812153 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a04cd0012557a2833e96539d48758fa7a8276e01ca17027b91af9bf54ff4dbfa" Jun 11 21:50:34.812583 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:34.812192 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:35.213144 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213114 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8c76t"] Jun 11 21:50:35.213452 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213439 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="pull" Jun 11 21:50:35.213496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213454 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="pull" Jun 11 21:50:35.213496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213465 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="extract" Jun 11 21:50:35.213496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213470 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="extract" Jun 11 21:50:35.213496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213478 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="util" Jun 11 21:50:35.213496 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213484 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="util" Jun 11 21:50:35.213641 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.213528 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5cbbe8-c6e1-4972-bb34-f0152250d2e5" containerName="extract" Jun 11 21:50:35.217850 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.217830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.220226 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.220203 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f798k\"" Jun 11 21:50:35.226867 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.226839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8c76t"] Jun 11 21:50:35.303764 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.303716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.303764 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.303768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7jq\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-kube-api-access-sb7jq\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.405129 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.405094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.405129 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.405130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7jq\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-kube-api-access-sb7jq\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.412884 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.412858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.413055 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.413036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7jq\" (UniqueName: \"kubernetes.io/projected/677c4aaf-c0f9-4f91-8119-59f081d41752-kube-api-access-sb7jq\") pod \"cert-manager-cainjector-5d99449ffd-8c76t\" (UID: \"677c4aaf-c0f9-4f91-8119-59f081d41752\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.527818 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.527738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" Jun 11 21:50:35.656757 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.656734 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8c76t"] Jun 11 21:50:35.658920 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:35.658893 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod677c4aaf_c0f9_4f91_8119_59f081d41752.slice/crio-e939f8120e47856a6a48a5f3e6cac3aca0f6677005d2dc4f4816248b22468c29 WatchSource:0}: Error finding container e939f8120e47856a6a48a5f3e6cac3aca0f6677005d2dc4f4816248b22468c29: Status 404 returned error can't find the container with id e939f8120e47856a6a48a5f3e6cac3aca0f6677005d2dc4f4816248b22468c29 Jun 11 21:50:35.819086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.818985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" event={"ID":"677c4aaf-c0f9-4f91-8119-59f081d41752","Type":"ContainerStarted","Data":"155f814e8e99b3b33d4151077d46cf57b17fae5930dbf227b544f889d6648163"} Jun 11 21:50:35.819086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.819042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" event={"ID":"677c4aaf-c0f9-4f91-8119-59f081d41752","Type":"ContainerStarted","Data":"e939f8120e47856a6a48a5f3e6cac3aca0f6677005d2dc4f4816248b22468c29"} Jun 11 21:50:35.834803 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:35.834753 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8c76t" podStartSLOduration=0.834735471 podStartE2EDuration="834.735471ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:50:35.833791064 +0000 UTC m=+483.178016154" watchObservedRunningTime="2026-06-11 21:50:35.834735471 +0000 UTC m=+483.178960563" Jun 11 21:50:40.821573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:40.821535 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-26c8l" Jun 11 21:50:48.736887 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.736846 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-482ng"] Jun 11 21:50:48.740629 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.740608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.742952 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.742933 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xtm4v\"" Jun 11 21:50:48.747295 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.747255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-482ng"] Jun 11 21:50:48.798443 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.798411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-bound-sa-token\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.798587 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.798452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrfdh\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-kube-api-access-xrfdh\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.892629 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.892593 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc"] Jun 11 21:50:48.896648 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.896632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:48.899121 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-bound-sa-token\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.899227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77xc\" (UniqueName: \"kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:48.899227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrfdh\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-kube-api-access-xrfdh\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.899227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:48.899387 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:48.899575 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899558 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:50:48.899645 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899559 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:50:48.899645 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.899606 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:50:48.906152 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.906132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc"] Jun 11 21:50:48.911014 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.910988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-bound-sa-token\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:48.911111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:48.911045 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrfdh\" (UniqueName: \"kubernetes.io/projected/cbdfe8eb-9d1d-4bb0-a75e-54591367032d-kube-api-access-xrfdh\") pod \"cert-manager-59c77684cc-482ng\" (UID: \"cbdfe8eb-9d1d-4bb0-a75e-54591367032d\") " pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:49.000463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.000370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77xc\" (UniqueName: \"kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.000463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.000423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.000463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.000453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.000828 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.000807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.000895 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.000844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.008238 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.008213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77xc\" (UniqueName: \"kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.051299 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.051249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-482ng" Jun 11 21:50:49.206091 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.206030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:49.208885 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.208863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-482ng"] Jun 11 21:50:49.211001 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:49.210974 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbdfe8eb_9d1d_4bb0_a75e_54591367032d.slice/crio-e4d03be08d987ee5106f76f5f1d0c9ec9faae3fc9f97fe1f203e643af682c97b WatchSource:0}: Error finding container e4d03be08d987ee5106f76f5f1d0c9ec9faae3fc9f97fe1f203e643af682c97b: Status 404 returned error can't find the container with id e4d03be08d987ee5106f76f5f1d0c9ec9faae3fc9f97fe1f203e643af682c97b Jun 11 21:50:49.365119 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.365094 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc"] Jun 11 21:50:49.366873 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:50:49.366833 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885e970a_b726_4a3c_ab02_7355798ea240.slice/crio-5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1 WatchSource:0}: Error finding container 5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1: Status 404 returned error can't find the container with id 5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1 Jun 11 21:50:49.885890 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.885860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-482ng" event={"ID":"cbdfe8eb-9d1d-4bb0-a75e-54591367032d","Type":"ContainerStarted","Data":"77f94581940704fe57b11b9933b4ffe8d09848e9cca8529e971de12bdff02788"} Jun 11 21:50:49.886381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.885903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-482ng" event={"ID":"cbdfe8eb-9d1d-4bb0-a75e-54591367032d","Type":"ContainerStarted","Data":"e4d03be08d987ee5106f76f5f1d0c9ec9faae3fc9f97fe1f203e643af682c97b"} Jun 11 21:50:49.887309 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.887265 2577 generic.go:356] "Generic (PLEG): container finished" podID="885e970a-b726-4a3c-ab02-7355798ea240" containerID="837685bd13842bf7500444fefcae3f31eb9c9225d5e3ca623948c87f84d6383c" exitCode=0 Jun 11 21:50:49.887381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.887347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" event={"ID":"885e970a-b726-4a3c-ab02-7355798ea240","Type":"ContainerDied","Data":"837685bd13842bf7500444fefcae3f31eb9c9225d5e3ca623948c87f84d6383c"} Jun 11 21:50:49.887418 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.887395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" event={"ID":"885e970a-b726-4a3c-ab02-7355798ea240","Type":"ContainerStarted","Data":"5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1"} Jun 11 21:50:49.902074 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:49.902025 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-482ng" podStartSLOduration=1.902010324 podStartE2EDuration="1.902010324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:50:49.900333263 +0000 UTC m=+497.244558346" watchObservedRunningTime="2026-06-11 21:50:49.902010324 +0000 UTC m=+497.246235415" Jun 11 21:50:51.899505 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:51.899463 2577 generic.go:356] "Generic (PLEG): container finished" podID="885e970a-b726-4a3c-ab02-7355798ea240" containerID="7ace00a213110b1dccd6b7c3a0a4faa0b54fdf925e7503fc1666078b89061abb" exitCode=0 Jun 11 21:50:51.900101 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:51.899554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" event={"ID":"885e970a-b726-4a3c-ab02-7355798ea240","Type":"ContainerDied","Data":"7ace00a213110b1dccd6b7c3a0a4faa0b54fdf925e7503fc1666078b89061abb"} Jun 11 21:50:52.906086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:52.906049 2577 generic.go:356] "Generic (PLEG): container finished" podID="885e970a-b726-4a3c-ab02-7355798ea240" containerID="3c8910c1c643eb59eca358c63beee2038224fbb5cb71a9bc56f8aa1dfcd69b70" exitCode=0 Jun 11 21:50:52.906494 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:52.906102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" event={"ID":"885e970a-b726-4a3c-ab02-7355798ea240","Type":"ContainerDied","Data":"3c8910c1c643eb59eca358c63beee2038224fbb5cb71a9bc56f8aa1dfcd69b70"} Jun 11 21:50:54.041005 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.040977 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:54.138274 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.138239 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle\") pod \"885e970a-b726-4a3c-ab02-7355798ea240\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " Jun 11 21:50:54.138463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.138328 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z77xc\" (UniqueName: \"kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc\") pod \"885e970a-b726-4a3c-ab02-7355798ea240\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " Jun 11 21:50:54.138463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.138360 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util\") pod \"885e970a-b726-4a3c-ab02-7355798ea240\" (UID: \"885e970a-b726-4a3c-ab02-7355798ea240\") " Jun 11 21:50:54.139119 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.139091 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle" (OuterVolumeSpecName: "bundle") pod "885e970a-b726-4a3c-ab02-7355798ea240" (UID: "885e970a-b726-4a3c-ab02-7355798ea240"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:54.140435 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.140408 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc" (OuterVolumeSpecName: "kube-api-access-z77xc") pod "885e970a-b726-4a3c-ab02-7355798ea240" (UID: "885e970a-b726-4a3c-ab02-7355798ea240"). InnerVolumeSpecName "kube-api-access-z77xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:50:54.144023 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.144001 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util" (OuterVolumeSpecName: "util") pod "885e970a-b726-4a3c-ab02-7355798ea240" (UID: "885e970a-b726-4a3c-ab02-7355798ea240"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:54.238842 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.238752 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:54.238842 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.238783 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z77xc\" (UniqueName: \"kubernetes.io/projected/885e970a-b726-4a3c-ab02-7355798ea240-kube-api-access-z77xc\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:54.238842 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.238791 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/885e970a-b726-4a3c-ab02-7355798ea240-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:50:54.917612 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.917578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" event={"ID":"885e970a-b726-4a3c-ab02-7355798ea240","Type":"ContainerDied","Data":"5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1"} Jun 11 21:50:54.917612 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.917599 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzrtbc" Jun 11 21:50:54.917812 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:50:54.917630 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5a16c1ddf6e3d085b957d20e57c1f6561c4e308566d2d7857efa7bbd9a8ca1" Jun 11 21:51:11.561590 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561551 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c"] Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561855 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="pull" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561865 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="pull" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561879 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="util" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561884 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="util" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561889 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="extract" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561896 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="extract" Jun 11 21:51:11.562046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.561942 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="885e970a-b726-4a3c-ab02-7355798ea240" containerName="extract" Jun 11 21:51:11.568156 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.568135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.570816 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.570785 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:51:11.570942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.570825 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:51:11.570942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.570824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qjx4v\"" Jun 11 21:51:11.570942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.570874 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 21:51:11.572068 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.572044 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 21:51:11.572198 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.572132 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 21:51:11.574335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.574313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c"] Jun 11 21:51:11.668855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.668815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-manager-config\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.668855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.668854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.669072 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.668917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.669072 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.668983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cb2p\" (UniqueName: \"kubernetes.io/projected/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-kube-api-access-4cb2p\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.770130 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.770090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cb2p\" (UniqueName: \"kubernetes.io/projected/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-kube-api-access-4cb2p\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.770357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.770163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-manager-config\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.770357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.770189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.770357 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.770235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.770918 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.770882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-manager-config\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.772706 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.772683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.772810 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.772759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-cert\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.784809 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.784786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cb2p\" (UniqueName: \"kubernetes.io/projected/b5a3ecd9-9eda-4b26-92c0-d0825ab6af04-kube-api-access-4cb2p\") pod \"lws-controller-manager-d4898ff9d-jss5c\" (UID: \"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:11.879363 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:11.879330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:12.006097 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:12.006071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c"] Jun 11 21:51:12.008457 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:51:12.008427 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a3ecd9_9eda_4b26_92c0_d0825ab6af04.slice/crio-7e6d2033cd7c18c372d2d44dc8df55d449ec7f7f6f3e601d723ca50d71a2e868 WatchSource:0}: Error finding container 7e6d2033cd7c18c372d2d44dc8df55d449ec7f7f6f3e601d723ca50d71a2e868: Status 404 returned error can't find the container with id 7e6d2033cd7c18c372d2d44dc8df55d449ec7f7f6f3e601d723ca50d71a2e868 Jun 11 21:51:13.001838 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:13.001806 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" event={"ID":"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04","Type":"ContainerStarted","Data":"7e6d2033cd7c18c372d2d44dc8df55d449ec7f7f6f3e601d723ca50d71a2e868"} Jun 11 21:51:14.008711 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:14.008676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" event={"ID":"b5a3ecd9-9eda-4b26-92c0-d0825ab6af04","Type":"ContainerStarted","Data":"42a973a0f40ef57da8cd87abe8f7725a5665d6282c694d677307abd848f493ea"} Jun 11 21:51:14.009143 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:14.008739 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:14.024167 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:14.024126 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" podStartSLOduration=1.6305160810000001 podStartE2EDuration="3.024111496s" totalImagesPullingTime="1.393595415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:14.024058676 +0000 UTC m=+521.368283768" watchObservedRunningTime="2026-06-11 21:51:14.024111496 +0000 UTC m=+521.368336588" Jun 11 21:51:15.384252 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.384217 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h"] Jun 11 21:51:15.387686 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.387670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.390566 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.390542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:51:15.390829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.390811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cxzwm\"" Jun 11 21:51:15.391392 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.391323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:51:15.391487 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.391434 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:51:15.392772 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.392753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:51:15.407734 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.407712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h"] Jun 11 21:51:15.504413 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.504376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.504413 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.504416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.504632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.504446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdg4\" (UniqueName: \"kubernetes.io/projected/71091d4c-8474-4244-8027-3e2ae75b663f-kube-api-access-lfdg4\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.504632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.504504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.504632 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.504537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.605769 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.605731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.605769 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.605771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.605999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.605797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdg4\" (UniqueName: \"kubernetes.io/projected/71091d4c-8474-4244-8027-3e2ae75b663f-kube-api-access-lfdg4\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.605999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.605825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.605999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.605847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.606260 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.606235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.607946 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.607915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71091d4c-8474-4244-8027-3e2ae75b663f-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.608210 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.608193 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.608268 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.608236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71091d4c-8474-4244-8027-3e2ae75b663f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.616664 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.616635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdg4\" (UniqueName: \"kubernetes.io/projected/71091d4c-8474-4244-8027-3e2ae75b663f-kube-api-access-lfdg4\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h\" (UID: \"71091d4c-8474-4244-8027-3e2ae75b663f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.699458 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.699372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:15.839628 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:15.839593 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h"] Jun 11 21:51:15.843080 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:51:15.843045 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71091d4c_8474_4244_8027_3e2ae75b663f.slice/crio-1bc486091607d10df0ba032b11f63ebdc5563dab4b9d1771acc6b3bca07c49bb WatchSource:0}: Error finding container 1bc486091607d10df0ba032b11f63ebdc5563dab4b9d1771acc6b3bca07c49bb: Status 404 returned error can't find the container with id 1bc486091607d10df0ba032b11f63ebdc5563dab4b9d1771acc6b3bca07c49bb Jun 11 21:51:16.022468 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:16.022388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" event={"ID":"71091d4c-8474-4244-8027-3e2ae75b663f","Type":"ContainerStarted","Data":"1bc486091607d10df0ba032b11f63ebdc5563dab4b9d1771acc6b3bca07c49bb"} Jun 11 21:51:19.038418 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:19.038319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" event={"ID":"71091d4c-8474-4244-8027-3e2ae75b663f","Type":"ContainerStarted","Data":"b1ef71ca534df5b341d219cd33d759a79be1649e3e64e61cd8c8d290183a9ddb"} Jun 11 21:51:20.044654 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:20.044558 2577 generic.go:356] "Generic (PLEG): container finished" podID="71091d4c-8474-4244-8027-3e2ae75b663f" containerID="b1ef71ca534df5b341d219cd33d759a79be1649e3e64e61cd8c8d290183a9ddb" exitCode=0 Jun 11 21:51:20.044654 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:20.044636 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" event={"ID":"71091d4c-8474-4244-8027-3e2ae75b663f","Type":"ContainerDied","Data":"b1ef71ca534df5b341d219cd33d759a79be1649e3e64e61cd8c8d290183a9ddb"} Jun 11 21:51:21.052659 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:21.052629 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:21.053004 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:21.052678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" event={"ID":"71091d4c-8474-4244-8027-3e2ae75b663f","Type":"ContainerStarted","Data":"b9da220bc7219222c6e74a0736d29bfe2dee2dbae68288c24c6ed2c4f47363c8"} Jun 11 21:51:21.082356 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:21.082299 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" podStartSLOduration=1.981389219 podStartE2EDuration="6.08226392s" totalImagesPullingTime="3.193882614s" totalInitContainerRuntime="906.992087ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:21.080099269 +0000 UTC m=+528.424324407" watchObservedRunningTime="2026-06-11 21:51:21.08226392 +0000 UTC m=+528.426489011" Jun 11 21:51:25.015226 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:25.015194 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-jss5c" Jun 11 21:51:32.059046 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:32.059012 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h" Jun 11 21:51:36.242234 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.242191 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct"] Jun 11 21:51:36.256678 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.256645 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct"] Jun 11 21:51:36.256827 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.256744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.259258 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.259232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:51:36.259426 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.259316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:51:36.260411 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.260390 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:51:36.382020 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.381973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.382020 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.382021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.382227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.382107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68dd\" (UniqueName: \"kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.483183 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.483147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.483183 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.483183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.483404 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.483221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68dd\" (UniqueName: \"kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.483634 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.483611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.483669 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.483618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.492266 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.492205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68dd\" (UniqueName: \"kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.567076 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.567028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:36.702378 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:36.702348 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct"] Jun 11 21:51:36.704290 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:51:36.704243 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ae5779_2c95_43ba_bac5_2e71ab3d85b0.slice/crio-5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9 WatchSource:0}: Error finding container 5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9: Status 404 returned error can't find the container with id 5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9 Jun 11 21:51:37.125492 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:37.125458 2577 generic.go:356] "Generic (PLEG): container finished" podID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerID="5ab55af9e125f1eab7b785a01118af186f506fca3d9618dd3e4107ad2142896e" exitCode=0 Jun 11 21:51:37.125677 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:37.125547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" event={"ID":"56ae5779-2c95-43ba-bac5-2e71ab3d85b0","Type":"ContainerDied","Data":"5ab55af9e125f1eab7b785a01118af186f506fca3d9618dd3e4107ad2142896e"} Jun 11 21:51:37.125677 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:37.125606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" event={"ID":"56ae5779-2c95-43ba-bac5-2e71ab3d85b0","Type":"ContainerStarted","Data":"5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9"} Jun 11 21:51:38.132126 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:38.132090 2577 generic.go:356] "Generic (PLEG): container finished" podID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerID="73c786051728148e1b74561472cb8ca78bd4f1574f113f396d5ecff52984a7f7" exitCode=0 Jun 11 21:51:38.132542 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:38.132175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" event={"ID":"56ae5779-2c95-43ba-bac5-2e71ab3d85b0","Type":"ContainerDied","Data":"73c786051728148e1b74561472cb8ca78bd4f1574f113f396d5ecff52984a7f7"} Jun 11 21:51:39.138742 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:39.138709 2577 generic.go:356] "Generic (PLEG): container finished" podID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerID="6fb640464265dae51d6a2662f6382bf8bdc76d8ad653ede342d79e607ac9d66b" exitCode=0 Jun 11 21:51:39.138742 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:39.138745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" event={"ID":"56ae5779-2c95-43ba-bac5-2e71ab3d85b0","Type":"ContainerDied","Data":"6fb640464265dae51d6a2662f6382bf8bdc76d8ad653ede342d79e607ac9d66b"} Jun 11 21:51:40.270469 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.270444 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:40.419949 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.419843 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util\") pod \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " Jun 11 21:51:40.419949 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.419885 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v68dd\" (UniqueName: \"kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd\") pod \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " Jun 11 21:51:40.419949 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.419914 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle\") pod \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\" (UID: \"56ae5779-2c95-43ba-bac5-2e71ab3d85b0\") " Jun 11 21:51:40.420809 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.420783 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle" (OuterVolumeSpecName: "bundle") pod "56ae5779-2c95-43ba-bac5-2e71ab3d85b0" (UID: "56ae5779-2c95-43ba-bac5-2e71ab3d85b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:51:40.422006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.421974 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd" (OuterVolumeSpecName: "kube-api-access-v68dd") pod "56ae5779-2c95-43ba-bac5-2e71ab3d85b0" (UID: "56ae5779-2c95-43ba-bac5-2e71ab3d85b0"). InnerVolumeSpecName "kube-api-access-v68dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:51:40.428106 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.428080 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util" (OuterVolumeSpecName: "util") pod "56ae5779-2c95-43ba-bac5-2e71ab3d85b0" (UID: "56ae5779-2c95-43ba-bac5-2e71ab3d85b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:51:40.521412 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.521382 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:40.521412 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.521410 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:40.521412 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:40.521419 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v68dd\" (UniqueName: \"kubernetes.io/projected/56ae5779-2c95-43ba-bac5-2e71ab3d85b0-kube-api-access-v68dd\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:41.149431 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:41.149403 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" Jun 11 21:51:41.149605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:41.149397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rhjct" event={"ID":"56ae5779-2c95-43ba-bac5-2e71ab3d85b0","Type":"ContainerDied","Data":"5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9"} Jun 11 21:51:41.149605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:41.149528 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5873314355adfebf3a0a8ee14d999cd6a9fe6f13a6431be27fa76dc1d3272ec9" Jun 11 21:51:46.314909 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.314872 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp"] Jun 11 21:51:46.315416 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315391 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="pull" Jun 11 21:51:46.315416 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315409 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="pull" Jun 11 21:51:46.315533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315427 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="util" Jun 11 21:51:46.315533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315434 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="util" Jun 11 21:51:46.315533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="extract" Jun 11 21:51:46.315533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315472 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="extract" Jun 11 21:51:46.315725 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.315561 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ae5779-2c95-43ba-bac5-2e71ab3d85b0" containerName="extract" Jun 11 21:51:46.319112 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.319089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.329731 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.329710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:51:46.330045 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.330031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:51:46.335712 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.335695 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:51:46.350951 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.350916 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp"] Jun 11 21:51:46.474623 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.474585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmdwb\" (UniqueName: \"kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.474623 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.474627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.474824 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.474645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.575755 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.575663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmdwb\" (UniqueName: \"kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.575755 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.575699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.575755 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.575718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.576155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.576135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.576192 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.576148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.597767 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.597733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmdwb\" (UniqueName: \"kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.628472 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.628422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:46.814728 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:46.814703 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp"] Jun 11 21:51:46.817159 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:51:46.817130 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01217e6_0af2_4701_99f8_027f69e1e088.slice/crio-a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f WatchSource:0}: Error finding container a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f: Status 404 returned error can't find the container with id a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f Jun 11 21:51:47.177552 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:47.177518 2577 generic.go:356] "Generic (PLEG): container finished" podID="c01217e6-0af2-4701-99f8-027f69e1e088" containerID="ea924cf85a3fd159c9d673ef592047896cdbdad42c2706b7dd33dfe1be574ce3" exitCode=0 Jun 11 21:51:47.177732 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:47.177606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" event={"ID":"c01217e6-0af2-4701-99f8-027f69e1e088","Type":"ContainerDied","Data":"ea924cf85a3fd159c9d673ef592047896cdbdad42c2706b7dd33dfe1be574ce3"} Jun 11 21:51:47.177732 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:47.177655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" event={"ID":"c01217e6-0af2-4701-99f8-027f69e1e088","Type":"ContainerStarted","Data":"a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f"} Jun 11 21:51:48.184333 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:48.184299 2577 generic.go:356] "Generic (PLEG): container finished" podID="c01217e6-0af2-4701-99f8-027f69e1e088" containerID="cc92e5f73eb2b06b95e5b675134a63414fd905e0de058c3a9bc6602576c210b6" exitCode=0 Jun 11 21:51:48.184698 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:48.184369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" event={"ID":"c01217e6-0af2-4701-99f8-027f69e1e088","Type":"ContainerDied","Data":"cc92e5f73eb2b06b95e5b675134a63414fd905e0de058c3a9bc6602576c210b6"} Jun 11 21:51:49.190924 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:49.190889 2577 generic.go:356] "Generic (PLEG): container finished" podID="c01217e6-0af2-4701-99f8-027f69e1e088" containerID="93240948a565c8eb6fce0073e0942c5fb3e43139ab189fc24cd8899dd33cd614" exitCode=0 Jun 11 21:51:49.191349 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:49.190932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" event={"ID":"c01217e6-0af2-4701-99f8-027f69e1e088","Type":"ContainerDied","Data":"93240948a565c8eb6fce0073e0942c5fb3e43139ab189fc24cd8899dd33cd614"} Jun 11 21:51:50.324960 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.324929 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:50.507474 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.507377 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util\") pod \"c01217e6-0af2-4701-99f8-027f69e1e088\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " Jun 11 21:51:50.507474 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.507416 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle\") pod \"c01217e6-0af2-4701-99f8-027f69e1e088\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " Jun 11 21:51:50.507474 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.507467 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmdwb\" (UniqueName: \"kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb\") pod \"c01217e6-0af2-4701-99f8-027f69e1e088\" (UID: \"c01217e6-0af2-4701-99f8-027f69e1e088\") " Jun 11 21:51:50.508397 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.508365 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle" (OuterVolumeSpecName: "bundle") pod "c01217e6-0af2-4701-99f8-027f69e1e088" (UID: "c01217e6-0af2-4701-99f8-027f69e1e088"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:51:50.509617 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.509593 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb" (OuterVolumeSpecName: "kube-api-access-dmdwb") pod "c01217e6-0af2-4701-99f8-027f69e1e088" (UID: "c01217e6-0af2-4701-99f8-027f69e1e088"). InnerVolumeSpecName "kube-api-access-dmdwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:51:50.512930 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.512890 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util" (OuterVolumeSpecName: "util") pod "c01217e6-0af2-4701-99f8-027f69e1e088" (UID: "c01217e6-0af2-4701-99f8-027f69e1e088"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:51:50.608487 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.608451 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmdwb\" (UniqueName: \"kubernetes.io/projected/c01217e6-0af2-4701-99f8-027f69e1e088-kube-api-access-dmdwb\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:50.608487 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.608481 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:50.608487 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.608491 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c01217e6-0af2-4701-99f8-027f69e1e088-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:51:50.684275 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7d74697646-nbh7s"] Jun 11 21:51:50.684650 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684634 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="extract" Jun 11 21:51:50.684650 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684649 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="extract" Jun 11 21:51:50.684795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684658 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="pull" Jun 11 21:51:50.684795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684664 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="pull" Jun 11 21:51:50.684795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684687 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="util" Jun 11 21:51:50.684795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684692 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="util" Jun 11 21:51:50.684795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.684764 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c01217e6-0af2-4701-99f8-027f69e1e088" containerName="extract" Jun 11 21:51:50.687934 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.687910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.690588 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.690568 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 21:51:50.690698 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.690658 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jkjv4\"" Jun 11 21:51:50.699090 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.699063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d74697646-nbh7s"] Jun 11 21:51:50.810877 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.810788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjsf\" (UniqueName: \"kubernetes.io/projected/7eb93467-cf5a-472e-afed-ddf034596f63-kube-api-access-qcjsf\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.810877 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.810833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7eb93467-cf5a-472e-afed-ddf034596f63-redirect-config\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.912018 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.911956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjsf\" (UniqueName: \"kubernetes.io/projected/7eb93467-cf5a-472e-afed-ddf034596f63-kube-api-access-qcjsf\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.912203 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.912126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7eb93467-cf5a-472e-afed-ddf034596f63-redirect-config\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.912887 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.912861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7eb93467-cf5a-472e-afed-ddf034596f63-redirect-config\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:50.920073 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:50.920050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjsf\" (UniqueName: \"kubernetes.io/projected/7eb93467-cf5a-472e-afed-ddf034596f63-kube-api-access-qcjsf\") pod \"dashboard-redirect-7d74697646-nbh7s\" (UID: \"7eb93467-cf5a-472e-afed-ddf034596f63\") " pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:51.000419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.000385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" Jun 11 21:51:51.134109 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.134085 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d74697646-nbh7s"] Jun 11 21:51:51.134731 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:51:51.134708 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb93467_cf5a_472e_afed_ddf034596f63.slice/crio-5afe6f9e56b5f1ed0c55bd7aa2648a59dc8fbeb56af499905b8f3729e492ca13 WatchSource:0}: Error finding container 5afe6f9e56b5f1ed0c55bd7aa2648a59dc8fbeb56af499905b8f3729e492ca13: Status 404 returned error can't find the container with id 5afe6f9e56b5f1ed0c55bd7aa2648a59dc8fbeb56af499905b8f3729e492ca13 Jun 11 21:51:51.203102 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.203074 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" Jun 11 21:51:51.203275 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.203105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsvpp" event={"ID":"c01217e6-0af2-4701-99f8-027f69e1e088","Type":"ContainerDied","Data":"a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f"} Jun 11 21:51:51.203275 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.203159 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7794d8d1e60e13a98b39496da172766935314c7b7666ce9303c89a0c01cf65f" Jun 11 21:51:51.204299 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:51.204252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" event={"ID":"7eb93467-cf5a-472e-afed-ddf034596f63","Type":"ContainerStarted","Data":"5afe6f9e56b5f1ed0c55bd7aa2648a59dc8fbeb56af499905b8f3729e492ca13"} Jun 11 21:51:54.223137 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:54.223098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" event={"ID":"7eb93467-cf5a-472e-afed-ddf034596f63","Type":"ContainerStarted","Data":"b78fc0a7151ceae8ac259b8cdcb120ce987d2cdf15bd2d2d1ab790fd81b15941"} Jun 11 21:51:54.241138 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:51:54.241090 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7d74697646-nbh7s" podStartSLOduration=2.067022895 podStartE2EDuration="4.241073775s" totalImagesPullingTime="2.17405088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:54.239668604 +0000 UTC m=+561.583893712" watchObservedRunningTime="2026-06-11 21:51:54.241073775 +0000 UTC m=+561.585298888" Jun 11 21:52:01.200442 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.200404 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:01.203830 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.203807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.206462 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.206435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 21:52:01.206570 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.206443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:52:01.206570 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.206450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4vdt8\"" Jun 11 21:52:01.206697 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.206679 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:52:01.214149 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.214127 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:01.293034 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.292996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293034 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293228 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293424 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b4w5\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.293424 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.293308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393684 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393684 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.393942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394188 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b4w5\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394188 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.393991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394188 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.394138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394361 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.394308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394492 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.394463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.394572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.394754 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.394737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.396154 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.396134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.396400 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.396380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.406418 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.406389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.406719 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.406696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b4w5\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.515703 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.515619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:01.537512 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.537475 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6"] Jun 11 21:52:01.541222 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.541185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.566611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.566575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6"] Jun 11 21:52:01.595720 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.595886 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.595886 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.595886 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.596077 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhpm5\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-kube-api-access-nhpm5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.596077 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.595958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.596077 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.596041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.596246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.596086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.596246 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.596113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.661991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.661961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:01.663584 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:01.663556 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb648f1_649d_4cc6_987e_87a128c1aa67.slice/crio-87f29e9ddd73af1982ae7209e541f98e3d4e00001df8b7fc9e8498b9353c3e28 WatchSource:0}: Error finding container 87f29e9ddd73af1982ae7209e541f98e3d4e00001df8b7fc9e8498b9353c3e28: Status 404 returned error can't find the container with id 87f29e9ddd73af1982ae7209e541f98e3d4e00001df8b7fc9e8498b9353c3e28 Jun 11 21:52:01.697140 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhpm5\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-kube-api-access-nhpm5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697785 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697879 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.697879 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.697837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.698163 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.698142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.699531 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.699513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.699779 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.699763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.705022 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.704993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.705122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.705112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhpm5\" (UniqueName: \"kubernetes.io/projected/4917a70e-fd3e-4b2c-aaa7-cafbf3370560-kube-api-access-nhpm5\") pod \"data-science-gateway-data-science-gateway-class-74759f9795jnrw6\" (UID: \"4917a70e-fd3e-4b2c-aaa7-cafbf3370560\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.852072 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.852032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:01.991625 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:01.991596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6"] Jun 11 21:52:01.992922 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:01.992890 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4917a70e_fd3e_4b2c_aaa7_cafbf3370560.slice/crio-efdcd849cf4aab10bb3683e6b5f8ddfa67283a14ec559e774bb5069916ee8595 WatchSource:0}: Error finding container efdcd849cf4aab10bb3683e6b5f8ddfa67283a14ec559e774bb5069916ee8595: Status 404 returned error can't find the container with id efdcd849cf4aab10bb3683e6b5f8ddfa67283a14ec559e774bb5069916ee8595 Jun 11 21:52:02.263877 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:02.263774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" event={"ID":"ecb648f1-649d-4cc6-987e-87a128c1aa67","Type":"ContainerStarted","Data":"87f29e9ddd73af1982ae7209e541f98e3d4e00001df8b7fc9e8498b9353c3e28"} Jun 11 21:52:02.265144 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:02.265120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" event={"ID":"4917a70e-fd3e-4b2c-aaa7-cafbf3370560","Type":"ContainerStarted","Data":"efdcd849cf4aab10bb3683e6b5f8ddfa67283a14ec559e774bb5069916ee8595"} Jun 11 21:52:04.480839 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.480798 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:04.481214 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.480877 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:04.481214 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.480906 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:04.488408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.488368 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:04.488476 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.488453 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:04.488513 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:04.488481 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 21:52:05.282457 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.282413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" event={"ID":"4917a70e-fd3e-4b2c-aaa7-cafbf3370560","Type":"ContainerStarted","Data":"f8e4efa040d7206fd949c306d3190e6281396aabefd8362fd7c509bc5267d791"} Jun 11 21:52:05.283909 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.283874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" event={"ID":"ecb648f1-649d-4cc6-987e-87a128c1aa67","Type":"ContainerStarted","Data":"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093"} Jun 11 21:52:05.301660 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.301617 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" podStartSLOduration=1.8084681169999999 podStartE2EDuration="4.301602526s" totalImagesPullingTime="2.493134409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:52:05.299550563 +0000 UTC m=+572.643775668" watchObservedRunningTime="2026-06-11 21:52:05.301602526 +0000 UTC m=+572.645827616" Jun 11 21:52:05.319355 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.319305 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" podStartSLOduration=1.504246953 podStartE2EDuration="4.319291305s" totalImagesPullingTime="2.815044352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:52:05.316846194 +0000 UTC m=+572.661071315" watchObservedRunningTime="2026-06-11 21:52:05.319291305 +0000 UTC m=+572.663516387" Jun 11 21:52:05.516824 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.516786 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:05.518079 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.518056 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 11 21:52:05.518138 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.518107 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 11 21:52:05.853028 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.852990 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:05.858002 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:05.857975 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:06.289378 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:06.289270 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:06.290244 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:06.290225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795jnrw6" Jun 11 21:52:06.336692 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:06.336660 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:06.516413 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:06.516373 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 11 21:52:06.516588 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:06.516429 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 11 21:52:07.517038 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:07.516994 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 11 21:52:07.517611 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:07.517063 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 11 21:52:08.298733 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:08.298690 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" containerID="cri-o://229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093" gracePeriod=30 Jun 11 21:52:13.546940 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.546914 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:13.604554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604526 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604570 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604595 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604618 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604634 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604696 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604661 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b4w5\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604902 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604822 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604902 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604842 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.604902 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data\") pod \"ecb648f1-649d-4cc6-987e-87a128c1aa67\" (UID: \"ecb648f1-649d-4cc6-987e-87a128c1aa67\") " Jun 11 21:52:13.605007 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.604831 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:13.605084 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.605069 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-credential-socket\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.607484 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.607457 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:13.607596 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.607563 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:52:13.607679 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.607650 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:13.607745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.607667 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:13.609566 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.609537 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:13.609659 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.609594 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 21:52:13.609756 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.609740 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:13.609806 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.609748 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5" (OuterVolumeSpecName: "kube-api-access-5b4w5") pod "ecb648f1-649d-4cc6-987e-87a128c1aa67" (UID: "ecb648f1-649d-4cc6-987e-87a128c1aa67"). InnerVolumeSpecName "kube-api-access-5b4w5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:13.706023 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.705991 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-socket\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706023 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706019 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-envoy\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706023 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706027 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-data\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706035 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb648f1-649d-4cc6-987e-87a128c1aa67-workload-certs\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706042 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-podinfo\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706050 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecb648f1-649d-4cc6-987e-87a128c1aa67-istiod-ca-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706059 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-istio-token\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:13.706227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:13.706066 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b4w5\" (UniqueName: \"kubernetes.io/projected/ecb648f1-649d-4cc6-987e-87a128c1aa67-kube-api-access-5b4w5\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:14.329067 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.329023 2577 generic.go:356] "Generic (PLEG): container finished" podID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerID="229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093" exitCode=0 Jun 11 21:52:14.329296 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.329077 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" Jun 11 21:52:14.329296 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.329115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" event={"ID":"ecb648f1-649d-4cc6-987e-87a128c1aa67","Type":"ContainerDied","Data":"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093"} Jun 11 21:52:14.329296 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.329192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr" event={"ID":"ecb648f1-649d-4cc6-987e-87a128c1aa67","Type":"ContainerDied","Data":"87f29e9ddd73af1982ae7209e541f98e3d4e00001df8b7fc9e8498b9353c3e28"} Jun 11 21:52:14.329296 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.329225 2577 scope.go:117] "RemoveContainer" containerID="229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093" Jun 11 21:52:14.338255 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.338238 2577 scope.go:117] "RemoveContainer" containerID="229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093" Jun 11 21:52:14.338540 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:52:14.338521 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093\": container with ID starting with 229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093 not found: ID does not exist" containerID="229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093" Jun 11 21:52:14.338598 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.338549 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093"} err="failed to get container status \"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093\": rpc error: code = NotFound desc = could not find container \"229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093\": container with ID starting with 229406e258dc6c9a6729c5c6815d5a2bd4eaf5e4058601db1304ab37bd852093 not found: ID does not exist" Jun 11 21:52:14.350822 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.350798 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:14.354322 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:14.354298 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fbnzsr"] Jun 11 21:52:15.052654 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:15.052615 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" path="/var/lib/kubelet/pods/ecb648f1-649d-4cc6-987e-87a128c1aa67/volumes" Jun 11 21:52:35.480935 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.480893 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:35.481460 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.481397 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" Jun 11 21:52:35.481460 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.481418 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" Jun 11 21:52:35.481566 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.481523 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb648f1-649d-4cc6-987e-87a128c1aa67" containerName="istio-proxy" Jun 11 21:52:35.486536 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.486515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:35.488888 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.488863 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:52:35.489035 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.488916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:52:35.490073 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.490043 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vpgfl\"" Jun 11 21:52:35.493388 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.493355 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:35.604192 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.604160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhnv9\" (UniqueName: \"kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9\") pod \"kuadrant-operator-catalog-96rrk\" (UID: \"8f78164e-6027-4091-b10c-859a70258839\") " pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:35.705239 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.705205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhnv9\" (UniqueName: \"kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9\") pod \"kuadrant-operator-catalog-96rrk\" (UID: \"8f78164e-6027-4091-b10c-859a70258839\") " pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:35.713102 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.713070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhnv9\" (UniqueName: \"kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9\") pod \"kuadrant-operator-catalog-96rrk\" (UID: \"8f78164e-6027-4091-b10c-859a70258839\") " pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:35.798540 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.798456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:35.837765 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.837731 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:35.927548 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:35.927520 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:35.929579 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:35.929552 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f78164e_6027_4091_b10c_859a70258839.slice/crio-82c28b3177b7cc45027d2c9a5f337df8594b9fcbc10d3a5d9aba6d58b9abde97 WatchSource:0}: Error finding container 82c28b3177b7cc45027d2c9a5f337df8594b9fcbc10d3a5d9aba6d58b9abde97: Status 404 returned error can't find the container with id 82c28b3177b7cc45027d2c9a5f337df8594b9fcbc10d3a5d9aba6d58b9abde97 Jun 11 21:52:36.045834 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.045788 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgcjc"] Jun 11 21:52:36.048581 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.048532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:36.056545 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.056523 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgcjc"] Jun 11 21:52:36.210153 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.210109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw2mn\" (UniqueName: \"kubernetes.io/projected/086e730e-d87c-42b9-b5a6-e26cb441b673-kube-api-access-cw2mn\") pod \"kuadrant-operator-catalog-sgcjc\" (UID: \"086e730e-d87c-42b9-b5a6-e26cb441b673\") " pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:36.311521 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.311437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw2mn\" (UniqueName: \"kubernetes.io/projected/086e730e-d87c-42b9-b5a6-e26cb441b673-kube-api-access-cw2mn\") pod \"kuadrant-operator-catalog-sgcjc\" (UID: \"086e730e-d87c-42b9-b5a6-e26cb441b673\") " pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:36.319800 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.319763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw2mn\" (UniqueName: \"kubernetes.io/projected/086e730e-d87c-42b9-b5a6-e26cb441b673-kube-api-access-cw2mn\") pod \"kuadrant-operator-catalog-sgcjc\" (UID: \"086e730e-d87c-42b9-b5a6-e26cb441b673\") " pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:36.359225 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.359189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:36.438847 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.438770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" event={"ID":"8f78164e-6027-4091-b10c-859a70258839","Type":"ContainerStarted","Data":"82c28b3177b7cc45027d2c9a5f337df8594b9fcbc10d3a5d9aba6d58b9abde97"} Jun 11 21:52:36.501909 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:36.498787 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgcjc"] Jun 11 21:52:36.538190 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:36.538155 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086e730e_d87c_42b9_b5a6_e26cb441b673.slice/crio-772d344f47228299c0d6e25e3ae9f9747729069e5e6fa28a46c156910ba1258d WatchSource:0}: Error finding container 772d344f47228299c0d6e25e3ae9f9747729069e5e6fa28a46c156910ba1258d: Status 404 returned error can't find the container with id 772d344f47228299c0d6e25e3ae9f9747729069e5e6fa28a46c156910ba1258d Jun 11 21:52:37.446913 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:37.446863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" event={"ID":"086e730e-d87c-42b9-b5a6-e26cb441b673","Type":"ContainerStarted","Data":"772d344f47228299c0d6e25e3ae9f9747729069e5e6fa28a46c156910ba1258d"} Jun 11 21:52:38.453304 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.453243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" event={"ID":"086e730e-d87c-42b9-b5a6-e26cb441b673","Type":"ContainerStarted","Data":"945d52e06382322668a33d0dcfb2b4032fc707571412839909e562dc939e8a1b"} Jun 11 21:52:38.454630 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.454605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" event={"ID":"8f78164e-6027-4091-b10c-859a70258839","Type":"ContainerStarted","Data":"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96"} Jun 11 21:52:38.454725 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.454674 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" podUID="8f78164e-6027-4091-b10c-859a70258839" containerName="registry-server" containerID="cri-o://8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96" gracePeriod=2 Jun 11 21:52:38.472060 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.471989 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" podStartSLOduration=1.06787042 podStartE2EDuration="2.471911651s" totalImagesPullingTime="1.404041231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:52:38.469546936 +0000 UTC m=+605.813772051" watchObservedRunningTime="2026-06-11 21:52:38.471911651 +0000 UTC m=+605.816136741" Jun 11 21:52:38.484952 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.484903 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" podStartSLOduration=1.475263182 podStartE2EDuration="3.484888461s" totalImagesPullingTime="2.009625279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:52:38.482768494 +0000 UTC m=+605.826993611" watchObservedRunningTime="2026-06-11 21:52:38.484888461 +0000 UTC m=+605.829113552" Jun 11 21:52:38.695160 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.695137 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:38.835354 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.835252 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhnv9\" (UniqueName: \"kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9\") pod \"8f78164e-6027-4091-b10c-859a70258839\" (UID: \"8f78164e-6027-4091-b10c-859a70258839\") " Jun 11 21:52:38.837678 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.837648 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9" (OuterVolumeSpecName: "kube-api-access-vhnv9") pod "8f78164e-6027-4091-b10c-859a70258839" (UID: "8f78164e-6027-4091-b10c-859a70258839"). InnerVolumeSpecName "kube-api-access-vhnv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:38.936558 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:38.936518 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhnv9\" (UniqueName: \"kubernetes.io/projected/8f78164e-6027-4091-b10c-859a70258839-kube-api-access-vhnv9\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:39.461168 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.461134 2577 generic.go:356] "Generic (PLEG): container finished" podID="8f78164e-6027-4091-b10c-859a70258839" containerID="8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96" exitCode=0 Jun 11 21:52:39.461673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.461186 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" Jun 11 21:52:39.461673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.461219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" event={"ID":"8f78164e-6027-4091-b10c-859a70258839","Type":"ContainerDied","Data":"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96"} Jun 11 21:52:39.461673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.461272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-96rrk" event={"ID":"8f78164e-6027-4091-b10c-859a70258839","Type":"ContainerDied","Data":"82c28b3177b7cc45027d2c9a5f337df8594b9fcbc10d3a5d9aba6d58b9abde97"} Jun 11 21:52:39.461673 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.461320 2577 scope.go:117] "RemoveContainer" containerID="8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96" Jun 11 21:52:39.470463 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.470447 2577 scope.go:117] "RemoveContainer" containerID="8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96" Jun 11 21:52:39.470702 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:52:39.470682 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96\": container with ID starting with 8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96 not found: ID does not exist" containerID="8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96" Jun 11 21:52:39.470747 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.470710 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96"} err="failed to get container status \"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96\": rpc error: code = NotFound desc = could not find container \"8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96\": container with ID starting with 8a63cba043b2404015dcec99ceab0aff6288ed53242cfd067f19ad4ab2528a96 not found: ID does not exist" Jun 11 21:52:39.477665 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.477645 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:39.479393 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:39.479364 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-96rrk"] Jun 11 21:52:41.052658 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:41.052625 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f78164e-6027-4091-b10c-859a70258839" path="/var/lib/kubelet/pods/8f78164e-6027-4091-b10c-859a70258839/volumes" Jun 11 21:52:46.360133 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:46.360093 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:46.360552 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:46.360159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:46.382079 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:46.382042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:46.516505 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:46.516479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sgcjc" Jun 11 21:52:47.687750 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.687716 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g"] Jun 11 21:52:47.688141 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.688072 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f78164e-6027-4091-b10c-859a70258839" containerName="registry-server" Jun 11 21:52:47.688141 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.688084 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f78164e-6027-4091-b10c-859a70258839" containerName="registry-server" Jun 11 21:52:47.688207 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.688169 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f78164e-6027-4091-b10c-859a70258839" containerName="registry-server" Jun 11 21:52:47.692671 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.692652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.695116 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.695094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wdc69\"" Jun 11 21:52:47.698667 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.698643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g"] Jun 11 21:52:47.707600 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.707573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.707747 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.707616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv8p4\" (UniqueName: \"kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.707747 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.707693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.809000 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.808959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.809198 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.809045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.809198 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.809083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv8p4\" (UniqueName: \"kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.809384 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.809364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.809456 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.809400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:47.816977 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:47.816958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv8p4\" (UniqueName: \"kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:48.002855 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.002750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:48.135183 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.135156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g"] Jun 11 21:52:48.136703 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:48.136678 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a14d35_9bee_4f2c_8dc4_67d65d9f2d79.slice/crio-1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916 WatchSource:0}: Error finding container 1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916: Status 404 returned error can't find the container with id 1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916 Jun 11 21:52:48.280548 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.280517 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr"] Jun 11 21:52:48.283934 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.283917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.291554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.291531 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr"] Jun 11 21:52:48.314032 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.314004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbdz\" (UniqueName: \"kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.314177 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.314057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.314177 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.314116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.414573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.414539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.414573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.414576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.414813 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.414615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbdz\" (UniqueName: \"kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.414928 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.414905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.415010 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.414988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.422363 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.422337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbdz\" (UniqueName: \"kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.506008 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.505972 2577 generic.go:356] "Generic (PLEG): container finished" podID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerID="e8f2ed8d792c42db0e6affbf47b95fee1d6a6972bb3417581f185e38baa09a76" exitCode=0 Jun 11 21:52:48.506155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.506060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" event={"ID":"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79","Type":"ContainerDied","Data":"e8f2ed8d792c42db0e6affbf47b95fee1d6a6972bb3417581f185e38baa09a76"} Jun 11 21:52:48.506155 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.506109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" event={"ID":"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79","Type":"ContainerStarted","Data":"1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916"} Jun 11 21:52:48.625159 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.625125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:48.757142 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.757049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr"] Jun 11 21:52:48.759867 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:48.759837 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd399c058_4b6d_403e_b052_4a165a207572.slice/crio-cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc WatchSource:0}: Error finding container cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc: Status 404 returned error can't find the container with id cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc Jun 11 21:52:48.875386 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.875318 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t"] Jun 11 21:52:48.881167 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.881119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:48.886399 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.886373 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t"] Jun 11 21:52:48.919697 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.919667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zsp\" (UniqueName: \"kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:48.919825 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.919702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:48.919825 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:48.919800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.021006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.020970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.021158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.021029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zsp\" (UniqueName: \"kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.021158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.021075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.021381 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.021359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.021462 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.021388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.028796 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.028771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zsp\" (UniqueName: \"kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.210872 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.210794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:49.351588 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.351561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t"] Jun 11 21:52:49.352763 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:49.352730 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55165af3_4e24_4db6_a4fc_112d5999c574.slice/crio-1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9 WatchSource:0}: Error finding container 1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9: Status 404 returned error can't find the container with id 1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9 Jun 11 21:52:49.481568 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.481473 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c"] Jun 11 21:52:49.485473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.485447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.492269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.492238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c"] Jun 11 21:52:49.513036 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.513002 2577 generic.go:356] "Generic (PLEG): container finished" podID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerID="daf17926eef62f2ef26b7570699d05244c922c5514fd739eeee4305e010ea35f" exitCode=0 Jun 11 21:52:49.513204 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.513087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" event={"ID":"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79","Type":"ContainerDied","Data":"daf17926eef62f2ef26b7570699d05244c922c5514fd739eeee4305e010ea35f"} Jun 11 21:52:49.514660 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.514642 2577 generic.go:356] "Generic (PLEG): container finished" podID="d399c058-4b6d-403e-b052-4a165a207572" containerID="238b48ff7f52b1c937916505bef0ed6cc1b91c43bc71350ec4a084c7b2369352" exitCode=0 Jun 11 21:52:49.514747 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.514724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" event={"ID":"d399c058-4b6d-403e-b052-4a165a207572","Type":"ContainerDied","Data":"238b48ff7f52b1c937916505bef0ed6cc1b91c43bc71350ec4a084c7b2369352"} Jun 11 21:52:49.514808 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.514775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" event={"ID":"d399c058-4b6d-403e-b052-4a165a207572","Type":"ContainerStarted","Data":"cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc"} Jun 11 21:52:49.516358 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.516338 2577 generic.go:356] "Generic (PLEG): container finished" podID="55165af3-4e24-4db6-a4fc-112d5999c574" containerID="3f201a75fc74b6360f62689c25e58090027520ced1dd2df19e639fc8a499ef5f" exitCode=0 Jun 11 21:52:49.516358 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.516364 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" event={"ID":"55165af3-4e24-4db6-a4fc-112d5999c574","Type":"ContainerDied","Data":"3f201a75fc74b6360f62689c25e58090027520ced1dd2df19e639fc8a499ef5f"} Jun 11 21:52:49.516487 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.516393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" event={"ID":"55165af3-4e24-4db6-a4fc-112d5999c574","Type":"ContainerStarted","Data":"1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9"} Jun 11 21:52:49.526747 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.526726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.526838 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.526774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.526838 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.526798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbqh\" (UniqueName: \"kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.627889 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.627847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.628076 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.627945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.628076 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.628064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbqh\" (UniqueName: \"kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.628414 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.628395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.628471 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.628411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.639567 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.639478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbqh\" (UniqueName: \"kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.852748 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.852718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:49.986375 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:49.986340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c"] Jun 11 21:52:49.987600 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:52:49.987579 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed4208b_c537_4681_81f0_0d9aaa74d6a1.slice/crio-61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21 WatchSource:0}: Error finding container 61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21: Status 404 returned error can't find the container with id 61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21 Jun 11 21:52:50.524126 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.524030 2577 generic.go:356] "Generic (PLEG): container finished" podID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerID="6b755e3f28f62effb4a20aba93a1396732afe26a76c2d84356da4ad10df005b4" exitCode=0 Jun 11 21:52:50.524126 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.524093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" event={"ID":"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79","Type":"ContainerDied","Data":"6b755e3f28f62effb4a20aba93a1396732afe26a76c2d84356da4ad10df005b4"} Jun 11 21:52:50.525827 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.525807 2577 generic.go:356] "Generic (PLEG): container finished" podID="d399c058-4b6d-403e-b052-4a165a207572" containerID="bf5065a3753f33dbfa240c8399d9dbe2483d7928af86aefca208e9a523fd0b66" exitCode=0 Jun 11 21:52:50.525917 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.525895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" event={"ID":"d399c058-4b6d-403e-b052-4a165a207572","Type":"ContainerDied","Data":"bf5065a3753f33dbfa240c8399d9dbe2483d7928af86aefca208e9a523fd0b66"} Jun 11 21:52:50.527685 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.527664 2577 generic.go:356] "Generic (PLEG): container finished" podID="55165af3-4e24-4db6-a4fc-112d5999c574" containerID="31a03eb347f6a348a99d3d0f644f612ef79018ce9492cfd23c4f7b855f57441b" exitCode=0 Jun 11 21:52:50.527763 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.527738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" event={"ID":"55165af3-4e24-4db6-a4fc-112d5999c574","Type":"ContainerDied","Data":"31a03eb347f6a348a99d3d0f644f612ef79018ce9492cfd23c4f7b855f57441b"} Jun 11 21:52:50.529298 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.529252 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerID="e5634fc8296301637fc0d8366961396596338380ea1a8673bb43f639559f9098" exitCode=0 Jun 11 21:52:50.529368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.529307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" event={"ID":"8ed4208b-c537-4681-81f0-0d9aaa74d6a1","Type":"ContainerDied","Data":"e5634fc8296301637fc0d8366961396596338380ea1a8673bb43f639559f9098"} Jun 11 21:52:50.529368 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:50.529346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" event={"ID":"8ed4208b-c537-4681-81f0-0d9aaa74d6a1","Type":"ContainerStarted","Data":"61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21"} Jun 11 21:52:51.537333 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.537225 2577 generic.go:356] "Generic (PLEG): container finished" podID="d399c058-4b6d-403e-b052-4a165a207572" containerID="d351980e0f83fe5007cc41869ecb1c663079dcf4fa52cf512ccc7ada5822b588" exitCode=0 Jun 11 21:52:51.537333 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.537305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" event={"ID":"d399c058-4b6d-403e-b052-4a165a207572","Type":"ContainerDied","Data":"d351980e0f83fe5007cc41869ecb1c663079dcf4fa52cf512ccc7ada5822b588"} Jun 11 21:52:51.539345 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.539321 2577 generic.go:356] "Generic (PLEG): container finished" podID="55165af3-4e24-4db6-a4fc-112d5999c574" containerID="faf4cbce379e6ab0f7be2c490e5b3fc70e15daee71da277431983f531bf30e1c" exitCode=0 Jun 11 21:52:51.539460 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.539401 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" event={"ID":"55165af3-4e24-4db6-a4fc-112d5999c574","Type":"ContainerDied","Data":"faf4cbce379e6ab0f7be2c490e5b3fc70e15daee71da277431983f531bf30e1c"} Jun 11 21:52:51.541103 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.541081 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerID="617b9eca598aa52af08740f9b2aef0de329bb5b4722292afc416ec0a29c7d4e1" exitCode=0 Jun 11 21:52:51.541235 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.541109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" event={"ID":"8ed4208b-c537-4681-81f0-0d9aaa74d6a1","Type":"ContainerDied","Data":"617b9eca598aa52af08740f9b2aef0de329bb5b4722292afc416ec0a29c7d4e1"} Jun 11 21:52:51.746396 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.746371 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:51.854908 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.854879 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv8p4\" (UniqueName: \"kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4\") pod \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " Jun 11 21:52:51.855022 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.854929 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util\") pod \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " Jun 11 21:52:51.855022 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.854945 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle\") pod \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\" (UID: \"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79\") " Jun 11 21:52:51.855532 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.855501 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle" (OuterVolumeSpecName: "bundle") pod "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" (UID: "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:51.857093 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.857067 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4" (OuterVolumeSpecName: "kube-api-access-mv8p4") pod "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" (UID: "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79"). InnerVolumeSpecName "kube-api-access-mv8p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:51.860305 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.860231 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util" (OuterVolumeSpecName: "util") pod "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" (UID: "73a14d35-9bee-4f2c-8dc4-67d65d9f2d79"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:51.955766 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.955721 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv8p4\" (UniqueName: \"kubernetes.io/projected/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-kube-api-access-mv8p4\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:51.955766 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.955761 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:51.955766 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:51.955774 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73a14d35-9bee-4f2c-8dc4-67d65d9f2d79-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.548878 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.548837 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerID="c6feb25f3f7fc10d63e519b9696500ed3151b10ea57cd6a360f18dc3ed953350" exitCode=0 Jun 11 21:52:52.549340 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.548923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" event={"ID":"8ed4208b-c537-4681-81f0-0d9aaa74d6a1","Type":"ContainerDied","Data":"c6feb25f3f7fc10d63e519b9696500ed3151b10ea57cd6a360f18dc3ed953350"} Jun 11 21:52:52.550859 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.550837 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" Jun 11 21:52:52.550998 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.550869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g" event={"ID":"73a14d35-9bee-4f2c-8dc4-67d65d9f2d79","Type":"ContainerDied","Data":"1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916"} Jun 11 21:52:52.550998 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.550906 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bb08e42cf2e323ed03df6ac549e8ff25ff7225882744ab99ca4f0c86ba4e916" Jun 11 21:52:52.712715 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.712685 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:52.715430 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.715407 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:52.762269 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8zsp\" (UniqueName: \"kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp\") pod \"55165af3-4e24-4db6-a4fc-112d5999c574\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " Jun 11 21:52:52.762436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762301 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util\") pod \"d399c058-4b6d-403e-b052-4a165a207572\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " Jun 11 21:52:52.762436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762322 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util\") pod \"55165af3-4e24-4db6-a4fc-112d5999c574\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " Jun 11 21:52:52.762436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762351 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gbdz\" (UniqueName: \"kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz\") pod \"d399c058-4b6d-403e-b052-4a165a207572\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " Jun 11 21:52:52.762436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle\") pod \"d399c058-4b6d-403e-b052-4a165a207572\" (UID: \"d399c058-4b6d-403e-b052-4a165a207572\") " Jun 11 21:52:52.762436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.762408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle\") pod \"55165af3-4e24-4db6-a4fc-112d5999c574\" (UID: \"55165af3-4e24-4db6-a4fc-112d5999c574\") " Jun 11 21:52:52.763219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.763087 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle" (OuterVolumeSpecName: "bundle") pod "55165af3-4e24-4db6-a4fc-112d5999c574" (UID: "55165af3-4e24-4db6-a4fc-112d5999c574"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:52.763219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.763110 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle" (OuterVolumeSpecName: "bundle") pod "d399c058-4b6d-403e-b052-4a165a207572" (UID: "d399c058-4b6d-403e-b052-4a165a207572"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:52.765021 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.764997 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz" (OuterVolumeSpecName: "kube-api-access-8gbdz") pod "d399c058-4b6d-403e-b052-4a165a207572" (UID: "d399c058-4b6d-403e-b052-4a165a207572"). InnerVolumeSpecName "kube-api-access-8gbdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:52.765139 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.765032 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp" (OuterVolumeSpecName: "kube-api-access-c8zsp") pod "55165af3-4e24-4db6-a4fc-112d5999c574" (UID: "55165af3-4e24-4db6-a4fc-112d5999c574"). InnerVolumeSpecName "kube-api-access-c8zsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:52.768247 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.768219 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util" (OuterVolumeSpecName: "util") pod "55165af3-4e24-4db6-a4fc-112d5999c574" (UID: "55165af3-4e24-4db6-a4fc-112d5999c574"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:52.768907 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.768887 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util" (OuterVolumeSpecName: "util") pod "d399c058-4b6d-403e-b052-4a165a207572" (UID: "d399c058-4b6d-403e-b052-4a165a207572"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:52.863122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863084 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8zsp\" (UniqueName: \"kubernetes.io/projected/55165af3-4e24-4db6-a4fc-112d5999c574-kube-api-access-c8zsp\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.863122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863118 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.863122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863128 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.863372 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863138 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gbdz\" (UniqueName: \"kubernetes.io/projected/d399c058-4b6d-403e-b052-4a165a207572-kube-api-access-8gbdz\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.863372 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863149 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d399c058-4b6d-403e-b052-4a165a207572-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:52.863372 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:52.863157 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55165af3-4e24-4db6-a4fc-112d5999c574-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:53.558359 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.558329 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" Jun 11 21:52:53.558732 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.558337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr" event={"ID":"d399c058-4b6d-403e-b052-4a165a207572","Type":"ContainerDied","Data":"cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc"} Jun 11 21:52:53.558732 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.558451 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb06b5a3ef7c9dd141fa6300325910748cb40faf1374cc2ff68073951b4510bc" Jun 11 21:52:53.560429 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.560404 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" Jun 11 21:52:53.560429 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.560415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t" event={"ID":"55165af3-4e24-4db6-a4fc-112d5999c574","Type":"ContainerDied","Data":"1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9"} Jun 11 21:52:53.560648 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.560472 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b1f91e2ed3c2ee873f17b60372eeb4c2b4fbb4ca6150dacdff40fb689baa0a9" Jun 11 21:52:53.697638 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.697615 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:53.771371 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.771339 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle\") pod \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " Jun 11 21:52:53.771549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.771386 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psbqh\" (UniqueName: \"kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh\") pod \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " Jun 11 21:52:53.771549 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.771449 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util\") pod \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\" (UID: \"8ed4208b-c537-4681-81f0-0d9aaa74d6a1\") " Jun 11 21:52:53.771923 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.771895 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle" (OuterVolumeSpecName: "bundle") pod "8ed4208b-c537-4681-81f0-0d9aaa74d6a1" (UID: "8ed4208b-c537-4681-81f0-0d9aaa74d6a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:53.773737 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.773703 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh" (OuterVolumeSpecName: "kube-api-access-psbqh") pod "8ed4208b-c537-4681-81f0-0d9aaa74d6a1" (UID: "8ed4208b-c537-4681-81f0-0d9aaa74d6a1"). InnerVolumeSpecName "kube-api-access-psbqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:52:53.777116 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.777089 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util" (OuterVolumeSpecName: "util") pod "8ed4208b-c537-4681-81f0-0d9aaa74d6a1" (UID: "8ed4208b-c537-4681-81f0-0d9aaa74d6a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:52:53.872969 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.872925 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:53.872969 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.872965 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:53.873167 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:53.872980 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psbqh\" (UniqueName: \"kubernetes.io/projected/8ed4208b-c537-4681-81f0-0d9aaa74d6a1-kube-api-access-psbqh\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:52:54.567793 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:54.567765 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" Jun 11 21:52:54.568335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:54.567766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c" event={"ID":"8ed4208b-c537-4681-81f0-0d9aaa74d6a1","Type":"ContainerDied","Data":"61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21"} Jun 11 21:52:54.568335 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:52:54.567880 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61429840d039c51129f4cde54ef63c8363fd3316ddceeda31185ef9bc3e89f21" Jun 11 21:53:00.285663 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.285623 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh"] Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.285976 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="extract" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.285989 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="extract" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286001 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="pull" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286009 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="pull" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286018 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="pull" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286024 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="pull" Jun 11 21:53:00.286030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286031 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="pull" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286037 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="pull" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286047 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286051 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286058 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286063 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286068 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286078 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286093 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="pull" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286098 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="pull" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286105 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286109 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286115 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286120 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286126 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286131 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="util" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286136 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286141 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286201 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d399c058-4b6d-403e-b052-4a165a207572" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286210 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed4208b-c537-4681-81f0-0d9aaa74d6a1" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286215 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="55165af3-4e24-4db6-a4fc-112d5999c574" containerName="extract" Jun 11 21:53:00.286241 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.286221 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a14d35-9bee-4f2c-8dc4-67d65d9f2d79" containerName="extract" Jun 11 21:53:00.289329 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.289312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.292330 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.292308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xctks\"" Jun 11 21:53:00.303757 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.303730 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh"] Jun 11 21:53:00.431013 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.430968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.431013 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.431020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8h6\" (UniqueName: \"kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.532559 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.532519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.532559 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.532561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8h6\" (UniqueName: \"kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.532977 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.532955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.543077 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.543018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8h6\" (UniqueName: \"kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.599175 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.599139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:00.737666 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:00.737640 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh"] Jun 11 21:53:00.740225 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:00.740192 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016b2f62_de1c_4227_b757_2ef17e447307.slice/crio-5497c532cff1b0fcf644d377ce7e4dcc9a6fc1a111a0f6bd863cfca28aae13b4 WatchSource:0}: Error finding container 5497c532cff1b0fcf644d377ce7e4dcc9a6fc1a111a0f6bd863cfca28aae13b4: Status 404 returned error can't find the container with id 5497c532cff1b0fcf644d377ce7e4dcc9a6fc1a111a0f6bd863cfca28aae13b4 Jun 11 21:53:01.610139 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:01.610094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" event={"ID":"016b2f62-de1c-4227-b757-2ef17e447307","Type":"ContainerStarted","Data":"5497c532cff1b0fcf644d377ce7e4dcc9a6fc1a111a0f6bd863cfca28aae13b4"} Jun 11 21:53:05.720710 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.720672 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg"] Jun 11 21:53:05.724421 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.724388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:05.727043 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.727018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-b4sqv\"" Jun 11 21:53:05.727316 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.727275 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 21:53:05.735006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.734977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg"] Jun 11 21:53:05.878621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.878587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5r9f\" (UniqueName: \"kubernetes.io/projected/4e0d9111-c5be-41ea-ab25-0d6da8fb19ea-kube-api-access-n5r9f\") pod \"dns-operator-controller-manager-864dd78c4c-74dbg\" (UID: \"4e0d9111-c5be-41ea-ab25-0d6da8fb19ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:05.979247 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.979154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5r9f\" (UniqueName: \"kubernetes.io/projected/4e0d9111-c5be-41ea-ab25-0d6da8fb19ea-kube-api-access-n5r9f\") pod \"dns-operator-controller-manager-864dd78c4c-74dbg\" (UID: \"4e0d9111-c5be-41ea-ab25-0d6da8fb19ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:05.988012 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:05.987955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5r9f\" (UniqueName: \"kubernetes.io/projected/4e0d9111-c5be-41ea-ab25-0d6da8fb19ea-kube-api-access-n5r9f\") pod \"dns-operator-controller-manager-864dd78c4c-74dbg\" (UID: \"4e0d9111-c5be-41ea-ab25-0d6da8fb19ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:06.038835 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:06.038801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:06.168203 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:06.168175 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg"] Jun 11 21:53:06.169820 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:06.169786 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0d9111_c5be_41ea_ab25_0d6da8fb19ea.slice/crio-992d9c813df90ac9a0e18293e3a920a98cc91a8b27fef60e7e67282e99f72b5e WatchSource:0}: Error finding container 992d9c813df90ac9a0e18293e3a920a98cc91a8b27fef60e7e67282e99f72b5e: Status 404 returned error can't find the container with id 992d9c813df90ac9a0e18293e3a920a98cc91a8b27fef60e7e67282e99f72b5e Jun 11 21:53:06.640765 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:06.640718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" event={"ID":"4e0d9111-c5be-41ea-ab25-0d6da8fb19ea","Type":"ContainerStarted","Data":"992d9c813df90ac9a0e18293e3a920a98cc91a8b27fef60e7e67282e99f72b5e"} Jun 11 21:53:07.713962 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.713927 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh"] Jun 11 21:53:07.717692 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.717674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:07.720205 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.720188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-spcgp\"" Jun 11 21:53:07.726328 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.726301 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh"] Jun 11 21:53:07.806374 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.806337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tsjq\" (UniqueName: \"kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq\") pod \"limitador-operator-controller-manager-859d7b78bd-kdszh\" (UID: \"616bc40e-e4ef-4f3d-aa30-d9aef120d433\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:07.907645 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.907599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tsjq\" (UniqueName: \"kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq\") pod \"limitador-operator-controller-manager-859d7b78bd-kdszh\" (UID: \"616bc40e-e4ef-4f3d-aa30-d9aef120d433\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:07.917680 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:07.917646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tsjq\" (UniqueName: \"kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq\") pod \"limitador-operator-controller-manager-859d7b78bd-kdszh\" (UID: \"616bc40e-e4ef-4f3d-aa30-d9aef120d433\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:08.031242 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.031220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:08.184443 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.181971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh"] Jun 11 21:53:08.186489 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:08.186455 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616bc40e_e4ef_4f3d_aa30_d9aef120d433.slice/crio-292fefadcacfe2f560d40c637170f05d09e35ed5612a2a506741204aa755ee4e WatchSource:0}: Error finding container 292fefadcacfe2f560d40c637170f05d09e35ed5612a2a506741204aa755ee4e: Status 404 returned error can't find the container with id 292fefadcacfe2f560d40c637170f05d09e35ed5612a2a506741204aa755ee4e Jun 11 21:53:08.655432 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.655385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" event={"ID":"616bc40e-e4ef-4f3d-aa30-d9aef120d433","Type":"ContainerStarted","Data":"292fefadcacfe2f560d40c637170f05d09e35ed5612a2a506741204aa755ee4e"} Jun 11 21:53:08.657605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.657571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" event={"ID":"016b2f62-de1c-4227-b757-2ef17e447307","Type":"ContainerStarted","Data":"e823181e1a5000e20e5d119a34e770e75c85279934e6e12006631ce804b5a2ac"} Jun 11 21:53:08.657805 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.657712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:08.679029 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:08.678979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" podStartSLOduration=1.401218716 podStartE2EDuration="8.678962411s" totalImagesPullingTime="7.277743695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:08.677679173 +0000 UTC m=+636.021904286" watchObservedRunningTime="2026-06-11 21:53:08.678962411 +0000 UTC m=+636.023187503" Jun 11 21:53:10.671507 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.671460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" event={"ID":"616bc40e-e4ef-4f3d-aa30-d9aef120d433","Type":"ContainerStarted","Data":"b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1"} Jun 11 21:53:10.671972 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.671538 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:10.673370 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.673343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" event={"ID":"4e0d9111-c5be-41ea-ab25-0d6da8fb19ea","Type":"ContainerStarted","Data":"f7e92d32b9a7f5c58180a478fb5ad46f806d2458cc4bae43971d2472863929f1"} Jun 11 21:53:10.673455 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.673392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:10.688955 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.688911 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" podStartSLOduration=1.598149831 podStartE2EDuration="3.688896532s" totalImagesPullingTime="2.090746701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:10.688134764 +0000 UTC m=+638.032359881" watchObservedRunningTime="2026-06-11 21:53:10.688896532 +0000 UTC m=+638.033121618" Jun 11 21:53:10.704494 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:10.704442 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" podStartSLOduration=1.599731882 podStartE2EDuration="5.704424935s" totalImagesPullingTime="4.104693053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:10.703013489 +0000 UTC m=+638.047238628" watchObservedRunningTime="2026-06-11 21:53:10.704424935 +0000 UTC m=+638.048650026" Jun 11 21:53:11.111915 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.111825 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd"] Jun 11 21:53:11.119201 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.119179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.121713 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.121690 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 21:53:11.121833 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.121715 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wdc69\"" Jun 11 21:53:11.121833 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.121774 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 21:53:11.122942 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.122916 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd"] Jun 11 21:53:11.236369 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.236332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2423d66c-2957-49cb-996e-dc6b959105ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.236369 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.236368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kj67\" (UniqueName: \"kubernetes.io/projected/2423d66c-2957-49cb-996e-dc6b959105ea-kube-api-access-2kj67\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.236592 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.236395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2423d66c-2957-49cb-996e-dc6b959105ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.337316 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.337236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2423d66c-2957-49cb-996e-dc6b959105ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.337316 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.337309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kj67\" (UniqueName: \"kubernetes.io/projected/2423d66c-2957-49cb-996e-dc6b959105ea-kube-api-access-2kj67\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.337573 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.337341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2423d66c-2957-49cb-996e-dc6b959105ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.337897 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.337875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2423d66c-2957-49cb-996e-dc6b959105ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.339765 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.339743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2423d66c-2957-49cb-996e-dc6b959105ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.344906 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.344886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kj67\" (UniqueName: \"kubernetes.io/projected/2423d66c-2957-49cb-996e-dc6b959105ea-kube-api-access-2kj67\") pod \"kuadrant-console-plugin-66b5774985-fppkd\" (UID: \"2423d66c-2957-49cb-996e-dc6b959105ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.430061 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.429957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" Jun 11 21:53:11.560408 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.560383 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd"] Jun 11 21:53:11.561848 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:11.561819 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2423d66c_2957_49cb_996e_dc6b959105ea.slice/crio-099d7233d65a1b5b7061e89140613d363ea6a12a3e350338dde034f9cc57a42f WatchSource:0}: Error finding container 099d7233d65a1b5b7061e89140613d363ea6a12a3e350338dde034f9cc57a42f: Status 404 returned error can't find the container with id 099d7233d65a1b5b7061e89140613d363ea6a12a3e350338dde034f9cc57a42f Jun 11 21:53:11.679621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:11.679585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" event={"ID":"2423d66c-2957-49cb-996e-dc6b959105ea","Type":"ContainerStarted","Data":"099d7233d65a1b5b7061e89140613d363ea6a12a3e350338dde034f9cc57a42f"} Jun 11 21:53:19.666556 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:19.666523 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:21.426610 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.426561 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh"] Jun 11 21:53:21.427062 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.426817 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" podUID="016b2f62-de1c-4227-b757-2ef17e447307" containerName="manager" containerID="cri-o://e823181e1a5000e20e5d119a34e770e75c85279934e6e12006631ce804b5a2ac" gracePeriod=2 Jun 11 21:53:21.434642 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.434570 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh"] Jun 11 21:53:21.447242 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.447208 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh"] Jun 11 21:53:21.447486 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.447460 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" containerName="manager" containerID="cri-o://b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1" gracePeriod=2 Jun 11 21:53:21.449439 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.449402 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:21.450008 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.449985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:21.461626 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.461599 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh"] Jun 11 21:53:21.467169 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.467132 2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"616bc40e-e4ef-4f3d-aa30-d9aef120d433\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-kdszh\": pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:21.468441 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.468399 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd"] Jun 11 21:53:21.468886 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.468867 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016b2f62-de1c-4227-b757-2ef17e447307" containerName="manager" Jun 11 21:53:21.468962 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.468890 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="016b2f62-de1c-4227-b757-2ef17e447307" containerName="manager" Jun 11 21:53:21.468962 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.468901 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" containerName="manager" Jun 11 21:53:21.468962 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.468910 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" containerName="manager" Jun 11 21:53:21.469114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.469021 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" containerName="manager" Jun 11 21:53:21.469114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.469037 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="016b2f62-de1c-4227-b757-2ef17e447307" containerName="manager" Jun 11 21:53:21.469532 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.469391 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:21.471627 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.471600 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:21.472473 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.472454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:21.474869 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.474827 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:21.476602 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.476578 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:21.484010 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.483988 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd"] Jun 11 21:53:21.636054 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.636018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8l7\" (UniqueName: \"kubernetes.io/projected/e836c071-9385-4170-be86-6e541236f11d-kube-api-access-cz8l7\") pod \"limitador-operator-controller-manager-859d7b78bd-xksmd\" (UID: \"e836c071-9385-4170-be86-6e541236f11d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:21.682308 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.682208 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-74dbg" Jun 11 21:53:21.710609 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.710552 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:21.712555 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:21.712509 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:21.737158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.737108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8l7\" (UniqueName: \"kubernetes.io/projected/e836c071-9385-4170-be86-6e541236f11d-kube-api-access-cz8l7\") pod \"limitador-operator-controller-manager-859d7b78bd-xksmd\" (UID: \"e836c071-9385-4170-be86-6e541236f11d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:21.746764 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.746642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8l7\" (UniqueName: \"kubernetes.io/projected/e836c071-9385-4170-be86-6e541236f11d-kube-api-access-cz8l7\") pod \"limitador-operator-controller-manager-859d7b78bd-xksmd\" (UID: \"e836c071-9385-4170-be86-6e541236f11d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:21.871035 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:21.870998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:22.495614 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.495573 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8"] Jun 11 21:53:22.510114 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.510078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.514866 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:22.514822 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:22.516745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.516664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8"] Jun 11 21:53:22.544786 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.544717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2040579-b8b6-42d8-b041-1d82fc320ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.545030 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.544819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgtw8\" (UniqueName: \"kubernetes.io/projected/e2040579-b8b6-42d8-b041-1d82fc320ead-kube-api-access-bgtw8\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.546976 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:22.546935 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:22.645586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.645540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2040579-b8b6-42d8-b041-1d82fc320ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.645781 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.645621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgtw8\" (UniqueName: \"kubernetes.io/projected/e2040579-b8b6-42d8-b041-1d82fc320ead-kube-api-access-bgtw8\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.645973 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.645945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2040579-b8b6-42d8-b041-1d82fc320ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.658554 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.658513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgtw8\" (UniqueName: \"kubernetes.io/projected/e2040579-b8b6-42d8-b041-1d82fc320ead-kube-api-access-bgtw8\") pod \"kuadrant-operator-controller-manager-86878c769f-5jwk8\" (UID: \"e2040579-b8b6-42d8-b041-1d82fc320ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:22.825013 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:22.824912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:23.052815 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:23.052769 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:23.054682 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:23.054643 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:26.424132 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:26.424091 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:53:34.838680 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.838642 2577 generic.go:356] "Generic (PLEG): container finished" podID="016b2f62-de1c-4227-b757-2ef17e447307" containerID="e823181e1a5000e20e5d119a34e770e75c85279934e6e12006631ce804b5a2ac" exitCode=0 Jun 11 21:53:34.840474 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.840432 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:34.842005 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.841974 2577 generic.go:356] "Generic (PLEG): container finished" podID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" containerID="b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1" exitCode=0 Jun 11 21:53:34.842122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.842027 2577 scope.go:117] "RemoveContainer" containerID="b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1" Jun 11 21:53:34.842561 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:34.842527 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:34.856609 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.856583 2577 scope.go:117] "RemoveContainer" containerID="b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1" Jun 11 21:53:34.856968 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:34.856918 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1\": container with ID starting with b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1 not found: ID does not exist" containerID="b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1" Jun 11 21:53:34.857124 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.856956 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1"} err="failed to get container status \"b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1\": rpc error: code = NotFound desc = could not find container \"b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1\": container with ID starting with b38f5675ed1072b2268ebbba8d3a0bded4129f3d3efabe5f1a515a75bedb59b1 not found: ID does not exist" Jun 11 21:53:34.858109 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.858083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8"] Jun 11 21:53:34.858878 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:34.858780 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2040579_b8b6_42d8_b041_1d82fc320ead.slice/crio-29a0ccf3f62e78dbcfc8f0563936a4846ebc482bad99e881848e727020cd3cce WatchSource:0}: Error finding container 29a0ccf3f62e78dbcfc8f0563936a4846ebc482bad99e881848e727020cd3cce: Status 404 returned error can't find the container with id 29a0ccf3f62e78dbcfc8f0563936a4846ebc482bad99e881848e727020cd3cce Jun 11 21:53:34.862797 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.862777 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:34.864746 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:34.864724 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:34.866686 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:34.866660 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:34.876310 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.876255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd"] Jun 11 21:53:34.877996 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:53:34.877965 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode836c071_9385_4170_be86_6e541236f11d.slice/crio-c92166b48c287e6ea8a4d990bf2083018685b271c7bd58bb090260fea650cf19 WatchSource:0}: Error finding container c92166b48c287e6ea8a4d990bf2083018685b271c7bd58bb090260fea650cf19: Status 404 returned error can't find the container with id c92166b48c287e6ea8a4d990bf2083018685b271c7bd58bb090260fea650cf19 Jun 11 21:53:34.956515 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.956484 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume\") pod \"016b2f62-de1c-4227-b757-2ef17e447307\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " Jun 11 21:53:34.956702 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.956545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt8h6\" (UniqueName: \"kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6\") pod \"016b2f62-de1c-4227-b757-2ef17e447307\" (UID: \"016b2f62-de1c-4227-b757-2ef17e447307\") " Jun 11 21:53:34.956702 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.956608 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tsjq\" (UniqueName: \"kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq\") pod \"616bc40e-e4ef-4f3d-aa30-d9aef120d433\" (UID: \"616bc40e-e4ef-4f3d-aa30-d9aef120d433\") " Jun 11 21:53:34.957036 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.957010 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "016b2f62-de1c-4227-b757-2ef17e447307" (UID: "016b2f62-de1c-4227-b757-2ef17e447307"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:53:34.958660 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.958639 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq" (OuterVolumeSpecName: "kube-api-access-6tsjq") pod "616bc40e-e4ef-4f3d-aa30-d9aef120d433" (UID: "616bc40e-e4ef-4f3d-aa30-d9aef120d433"). InnerVolumeSpecName "kube-api-access-6tsjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:53:34.958729 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:34.958687 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6" (OuterVolumeSpecName: "kube-api-access-mt8h6") pod "016b2f62-de1c-4227-b757-2ef17e447307" (UID: "016b2f62-de1c-4227-b757-2ef17e447307"). InnerVolumeSpecName "kube-api-access-mt8h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:53:35.053398 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.053366 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016b2f62-de1c-4227-b757-2ef17e447307" path="/var/lib/kubelet/pods/016b2f62-de1c-4227-b757-2ef17e447307/volumes" Jun 11 21:53:35.053729 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.053712 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" path="/var/lib/kubelet/pods/616bc40e-e4ef-4f3d-aa30-d9aef120d433/volumes" Jun 11 21:53:35.057461 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.057429 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016b2f62-de1c-4227-b757-2ef17e447307-extensions-socket-volume\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:35.057461 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.057458 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt8h6\" (UniqueName: \"kubernetes.io/projected/016b2f62-de1c-4227-b757-2ef17e447307-kube-api-access-mt8h6\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:35.057783 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.057473 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tsjq\" (UniqueName: \"kubernetes.io/projected/616bc40e-e4ef-4f3d-aa30-d9aef120d433-kube-api-access-6tsjq\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:35.848206 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.848177 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:35.850019 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.849988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" event={"ID":"2423d66c-2957-49cb-996e-dc6b959105ea","Type":"ContainerStarted","Data":"e3b6a08e53596f52dc13824eb1823debc7d9efd60fa029eab4ecd1c2e6c17ad5"} Jun 11 21:53:35.850575 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:35.850547 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:35.851815 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.851793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" event={"ID":"e2040579-b8b6-42d8-b041-1d82fc320ead","Type":"ContainerStarted","Data":"ec4480fffe7ea79a9d421ad488f10641f5ee5e1ece1c492b0adaf2949011eee0"} Jun 11 21:53:35.851922 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.851868 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" event={"ID":"e2040579-b8b6-42d8-b041-1d82fc320ead","Type":"ContainerStarted","Data":"29a0ccf3f62e78dbcfc8f0563936a4846ebc482bad99e881848e727020cd3cce"} Jun 11 21:53:35.851922 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.851894 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:35.852539 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:35.852511 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:35.853419 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.853396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" event={"ID":"e836c071-9385-4170-be86-6e541236f11d","Type":"ContainerStarted","Data":"66f97d805143f2eeb866b5d53a9bf2c59c9b0073d404a1a736365c3b996b5dad"} Jun 11 21:53:35.853503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.853445 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:35.853503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.853461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" event={"ID":"e836c071-9385-4170-be86-6e541236f11d","Type":"ContainerStarted","Data":"c92166b48c287e6ea8a4d990bf2083018685b271c7bd58bb090260fea650cf19"} Jun 11 21:53:35.854510 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.854495 2577 scope.go:117] "RemoveContainer" containerID="e823181e1a5000e20e5d119a34e770e75c85279934e6e12006631ce804b5a2ac" Jun 11 21:53:35.854600 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.854496 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:35.868547 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.868496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fppkd" podStartSLOduration=1.654967482 podStartE2EDuration="24.868479419s" totalImagesPullingTime="23.213511937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:35.86679573 +0000 UTC m=+663.211020822" watchObservedRunningTime="2026-06-11 21:53:35.868479419 +0000 UTC m=+663.212704511" Jun 11 21:53:35.868772 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:35.868746 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xgnkh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="016b2f62-de1c-4227-b757-2ef17e447307" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xgnkh" Jun 11 21:53:35.887178 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:35.887137 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kdszh\" is forbidden: User \"system:node:ip-10-0-138-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-118.ec2.internal' and this object" podUID="616bc40e-e4ef-4f3d-aa30-d9aef120d433" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kdszh" Jun 11 21:53:35.911033 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.910973 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" podStartSLOduration=14.910953321000001 podStartE2EDuration="14.910953321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:35.885139098 +0000 UTC m=+663.229364192" watchObservedRunningTime="2026-06-11 21:53:35.910953321 +0000 UTC m=+663.255178414" Jun 11 21:53:35.911213 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:35.911159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" podStartSLOduration=13.91114733 podStartE2EDuration="13.91114733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:35.910362161 +0000 UTC m=+663.254587279" watchObservedRunningTime="2026-06-11 21:53:35.91114733 +0000 UTC m=+663.255372422" Jun 11 21:53:46.863937 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:46.863898 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xksmd" Jun 11 21:53:46.864568 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:46.863995 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jwk8" Jun 11 21:53:51.446910 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.446861 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-798f55fdb9-krr5h" podUID="2fa24895-463e-4666-a5ae-f64c6769e031" containerName="console" containerID="cri-o://58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94" gracePeriod=15 Jun 11 21:53:51.697945 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.697886 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:53:51.807981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.807949 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.807981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.807982 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808017 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndqsp\" (UniqueName: \"kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808108 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808133 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808230 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808154 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca\") pod \"2fa24895-463e-4666-a5ae-f64c6769e031\" (UID: \"2fa24895-463e-4666-a5ae-f64c6769e031\") " Jun 11 21:53:51.808522 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808441 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config" (OuterVolumeSpecName: "console-config") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:53:51.808607 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808484 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:53:51.808750 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808718 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:53:51.808867 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.808802 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:53:51.810532 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.810503 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:53:51.810628 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.810582 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp" (OuterVolumeSpecName: "kube-api-access-ndqsp") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "kube-api-access-ndqsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:53:51.810670 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.810625 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fa24895-463e-4666-a5ae-f64c6769e031" (UID: "2fa24895-463e-4666-a5ae-f64c6769e031"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:53:51.909406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909359 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-console-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909396 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-oauth-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909407 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-oauth-config\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909406 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909415 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndqsp\" (UniqueName: \"kubernetes.io/projected/2fa24895-463e-4666-a5ae-f64c6769e031-kube-api-access-ndqsp\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909697 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909424 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fa24895-463e-4666-a5ae-f64c6769e031-console-serving-cert\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909697 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909433 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-trusted-ca-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.909697 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.909440 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa24895-463e-4666-a5ae-f64c6769e031-service-ca\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:53:51.945660 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.945625 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa24895-463e-4666-a5ae-f64c6769e031" containerID="58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94" exitCode=0 Jun 11 21:53:51.945871 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.945687 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f55fdb9-krr5h" Jun 11 21:53:51.945871 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.945722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f55fdb9-krr5h" event={"ID":"2fa24895-463e-4666-a5ae-f64c6769e031","Type":"ContainerDied","Data":"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94"} Jun 11 21:53:51.945871 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.945787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f55fdb9-krr5h" event={"ID":"2fa24895-463e-4666-a5ae-f64c6769e031","Type":"ContainerDied","Data":"86031c7097fdedfb2ea155b5d5ac1cc0d7fb97c1e12b11f6206f42ccf03a4f75"} Jun 11 21:53:51.945871 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.945813 2577 scope.go:117] "RemoveContainer" containerID="58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94" Jun 11 21:53:51.956883 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.956860 2577 scope.go:117] "RemoveContainer" containerID="58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94" Jun 11 21:53:51.957272 ip-10-0-138-118 kubenswrapper[2577]: E0611 21:53:51.957251 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94\": container with ID starting with 58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94 not found: ID does not exist" containerID="58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94" Jun 11 21:53:51.957384 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.957308 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94"} err="failed to get container status \"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94\": rpc error: code = NotFound desc = could not find container \"58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94\": container with ID starting with 58f1fb28221e2154653c563a690e5a047868be872fbc6cec4b20013bab8e2f94 not found: ID does not exist" Jun 11 21:53:51.970126 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.970086 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:53:51.974709 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:51.974670 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798f55fdb9-krr5h"] Jun 11 21:53:53.052954 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:53:53.052910 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa24895-463e-4666-a5ae-f64c6769e031" path="/var/lib/kubelet/pods/2fa24895-463e-4666-a5ae-f64c6769e031/volumes" Jun 11 21:54:07.977802 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:07.977764 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bxfr"] Jun 11 21:54:07.978272 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:07.978127 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa24895-463e-4666-a5ae-f64c6769e031" containerName="console" Jun 11 21:54:07.978272 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:07.978138 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa24895-463e-4666-a5ae-f64c6769e031" containerName="console" Jun 11 21:54:07.978272 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:07.978195 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa24895-463e-4666-a5ae-f64c6769e031" containerName="console" Jun 11 21:54:08.031876 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.031842 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bxfr"] Jun 11 21:54:08.031876 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.031879 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bxfr"] Jun 11 21:54:08.032137 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.031965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.034556 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.034521 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 21:54:08.055219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.055195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a5babdae-21a8-4193-928c-7b258180307f-config-file\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.055380 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.055240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnk8l\" (UniqueName: \"kubernetes.io/projected/a5babdae-21a8-4193-928c-7b258180307f-kube-api-access-jnk8l\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.156071 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.156012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnk8l\" (UniqueName: \"kubernetes.io/projected/a5babdae-21a8-4193-928c-7b258180307f-kube-api-access-jnk8l\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.156258 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.156122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a5babdae-21a8-4193-928c-7b258180307f-config-file\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.156734 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.156713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a5babdae-21a8-4193-928c-7b258180307f-config-file\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.163723 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.163689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnk8l\" (UniqueName: \"kubernetes.io/projected/a5babdae-21a8-4193-928c-7b258180307f-kube-api-access-jnk8l\") pod \"limitador-limitador-54d6d988d5-9bxfr\" (UID: \"a5babdae-21a8-4193-928c-7b258180307f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.343542 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.343446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:08.482503 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:08.482470 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bxfr"] Jun 11 21:54:08.483829 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:54:08.483799 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5babdae_21a8_4193_928c_7b258180307f.slice/crio-2c1165b10b9ebb7a27900de675954bdbd4d6cd00234a79b96f20a9f583681d13 WatchSource:0}: Error finding container 2c1165b10b9ebb7a27900de675954bdbd4d6cd00234a79b96f20a9f583681d13: Status 404 returned error can't find the container with id 2c1165b10b9ebb7a27900de675954bdbd4d6cd00234a79b96f20a9f583681d13 Jun 11 21:54:09.058165 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:09.058097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" event={"ID":"a5babdae-21a8-4193-928c-7b258180307f","Type":"ContainerStarted","Data":"2c1165b10b9ebb7a27900de675954bdbd4d6cd00234a79b96f20a9f583681d13"} Jun 11 21:54:11.071955 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:11.071909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" event={"ID":"a5babdae-21a8-4193-928c-7b258180307f","Type":"ContainerStarted","Data":"4ae16cee009e4571a9cdf127327100f0277ff045d42a3a31a3ba502bc5138a97"} Jun 11 21:54:11.072374 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:11.072020 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:11.090795 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:11.090741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" podStartSLOduration=1.66057046 podStartE2EDuration="4.090728732s" totalImagesPullingTime="2.430158272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:54:11.089091174 +0000 UTC m=+698.433316294" watchObservedRunningTime="2026-06-11 21:54:11.090728732 +0000 UTC m=+698.434953822" Jun 11 21:54:22.078464 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:22.078431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bxfr" Jun 11 21:54:35.318488 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.318454 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r"] Jun 11 21:54:35.323671 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.323649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.326485 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.326448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:54:35.327558 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.327543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:54:35.327558 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.327551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqxp8\"" Jun 11 21:54:35.333051 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.333024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r"] Jun 11 21:54:35.392767 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.392734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdcnz\" (UniqueName: \"kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.392955 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.392787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.392955 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.392808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.494118 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.494077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdcnz\" (UniqueName: \"kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.494323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.494138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.494323 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.494168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.494655 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.494632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.494716 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.494642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.503688 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.503667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdcnz\" (UniqueName: \"kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.634010 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.633972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:35.775447 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:54:35.775410 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b098d2_fd66_4261_8c75_ef3ed170b91e.slice/crio-fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64 WatchSource:0}: Error finding container fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64: Status 404 returned error can't find the container with id fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64 Jun 11 21:54:35.775784 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:35.775762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r"] Jun 11 21:54:36.222533 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:36.222499 2577 generic.go:356] "Generic (PLEG): container finished" podID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerID="0b4c891ee0cf531bd0ee10e9bb5787d06923ca3b4fabb8c6764a755fb7bc68f7" exitCode=0 Jun 11 21:54:36.222717 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:36.222544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" event={"ID":"40b098d2-fd66-4261-8c75-ef3ed170b91e","Type":"ContainerDied","Data":"0b4c891ee0cf531bd0ee10e9bb5787d06923ca3b4fabb8c6764a755fb7bc68f7"} Jun 11 21:54:36.222717 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:36.222605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" event={"ID":"40b098d2-fd66-4261-8c75-ef3ed170b91e","Type":"ContainerStarted","Data":"fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64"} Jun 11 21:54:37.229964 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:37.229930 2577 generic.go:356] "Generic (PLEG): container finished" podID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerID="18b288f30efec2fd2e94355bfe7f626c33c8fba3b0f936d69e1801df8f216799" exitCode=0 Jun 11 21:54:37.230423 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:37.230009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" event={"ID":"40b098d2-fd66-4261-8c75-ef3ed170b91e","Type":"ContainerDied","Data":"18b288f30efec2fd2e94355bfe7f626c33c8fba3b0f936d69e1801df8f216799"} Jun 11 21:54:38.237981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:38.237948 2577 generic.go:356] "Generic (PLEG): container finished" podID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerID="b95fbfd912140ed4222395e35f950cff36de7684274a5d378c9e7d6966be3d1d" exitCode=0 Jun 11 21:54:38.238402 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:38.238010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" event={"ID":"40b098d2-fd66-4261-8c75-ef3ed170b91e","Type":"ContainerDied","Data":"b95fbfd912140ed4222395e35f950cff36de7684274a5d378c9e7d6966be3d1d"} Jun 11 21:54:39.381326 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.381299 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:39.533541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.533439 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdcnz\" (UniqueName: \"kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz\") pod \"40b098d2-fd66-4261-8c75-ef3ed170b91e\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " Jun 11 21:54:39.533541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.533489 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util\") pod \"40b098d2-fd66-4261-8c75-ef3ed170b91e\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " Jun 11 21:54:39.533541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.533532 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle\") pod \"40b098d2-fd66-4261-8c75-ef3ed170b91e\" (UID: \"40b098d2-fd66-4261-8c75-ef3ed170b91e\") " Jun 11 21:54:39.534031 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.534003 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle" (OuterVolumeSpecName: "bundle") pod "40b098d2-fd66-4261-8c75-ef3ed170b91e" (UID: "40b098d2-fd66-4261-8c75-ef3ed170b91e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:54:39.535537 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.535516 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz" (OuterVolumeSpecName: "kube-api-access-kdcnz") pod "40b098d2-fd66-4261-8c75-ef3ed170b91e" (UID: "40b098d2-fd66-4261-8c75-ef3ed170b91e"). InnerVolumeSpecName "kube-api-access-kdcnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:54:39.539066 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.539031 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util" (OuterVolumeSpecName: "util") pod "40b098d2-fd66-4261-8c75-ef3ed170b91e" (UID: "40b098d2-fd66-4261-8c75-ef3ed170b91e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:54:39.634586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.634551 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-util\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:54:39.634586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.634583 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b098d2-fd66-4261-8c75-ef3ed170b91e-bundle\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:54:39.634586 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:39.634592 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdcnz\" (UniqueName: \"kubernetes.io/projected/40b098d2-fd66-4261-8c75-ef3ed170b91e-kube-api-access-kdcnz\") on node \"ip-10-0-138-118.ec2.internal\" DevicePath \"\"" Jun 11 21:54:40.250058 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:40.250026 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" Jun 11 21:54:40.250058 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:40.250039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489hn5r" event={"ID":"40b098d2-fd66-4261-8c75-ef3ed170b91e","Type":"ContainerDied","Data":"fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64"} Jun 11 21:54:40.250292 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:54:40.250082 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbd187f0aae1d7ff3243331da2e37ad38946f4fbe435315cb5f6eb4136627c64" Jun 11 21:57:36.600044 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:36.600017 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d74697646-nbh7s_7eb93467-cf5a-472e-afed-ddf034596f63/nginx/0.log" Jun 11 21:57:37.749490 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:37.749458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h_71091d4c-8474-4244-8027-3e2ae75b663f/copy-manifests/0.log" Jun 11 21:57:37.755787 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:37.755761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h_71091d4c-8474-4244-8027-3e2ae75b663f/manager/0.log" Jun 11 21:57:38.538689 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.538657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/util/0.log" Jun 11 21:57:38.544588 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.544566 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/pull/0.log" Jun 11 21:57:38.550016 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.549996 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/extract/0.log" Jun 11 21:57:38.659045 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.659011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/util/0.log" Jun 11 21:57:38.664941 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.664917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/pull/0.log" Jun 11 21:57:38.670005 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.669984 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/extract/0.log" Jun 11 21:57:38.774560 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.774528 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/util/0.log" Jun 11 21:57:38.780708 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.780685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/pull/0.log" Jun 11 21:57:38.790869 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.790782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/extract/0.log" Jun 11 21:57:38.896489 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.896459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/extract/0.log" Jun 11 21:57:38.902159 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.902136 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/util/0.log" Jun 11 21:57:38.908193 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:38.908173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/pull/0.log" Jun 11 21:57:39.235359 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.235328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-74dbg_4e0d9111-c5be-41ea-ab25-0d6da8fb19ea/manager/0.log" Jun 11 21:57:39.345903 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.345878 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fppkd_2423d66c-2957-49cb-996e-dc6b959105ea/kuadrant-console-plugin/0.log" Jun 11 21:57:39.458086 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.458055 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sgcjc_086e730e-d87c-42b9-b5a6-e26cb441b673/registry-server/0.log" Jun 11 21:57:39.574538 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.574446 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jwk8_e2040579-b8b6-42d8-b041-1d82fc320ead/manager/0.log" Jun 11 21:57:39.680135 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.680096 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9bxfr_a5babdae-21a8-4193-928c-7b258180307f/limitador/0.log" Jun 11 21:57:39.789937 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:39.789899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xksmd_e836c071-9385-4170-be86-6e541236f11d/manager/0.log" Jun 11 21:57:40.122124 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:40.122086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795jnrw6_4917a70e-fd3e-4b2c-aaa7-cafbf3370560/istio-proxy/0.log" Jun 11 21:57:44.798144 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798109 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fcg/must-gather-5799z"] Jun 11 21:57:44.798543 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798527 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="util" Jun 11 21:57:44.798601 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798546 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="util" Jun 11 21:57:44.798601 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798562 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="pull" Jun 11 21:57:44.798601 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798567 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="pull" Jun 11 21:57:44.798601 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798579 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="extract" Jun 11 21:57:44.798601 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798585 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="extract" Jun 11 21:57:44.798761 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.798657 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b098d2-fd66-4261-8c75-ef3ed170b91e" containerName="extract" Jun 11 21:57:44.801873 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.801853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:44.804189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.804165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fcg\"/\"kube-root-ca.crt\"" Jun 11 21:57:44.804317 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.804179 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fcg\"/\"openshift-service-ca.crt\"" Jun 11 21:57:44.805348 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.805256 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6fcg\"/\"default-dockercfg-sbjrx\"" Jun 11 21:57:44.808812 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.808787 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/must-gather-5799z"] Jun 11 21:57:44.925788 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.925752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-must-gather-output\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:44.925987 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:44.925912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kkrp\" (UniqueName: \"kubernetes.io/projected/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-kube-api-access-9kkrp\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.027307 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.027241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-must-gather-output\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.027509 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.027400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kkrp\" (UniqueName: \"kubernetes.io/projected/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-kube-api-access-9kkrp\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.027604 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.027583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-must-gather-output\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.035227 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.035193 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kkrp\" (UniqueName: \"kubernetes.io/projected/c9cb7f24-4a65-4967-ba1a-cfd1b29046e0-kube-api-access-9kkrp\") pod \"must-gather-5799z\" (UID: \"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0\") " pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.112959 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.112927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/must-gather-5799z" Jun 11 21:57:45.260701 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.260670 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/must-gather-5799z"] Jun 11 21:57:45.261812 ip-10-0-138-118 kubenswrapper[2577]: W0611 21:57:45.261785 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9cb7f24_4a65_4967_ba1a_cfd1b29046e0.slice/crio-a1b493af630167f902a4f7e489adb17aabb93f23cf8aa94061e5cf57cc72bf74 WatchSource:0}: Error finding container a1b493af630167f902a4f7e489adb17aabb93f23cf8aa94061e5cf57cc72bf74: Status 404 returned error can't find the container with id a1b493af630167f902a4f7e489adb17aabb93f23cf8aa94061e5cf57cc72bf74 Jun 11 21:57:45.263621 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.263601 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:57:45.269760 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:45.269731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/must-gather-5799z" event={"ID":"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0","Type":"ContainerStarted","Data":"a1b493af630167f902a4f7e489adb17aabb93f23cf8aa94061e5cf57cc72bf74"} Jun 11 21:57:46.278027 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:46.277939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/must-gather-5799z" event={"ID":"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0","Type":"ContainerStarted","Data":"07c6fe64687bf2f64513c3e5176fd32f1c05aafaa3b0c4a091f35fcc12bef506"} Jun 11 21:57:46.278027 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:46.277990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/must-gather-5799z" event={"ID":"c9cb7f24-4a65-4967-ba1a-cfd1b29046e0","Type":"ContainerStarted","Data":"ebcca6fecb7de371d240e58ccd003a042b77dd79e906d184164669a399303596"} Jun 11 21:57:46.292999 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:46.292949 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fcg/must-gather-5799z" podStartSLOduration=1.53304595 podStartE2EDuration="2.292931547s" totalImagesPullingTime="759.885597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:57:46.291181787 +0000 UTC m=+913.635406874" watchObservedRunningTime="2026-06-11 21:57:46.292931547 +0000 UTC m=+913.637156639" Jun 11 21:57:47.635979 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:47.635925 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5r5p5_6c6444fc-353c-48df-99fa-b18a8063cfaf/global-pull-secret-syncer/0.log" Jun 11 21:57:47.741045 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:47.741011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnl6j_a486857e-f78b-4835-aa3a-6f00aae1ba37/konnectivity-agent/0.log" Jun 11 21:57:47.809211 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:47.809183 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-118.ec2.internal_027e16a1fff3398b7e017b3269af3ba3/haproxy/0.log" Jun 11 21:57:52.226648 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.226604 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/extract/0.log" Jun 11 21:57:52.251145 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.251112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/util/0.log" Jun 11 21:57:52.273110 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.273073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mf72c_8ed4208b-c537-4681-81f0-0d9aaa74d6a1/pull/0.log" Jun 11 21:57:52.309981 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.309939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/extract/0.log" Jun 11 21:57:52.333891 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.333862 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/util/0.log" Jun 11 21:57:52.364146 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.364110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q7t7t_55165af3-4e24-4db6-a4fc-112d5999c574/pull/0.log" Jun 11 21:57:52.393740 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.393705 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/extract/0.log" Jun 11 21:57:52.423615 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.423578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/util/0.log" Jun 11 21:57:52.446837 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.446796 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739xlmr_d399c058-4b6d-403e-b052-4a165a207572/pull/0.log" Jun 11 21:57:52.484491 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.484396 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/extract/0.log" Jun 11 21:57:52.506119 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.506079 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/util/0.log" Jun 11 21:57:52.531788 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.531758 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16bm2g_73a14d35-9bee-4f2c-8dc4-67d65d9f2d79/pull/0.log" Jun 11 21:57:52.637189 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.637160 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-74dbg_4e0d9111-c5be-41ea-ab25-0d6da8fb19ea/manager/0.log" Jun 11 21:57:52.666991 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.666954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fppkd_2423d66c-2957-49cb-996e-dc6b959105ea/kuadrant-console-plugin/0.log" Jun 11 21:57:52.700447 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.700410 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sgcjc_086e730e-d87c-42b9-b5a6-e26cb441b673/registry-server/0.log" Jun 11 21:57:52.747729 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.747591 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jwk8_e2040579-b8b6-42d8-b041-1d82fc320ead/manager/0.log" Jun 11 21:57:52.775841 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.775812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9bxfr_a5babdae-21a8-4193-928c-7b258180307f/limitador/0.log" Jun 11 21:57:52.804190 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:52.804152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xksmd_e836c071-9385-4170-be86-6e541236f11d/manager/0.log" Jun 11 21:57:54.605576 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.605532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-fw4lt_348a1396-20d4-4189-9a92-bcc70b6ce8ba/cluster-monitoring-operator/0.log" Jun 11 21:57:54.636396 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.636362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-state-metrics/0.log" Jun 11 21:57:54.656540 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.656505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-rbac-proxy-main/0.log" Jun 11 21:57:54.686008 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.685923 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-lcblm_821f0dfb-db8d-43db-a135-f6eb76cc83e9/kube-rbac-proxy-self/0.log" Jun 11 21:57:54.723581 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.723424 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65454dd745-czktk_16d9a130-6079-4c4c-8cec-d3d480f3b52a/metrics-server/0.log" Jun 11 21:57:54.988325 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:54.988273 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/node-exporter/0.log" Jun 11 21:57:55.016042 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.015926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/kube-rbac-proxy/0.log" Jun 11 21:57:55.055111 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.055075 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7zzl_d6864066-a78c-4ada-8b91-0408ad00cead/init-textfile/0.log" Jun 11 21:57:55.092541 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.092509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/kube-rbac-proxy-main/0.log" Jun 11 21:57:55.119790 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.119763 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/kube-rbac-proxy-self/0.log" Jun 11 21:57:55.141436 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.141398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-7pnx5_b6c399c9-e0c9-4e20-aeb5-08eb3a429a93/openshift-state-metrics/0.log" Jun 11 21:57:55.383953 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:55.383907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rpc5c_614aa11d-868a-41d7-aeb0-96327af7899b/prometheus-operator-admission-webhook/0.log" Jun 11 21:57:57.873851 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.873814 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs"] Jun 11 21:57:57.879899 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.879872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:57.886295 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.886244 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs"] Jun 11 21:57:57.972379 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.972326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-lib-modules\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:57.972700 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.972678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqgrc\" (UniqueName: \"kubernetes.io/projected/35d29bff-24a5-4f42-98e7-1459a820276d-kube-api-access-zqgrc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:57.972933 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.972914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-sys\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:57.973092 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.973076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-proc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:57.973206 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:57.973191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-podres\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.074652 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqgrc\" (UniqueName: \"kubernetes.io/projected/35d29bff-24a5-4f42-98e7-1459a820276d-kube-api-access-zqgrc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.074841 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-sys\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.074841 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-proc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.074841 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-podres\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.075006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-sys\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.075006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-lib-modules\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.075006 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.074947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-podres\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.075158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.075034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-proc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.075158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.075039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35d29bff-24a5-4f42-98e7-1459a820276d-lib-modules\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.083528 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.083497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqgrc\" (UniqueName: \"kubernetes.io/projected/35d29bff-24a5-4f42-98e7-1459a820276d-kube-api-access-zqgrc\") pod \"perf-node-gather-daemonset-524fs\" (UID: \"35d29bff-24a5-4f42-98e7-1459a820276d\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.201184 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.201092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:58.390174 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.390141 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs"] Jun 11 21:57:58.962819 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:58.962792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-h9s4z_610fce85-3eb6-4c03-a491-16e48f5fb92c/volume-data-source-validator/0.log" Jun 11 21:57:59.406811 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:59.406775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" event={"ID":"35d29bff-24a5-4f42-98e7-1459a820276d","Type":"ContainerStarted","Data":"c8f033bc6ba060b8340b09f95003327c88d0a926f49e06589a814802c522f9a1"} Jun 11 21:57:59.406996 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:59.406836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" event={"ID":"35d29bff-24a5-4f42-98e7-1459a820276d","Type":"ContainerStarted","Data":"50aaad0998b516a96f5fef3b5c8b52f286ea9eebb1f92c46de1da17f2cd5e242"} Jun 11 21:57:59.406996 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:59.406918 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:57:59.423536 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:57:59.423481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" podStartSLOduration=2.423464356 podStartE2EDuration="2.423464356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:57:59.421833274 +0000 UTC m=+926.766058390" watchObservedRunningTime="2026-06-11 21:57:59.423464356 +0000 UTC m=+926.767689448" Jun 11 21:58:00.220539 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:00.220507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmzgt_d6f082b2-cb1f-42a0-b672-cca04700b7a4/dns/0.log" Jun 11 21:58:00.239710 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:00.239677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmzgt_d6f082b2-cb1f-42a0-b672-cca04700b7a4/kube-rbac-proxy/0.log" Jun 11 21:58:00.283078 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:00.283042 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzh96_ef36db73-b675-4e46-ac28-8ca17deb634f/dns-node-resolver/0.log" Jun 11 21:58:00.877765 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:00.877737 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjj4n_9f9a49cd-fd3f-4507-81d0-07d8c0ec98ed/node-ca/0.log" Jun 11 21:58:01.835122 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:01.835082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795jnrw6_4917a70e-fd3e-4b2c-aaa7-cafbf3370560/istio-proxy/0.log" Jun 11 21:58:02.640599 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:02.640570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m975x_3784790e-e24d-498d-9418-bd0aec3373e9/serve-healthcheck-canary/0.log" Jun 11 21:58:03.182684 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:03.182652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7nf_10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e/kube-rbac-proxy/0.log" Jun 11 21:58:03.207037 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:03.206998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7nf_10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e/exporter/0.log" Jun 11 21:58:03.227509 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:03.227475 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7nf_10ab0c06-1cd4-47ab-8bc4-ef9a5e574b6e/extractor/0.log" Jun 11 21:58:05.428590 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:05.428554 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-524fs" Jun 11 21:58:05.563136 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:05.563106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d74697646-nbh7s_7eb93467-cf5a-472e-afed-ddf034596f63/nginx/0.log" Jun 11 21:58:05.887219 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:05.887185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h_71091d4c-8474-4244-8027-3e2ae75b663f/manager/0.log" Jun 11 21:58:05.903478 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:05.903449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-qdv6h_71091d4c-8474-4244-8027-3e2ae75b663f/copy-manifests/0.log" Jun 11 21:58:07.716690 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:07.716657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4898ff9d-jss5c_b5a3ecd9-9eda-4b26-92c0-d0825ab6af04/manager/0.log" Jun 11 21:58:12.771873 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:12.771837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795jnrw6_4917a70e-fd3e-4b2c-aaa7-cafbf3370560/istio-proxy/0.log" Jun 11 21:58:12.837722 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:12.837687 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-zvbxs_b70d5f2b-fecc-43a1-a805-6b5acbc59d18/migrator/0.log" Jun 11 21:58:12.858113 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:12.858084 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-zvbxs_b70d5f2b-fecc-43a1-a805-6b5acbc59d18/graceful-termination/0.log" Jun 11 21:58:13.287422 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:13.287386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-nfczh_70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3/kube-storage-version-migrator-operator/1.log" Jun 11 21:58:13.290620 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:13.290569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-nfczh_70b7ea98-b1e8-47d5-b5a5-6b422f3e4de3/kube-storage-version-migrator-operator/0.log" Jun 11 21:58:14.009829 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.009799 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795jnrw6_4917a70e-fd3e-4b2c-aaa7-cafbf3370560/istio-proxy/0.log" Jun 11 21:58:14.550525 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.550499 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/kube-multus-additional-cni-plugins/0.log" Jun 11 21:58:14.568745 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.568717 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/egress-router-binary-copy/0.log" Jun 11 21:58:14.586988 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.586960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/cni-plugins/0.log" Jun 11 21:58:14.604437 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.604409 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/bond-cni-plugin/0.log" Jun 11 21:58:14.622881 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.622802 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/routeoverride-cni/0.log" Jun 11 21:58:14.642401 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.642367 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/whereabouts-cni-bincopy/0.log" Jun 11 21:58:14.660365 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.660332 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2nkf_c9350ece-db35-4c19-9c6b-1a627e183474/whereabouts-cni/0.log" Jun 11 21:58:14.840139 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.840058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jjsdm_d8872af2-fe26-4c54-b863-153203004cd5/kube-multus/0.log" Jun 11 21:58:14.992158 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:14.992124 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c99vr_964496b6-1b92-4c4d-91db-bb37d54d379b/network-metrics-daemon/0.log" Jun 11 21:58:15.007605 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:15.007576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c99vr_964496b6-1b92-4c4d-91db-bb37d54d379b/kube-rbac-proxy/0.log" Jun 11 21:58:15.634258 ip-10-0-138-118 kubenswrapper[2577]: I0611 21:58:15.634217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795jnrw6_4917a70e-fd3e-4b2c-aaa7-cafbf3370560/istio-proxy/0.log"