Jun 09 17:17:41.814266 ip-10-0-142-117 systemd[1]: Starting Kubernetes Kubelet... Jun 09 17:17:42.155718 ip-10-0-142-117 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:17:42.155718 ip-10-0-142-117 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 17:17:42.155718 ip-10-0-142-117 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:17:42.155718 ip-10-0-142-117 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 17:17:42.155718 ip-10-0-142-117 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:17:42.156749 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.156658 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 17:17:42.161619 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161587 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.161619 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161614 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.161619 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161620 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.161619 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161624 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.161619 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161628 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161635 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161641 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161645 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161649 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161654 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161657 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161661 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161665 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161669 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161673 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161677 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161681 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161684 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161688 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161692 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161706 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161710 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161714 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161718 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.161936 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161722 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161726 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161729 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161733 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161737 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161742 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161746 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161750 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161754 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161758 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161762 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161766 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161770 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161774 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161780 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161784 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161789 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161793 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161814 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161820 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.162736 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161824 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161829 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161833 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161837 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161841 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161846 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161850 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161854 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161858 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161863 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161867 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161872 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161876 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161880 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161884 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161889 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161894 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161898 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161903 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161907 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.163578 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161911 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161916 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161920 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161924 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161928 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161932 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161938 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161945 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161949 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161953 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161957 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161961 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161966 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161970 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161975 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161979 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161983 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161992 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.161998 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.164480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162003 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162007 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162013 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162018 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162022 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162027 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162032 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162036 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162041 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162045 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162052 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162059 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162063 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162068 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162073 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.162078 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163294 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163304 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163310 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163315 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.165308 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163319 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163325 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163330 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163334 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163338 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163342 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163346 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163350 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163356 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163363 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163367 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163371 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163375 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163379 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163384 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163389 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163393 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163398 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163402 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163406 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.166194 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163410 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163417 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163423 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163428 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163433 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163438 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163442 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163447 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163452 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163456 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163460 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163465 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163469 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163474 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163478 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163482 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163487 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163491 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163496 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.166878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163500 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163504 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163508 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163513 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163518 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163522 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163526 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163531 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163535 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163539 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163542 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163547 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163551 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163556 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163560 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163564 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163569 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163573 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163577 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163580 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.167424 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163587 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163591 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163595 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163600 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163606 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163610 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163614 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163619 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163624 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163628 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163632 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163637 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163641 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163645 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163649 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163654 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163658 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163663 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163667 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.168095 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163671 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163677 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163684 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163689 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163694 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163699 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163704 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163710 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163715 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163719 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163724 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163729 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163733 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163740 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163745 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163749 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.163753 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164435 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164444 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164449 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.168635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164454 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164459 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164464 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164470 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164474 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164478 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164482 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164486 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164490 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164495 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164498 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164503 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164506 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164511 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164515 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164519 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164524 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164528 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164532 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164536 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.169172 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164540 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164546 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164552 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164557 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164562 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164569 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164574 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164578 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164582 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164587 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164591 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164595 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164599 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164604 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164609 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164613 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164618 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164622 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164626 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164630 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.169742 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164634 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164638 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164643 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164648 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164652 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164656 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164661 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164665 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164669 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164673 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164677 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164681 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164686 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164690 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164694 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164698 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164702 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164709 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164713 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164719 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.170332 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164723 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164727 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164731 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164736 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164740 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164745 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164749 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164754 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164758 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164762 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164766 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164770 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164774 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164779 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164783 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164787 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164791 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164814 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164820 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.170840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164824 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164829 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164833 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164837 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164843 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164849 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164853 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164858 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164862 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164866 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164872 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164877 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164882 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164886 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164890 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164894 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.164901 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165004 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165015 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165028 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 17:17:42.171302 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165036 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165044 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165049 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165055 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165061 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165066 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165071 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165077 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165083 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165089 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165094 2561 flags.go:64] FLAG: --cgroup-root="" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165099 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165103 2561 flags.go:64] FLAG: --client-ca-file="" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165108 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165113 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165120 2561 flags.go:64] FLAG: --cluster-domain="" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165125 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165130 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165135 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165140 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165146 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165151 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165159 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 17:17:42.171789 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165165 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165170 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165175 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165180 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165185 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165189 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165196 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165202 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165206 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165211 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165216 2561 flags.go:64] FLAG: --enable-server="true" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165221 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165229 2561 flags.go:64] FLAG: --event-burst="100" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165235 2561 flags.go:64] FLAG: --event-qps="50" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165240 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165245 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165250 2561 flags.go:64] FLAG: --eviction-hard="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165257 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165262 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165267 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165272 2561 flags.go:64] FLAG: --eviction-soft="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165277 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165282 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165287 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165291 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 17:17:42.172388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165296 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165300 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165304 2561 flags.go:64] FLAG: --feature-gates="" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165310 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165315 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165320 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165326 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165331 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165335 2561 flags.go:64] FLAG: --help="false" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165340 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165346 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165351 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165356 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165362 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165368 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165373 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165377 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165381 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165386 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165392 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165397 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165402 2561 flags.go:64] FLAG: --kube-reserved="" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165407 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165411 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 17:17:42.173114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165416 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165420 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165425 2561 flags.go:64] FLAG: --lock-file="" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165430 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165435 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165440 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165449 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165454 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165459 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165464 2561 flags.go:64] FLAG: --logging-format="text" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165468 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165474 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165479 2561 flags.go:64] FLAG: --manifest-url="" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165484 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165496 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165501 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165508 2561 flags.go:64] FLAG: --max-pods="110" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165514 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165519 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165523 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165528 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165533 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165537 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165542 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165554 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 17:17:42.173724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165559 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165564 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165569 2561 flags.go:64] FLAG: --pod-cidr="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165575 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165585 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165590 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165595 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165600 2561 flags.go:64] FLAG: --port="10250" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165612 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165617 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a9554cd990f2fef" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165622 2561 flags.go:64] FLAG: --qos-reserved="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165626 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165631 2561 flags.go:64] FLAG: --register-node="true" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165636 2561 flags.go:64] FLAG: --register-with-taints="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165643 2561 flags.go:64] FLAG: --registry-burst="10" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165647 2561 flags.go:64] FLAG: --registry-qps="5" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165652 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165656 2561 flags.go:64] FLAG: --reserved-memory="" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165662 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165667 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165672 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165677 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165685 2561 flags.go:64] FLAG: --runonce="false" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165690 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165695 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 17:17:42.174503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165700 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165705 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165710 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165715 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165721 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165726 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165730 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165735 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165740 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165744 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165749 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165755 2561 flags.go:64] FLAG: --system-cgroups="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165760 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165769 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165774 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165779 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165786 2561 flags.go:64] FLAG: --tls-min-version="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165791 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165827 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165833 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165838 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165843 2561 flags.go:64] FLAG: --v="2" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165850 2561 flags.go:64] FLAG: --version="false" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165857 2561 flags.go:64] FLAG: --vmodule="" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165863 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 17:17:42.175511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.165868 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166054 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166060 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166065 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166072 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166078 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166082 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166087 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166091 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166095 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166100 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166104 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166108 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166112 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166117 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166121 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166125 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166129 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166134 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166139 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.176169 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166144 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166148 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166152 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166156 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166160 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166165 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166169 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166176 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166180 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166184 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166188 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166192 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166196 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166200 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166204 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166210 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166218 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166222 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166226 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166231 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.176672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166235 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166240 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166244 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166249 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166253 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166257 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166261 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166265 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166269 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166274 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166279 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166283 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166288 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166292 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166296 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166300 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166305 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166309 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166314 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.177180 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166320 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166327 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166332 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166337 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166342 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166346 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166350 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166355 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166359 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166366 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166370 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166374 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166378 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166382 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166387 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166391 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166395 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166399 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166404 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166408 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.177653 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166412 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166416 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166420 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166425 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166429 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166433 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166438 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166445 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166450 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166455 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166459 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166463 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166469 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166474 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166478 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166482 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166487 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166491 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166495 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.178201 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166499 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.166503 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.166999 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.174480 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.174502 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.174529 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.174538 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174696 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174704 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174709 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174714 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174725 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174729 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174735 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174739 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.178672 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174743 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174748 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174752 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174756 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174761 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174765 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174770 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174774 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174783 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174787 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174792 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174813 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174817 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174822 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174826 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174830 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174836 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174843 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174847 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.179063 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174852 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174856 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174867 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174872 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174876 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174883 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174889 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174893 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174898 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174902 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174906 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174910 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174915 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174919 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174927 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174932 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174936 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174940 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174945 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174949 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.179601 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174954 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174958 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174962 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174966 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174973 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174978 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174983 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174993 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.174997 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175002 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175006 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175010 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175015 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175019 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175025 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175030 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175034 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175039 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175044 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.180118 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175052 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175057 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175061 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175065 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175070 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175075 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175079 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175083 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175088 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175092 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175096 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175101 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175105 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175114 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175118 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175123 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175127 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175132 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175136 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175140 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.180593 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175145 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175150 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175154 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175159 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175164 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175173 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175177 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175182 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175186 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175192 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175196 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175201 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175205 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.175213 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175750 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:17:42.181108 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175762 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175766 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175769 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175773 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175776 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175779 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175782 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175785 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175788 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175791 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175793 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175808 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175812 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175816 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175821 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175824 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175827 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175830 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175833 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:17:42.181480 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175836 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175838 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175841 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175845 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175848 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175851 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175854 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175857 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175860 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175863 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175866 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175869 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175873 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175876 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175879 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175882 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175885 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175888 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175891 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:17:42.182029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175893 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175896 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175899 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175902 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175904 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175907 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175910 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175912 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175915 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175917 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175920 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175922 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175925 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175928 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175930 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175933 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175935 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175938 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175940 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175943 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:17:42.182522 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175945 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175948 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175951 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175953 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175956 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175958 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175962 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175965 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175967 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175970 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175973 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175976 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175979 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175981 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175984 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175986 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175989 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175992 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175994 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175997 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:17:42.183051 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.175999 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176002 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176004 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176007 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176010 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176012 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176015 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176017 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176020 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176022 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176025 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176029 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176033 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176036 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176039 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176042 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176044 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176047 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176051 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:17:42.183635 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:42.176054 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.176060 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.176199 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.178998 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.180147 2561 server.go:1019] "Starting client certificate rotation" Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.180251 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.180317 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 17:17:42.184162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.182388 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 17:17:42.184921 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.184901 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 17:17:42.195708 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.195688 2561 log.go:25] "Validated CRI v1 runtime API" Jun 09 17:17:42.198490 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.198475 2561 log.go:25] "Validated CRI v1 image API" Jun 09 17:17:42.199325 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.199308 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 17:17:42.201397 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.201378 2561 fs.go:135] Filesystem UUIDs: map[1500eb42-a108-4186-9416-ace90a53b2dc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f03db7b1-ba24-4279-a3a8-5856e6bbba8d:/dev/nvme0n1p3] Jun 09 17:17:42.201460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.201397 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 17:17:42.202313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.202297 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 17:17:42.207490 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.207376 2561 manager.go:216] Machine: {Timestamp:2026-06-09 17:17:42.20582176 +0000 UTC m=+0.283969991 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101215 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dadfd3acae029d5bc797c90672b42 SystemUUID:ec2dadfd-3aca-e029-d5bc-797c90672b42 BootID:2403014b-6d48-48be-877b-d4fac109c40c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:99:1d:8e:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:99:1d:8e:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:39:c1:ad:dd:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 17:17:42.207490 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.207481 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 17:17:42.207626 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.207614 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 17:17:42.210589 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.210548 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 17:17:42.210761 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.210593 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 17:17:42.211766 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.211754 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 17:17:42.211815 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.211769 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 17:17:42.211815 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.211778 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 17:17:42.212447 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.212436 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 17:17:42.213686 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.213673 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 17:17:42.216940 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.216924 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 17:17:42.217262 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217251 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 17:17:42.217305 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217287 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 09 17:17:42.217305 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217297 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 17:17:42.217367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217312 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 17:17:42.217367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217322 2561 kubelet.go:398] "Adding apiserver pod source" Jun 09 17:17:42.217367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.217331 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 17:17:42.218029 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.218009 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 17:17:42.218086 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.218047 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 17:17:42.220641 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.220614 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 17:17:42.221166 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.221149 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4tg7r" Jun 09 17:17:42.222148 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222126 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 17:17:42.222232 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222172 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 17:17:42.222892 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222878 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222895 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222905 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222913 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222924 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222929 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222937 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222942 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 17:17:42.222946 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222949 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 17:17:42.223237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222955 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 17:17:42.223237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222964 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 17:17:42.223237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.222969 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 17:17:42.224131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.224119 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 17:17:42.224185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.224133 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 17:17:42.230349 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.230332 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4tg7r" Jun 09 17:17:42.242188 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.242166 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 17:17:42.242188 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.242171 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 17:17:42.242309 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.242182 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 17:17:42.243316 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.243297 2561 server.go:1268] "Started kubelet" Jun 09 17:17:42.243385 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.243336 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 17:17:42.243498 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.243456 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 17:17:42.243548 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.243522 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 17:17:42.244442 ip-10-0-142-117 systemd[1]: Started Kubernetes Kubelet. Jun 09 17:17:42.245098 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.244907 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 09 17:17:42.245235 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.245219 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 17:17:42.249927 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.249905 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 17:17:42.250022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.249927 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 17:17:42.250089 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.250017 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.250611 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.250586 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 17:17:42.250907 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.250881 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 17:17:42.251016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.250975 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 17:17:42.251016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251017 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 17:17:42.251146 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251109 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 09 17:17:42.251146 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251120 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 09 17:17:42.251146 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251127 2561 factory.go:153] Registering CRI-O factory Jun 09 17:17:42.251146 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251141 2561 factory.go:223] Registration of the crio container factory successfully Jun 09 17:17:42.251324 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251253 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 17:17:42.251324 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251263 2561 factory.go:55] Registering systemd factory Jun 09 17:17:42.251324 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251270 2561 factory.go:223] Registration of the systemd container factory successfully Jun 09 17:17:42.251324 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251293 2561 factory.go:103] Registering Raw factory Jun 09 17:17:42.251324 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.251308 2561 manager.go:1196] Started watching for new ooms in manager Jun 09 17:17:42.252984 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.252694 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:42.253766 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.253750 2561 manager.go:349] Starting recovery of all containers Jun 09 17:17:42.255124 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.255102 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.259142 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.259102 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 17:17:42.265588 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.265487 2561 manager.go:354] Recovery completed Jun 09 17:17:42.269929 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.269916 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.271829 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.271776 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.271829 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.271820 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.271829 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.271831 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.272357 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.272341 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 17:17:42.272357 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.272356 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 17:17:42.272461 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.272374 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.272461 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.272376 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 17:17:42.272996 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.272982 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.273059 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.273007 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.273059 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.273019 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.273552 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.273540 2561 policy_none.go:49] "None policy: Start" Jun 09 17:17:42.273585 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.273557 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 17:17:42.273585 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.273566 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 17:17:42.274432 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.274420 2561 policy_none.go:47] "Start" Jun 09 17:17:42.303492 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.303473 2561 manager.go:337] "Starting Device Plugin manager" Jun 09 17:17:42.303604 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.303566 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 17:17:42.303604 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.303581 2561 server.go:87] "Starting device plugin registration server" Jun 09 17:17:42.303842 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.303830 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 17:17:42.303912 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.303847 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 17:17:42.304034 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.304016 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 17:17:42.304134 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.304121 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 17:17:42.304134 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.304135 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 17:17:42.304901 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.304877 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 17:17:42.304994 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.304927 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.322520 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.322496 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 17:17:42.328681 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.322535 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 17:17:42.328681 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.322555 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 17:17:42.328681 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.322590 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 17:17:42.328681 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.324676 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:42.404709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.404665 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.405633 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.405617 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.405753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.405650 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.405753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.405661 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.405753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.405685 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.414079 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.414056 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.414079 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.414081 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-117.ec2.internal\": node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.423236 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.423212 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal"] Jun 09 17:17:42.423320 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.423275 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.424995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.424976 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.425091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.425002 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.425091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.425013 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.427230 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427216 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.427340 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.427380 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427356 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.427964 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427951 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.428024 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427973 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.428024 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.427986 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.428024 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.428006 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.428024 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.428023 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.428161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.428033 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.428363 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.428346 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.430088 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.430072 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.430184 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.430097 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:17:42.430744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.430722 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:17:42.430837 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.430747 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:17:42.430837 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.430759 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:17:42.446382 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.446361 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.450470 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.450452 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-117.ec2.internal\" not found" node="ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.452503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.452482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.452593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.452517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f6ad2919053178a56c098c140bfb06e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"3f6ad2919053178a56c098c140bfb06e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.452593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.452543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.529284 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.529255 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.553687 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f6ad2919053178a56c098c140bfb06e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"3f6ad2919053178a56c098c140bfb06e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.553757 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.553757 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.553870 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f6ad2919053178a56c098c140bfb06e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-117.ec2.internal\" (UID: \"3f6ad2919053178a56c098c140bfb06e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.553870 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.553870 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.553845 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a69666f4c6a13164ab6093b94da8a9d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal\" (UID: \"a69666f4c6a13164ab6093b94da8a9d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.629871 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.629837 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.730608 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.730537 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.753854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.753830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.758146 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:42.757772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:42.831155 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.831114 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:42.931737 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:42.931703 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.032282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.032200 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.132845 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.132817 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.180307 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.180273 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 17:17:43.180978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.180422 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 17:17:43.180978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.180479 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 17:17:43.233796 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.233760 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.246085 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.246033 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 17:12:42 +0000 UTC" deadline="2027-11-12 10:59:45.245374677 +0000 UTC" Jun 09 17:17:43.246085 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.246083 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12497h42m1.9992967s" Jun 09 17:17:43.327987 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:43.327948 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6ad2919053178a56c098c140bfb06e.slice/crio-7779319f75678451aceae69f2a2ba36a4855b23949b73ca7066663e5af81da2f WatchSource:0}: Error finding container 7779319f75678451aceae69f2a2ba36a4855b23949b73ca7066663e5af81da2f: Status 404 returned error can't find the container with id 7779319f75678451aceae69f2a2ba36a4855b23949b73ca7066663e5af81da2f Jun 09 17:17:43.328183 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:43.328164 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69666f4c6a13164ab6093b94da8a9d9.slice/crio-622a0e61cae6e840442ee3d8bb4ab1a18fdc3a36214c0bb5357dffd1a3f5b8ec WatchSource:0}: Error finding container 622a0e61cae6e840442ee3d8bb4ab1a18fdc3a36214c0bb5357dffd1a3f5b8ec: Status 404 returned error can't find the container with id 622a0e61cae6e840442ee3d8bb4ab1a18fdc3a36214c0bb5357dffd1a3f5b8ec Jun 09 17:17:43.333548 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.333528 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:17:43.333890 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.333861 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.421471 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.421438 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:43.434310 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.434283 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.534812 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:43.534750 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-117.ec2.internal\" not found" Jun 09 17:17:43.557221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.557193 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:43.650978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.650900 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" Jun 09 17:17:43.659708 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.659680 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 17:17:43.661079 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.661060 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" Jun 09 17:17:43.671399 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:43.671379 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 17:17:44.007421 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.007335 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:44.218186 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.218156 2561 apiserver.go:52] "Watching apiserver" Jun 09 17:17:44.228386 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.228351 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 17:17:44.228759 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.228731 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-cdf7p","openshift-network-diagnostics/network-check-target-2t24f","openshift-ovn-kubernetes/ovnkube-node-k4bl6","kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal","openshift-cluster-node-tuning-operator/tuned-stkgm","openshift-dns/node-resolver-57772","openshift-multus/multus-fcchx","openshift-multus/network-metrics-daemon-f4772","openshift-network-operator/iptables-alerter-gmdqn","kube-system/global-pull-secret-syncer-cf7tq","kube-system/konnectivity-agent-sjz89","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f","openshift-image-registry/node-ca-bwlhx"] Jun 09 17:17:44.231577 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.231554 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.233602 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.233572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.233714 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.233666 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:44.234460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.234298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l4v2h\"" Jun 09 17:17:44.234460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.234313 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.234460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.234305 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.236329 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.236214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:44.236329 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.236294 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:44.238660 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.238516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.240746 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.240722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 17:17:44.240922 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.240725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.241274 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.241251 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 17:17:44.241372 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.241255 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.241704 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.241662 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.241873 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.241748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 17:17:44.242402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.242383 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 17:17:44.242578 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.242561 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gt6jc\"" Jun 09 17:17:44.243117 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.243094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.243214 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.243192 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.243278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.243209 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 17:17:44.243406 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.243323 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.243514 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.243493 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v2lp2\"" Jun 09 17:17:44.245201 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.245123 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.245371 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.245350 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.245478 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.245351 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vbt6r\"" Jun 09 17:17:44.245549 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.245506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.245603 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.245573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:44.247937 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.247916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.250151 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250130 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.250276 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250188 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lqpdf\"" Jun 09 17:17:44.250496 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250456 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 17:17:44.250496 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250479 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.250778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250762 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 17:17:44.250874 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.250824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.253035 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253018 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.253165 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253018 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 17:17:44.253250 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.253684 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253443 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 17:17:44.253684 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253544 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 17:17:44.253684 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pmz8g\"" Jun 09 17:17:44.253883 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.253860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.255399 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.255375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.256823 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.256291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 17:17:44.256823 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.256397 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7vzgp\"" Jun 09 17:17:44.256823 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.256508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 17:17:44.260031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.257518 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:17:44.260031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.257833 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 17:17:44.260031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.258172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.260031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.258551 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2s84n\"" Jun 09 17:17:44.260864 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.260845 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 17:17:44.260958 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.260940 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 17:17:44.261145 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.261128 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cn9z5\"" Jun 09 17:17:44.262090 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-systemd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.262193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysconfig\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.262193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-conf\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.262193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.262346 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-tmp\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.262346 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.262346 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-slash\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.262346 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-log-socket\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.262531 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f99dde7-d0a9-4841-bd41-36e6318af67c-host\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.262531 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.262531 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.262531 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-netd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.262725 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.262580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-script-lib\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-systemd\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6b5\" (UniqueName: \"kubernetes.io/projected/64fb8be3-2289-407c-855b-04ce0591b265-kube-api-access-zm6b5\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-var-lib-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-host\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-tuned\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263747 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-dbus\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-config\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovn-node-metrics-cert\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfr94\" (UniqueName: \"kubernetes.io/projected/9f99dde7-d0a9-4841-bd41-36e6318af67c-kube-api-access-dfr94\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1425bdc3-ca38-44d4-b1ac-c4a39a889451-hosts-file\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.263962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.263994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2sd\" (UniqueName: \"kubernetes.io/projected/1e79cb33-2aae-49de-afef-e45c39fe247d-kube-api-access-px2sd\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1425bdc3-ca38-44d4-b1ac-c4a39a889451-tmp-dir\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-node-log\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f99dde7-d0a9-4841-bd41-36e6318af67c-serviceca\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64fb8be3-2289-407c-855b-04ce0591b265-iptables-alerter-script\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8cw\" (UniqueName: \"kubernetes.io/projected/1425bdc3-ca38-44d4-b1ac-c4a39a889451-kube-api-access-fs8cw\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-device-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-system-cni-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-ovn\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-os-release\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-bin\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-run\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:44.264655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gsj\" (UniqueName: \"kubernetes.io/projected/bf847c2e-14a7-4d96-b898-bd618ae46f0a-kube-api-access-x7gsj\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-kubernetes\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-sys\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64fb8be3-2289-407c-855b-04ce0591b265-host-slash\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-netns\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-modprobe-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-lib-modules\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgqf\" (UniqueName: \"kubernetes.io/projected/4d4c092f-fbd6-4ce0-8868-6677172f902d-kube-api-access-tcgqf\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-kubelet\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-var-lib-kubelet\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264775 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-kubelet-config\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-systemd-units\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.265416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngc6\" (UniqueName: \"kubernetes.io/projected/cd528e43-bc45-40c0-ad47-4ec9638b7774-kube-api-access-4ngc6\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjn2z\" (UniqueName: \"kubernetes.io/projected/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-kube-api-access-mjn2z\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cnibin\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.264989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-etc-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.266229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.265011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-env-overrides\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.277578 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.277551 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7wfg4" Jun 09 17:17:44.285038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.285017 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7wfg4" Jun 09 17:17:44.327202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.327144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" event={"ID":"3f6ad2919053178a56c098c140bfb06e","Type":"ContainerStarted","Data":"7779319f75678451aceae69f2a2ba36a4855b23949b73ca7066663e5af81da2f"} Jun 09 17:17:44.328257 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.328228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"a69666f4c6a13164ab6093b94da8a9d9","Type":"ContainerStarted","Data":"622a0e61cae6e840442ee3d8bb4ab1a18fdc3a36214c0bb5357dffd1a3f5b8ec"} Jun 09 17:17:44.351771 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.351740 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 17:17:44.365293 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-netd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-script-lib\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-systemd\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6b5\" (UniqueName: \"kubernetes.io/projected/64fb8be3-2289-407c-855b-04ce0591b265-kube-api-access-zm6b5\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-multus\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-netd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-var-lib-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-host\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.365481 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-tuned\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-socket-dir-parent\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-dbus\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-config\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovn-node-metrics-cert\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfr94\" (UniqueName: \"kubernetes.io/projected/9f99dde7-d0a9-4841-bd41-36e6318af67c-kube-api-access-dfr94\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1425bdc3-ca38-44d4-b1ac-c4a39a889451-hosts-file\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-systemd\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2sd\" (UniqueName: \"kubernetes.io/projected/1e79cb33-2aae-49de-afef-e45c39fe247d-kube-api-access-px2sd\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1425bdc3-ca38-44d4-b1ac-c4a39a889451-tmp-dir\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-cnibin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-k8s-cni-cncf-io\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-conf-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-node-log\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.365972 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f99dde7-d0a9-4841-bd41-36e6318af67c-serviceca\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64fb8be3-2289-407c-855b-04ce0591b265-iptables-alerter-script\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8cw\" (UniqueName: \"kubernetes.io/projected/1425bdc3-ca38-44d4-b1ac-c4a39a889451-kube-api-access-fs8cw\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-device-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-dbus\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.365992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-system-cni-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-system-cni-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-ovn\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-node-log\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-os-release\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-netns\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1425bdc3-ca38-44d4-b1ac-c4a39a889451-tmp-dir\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-kubelet\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366334 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-device-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-var-lib-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.366813 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-multus-daemon-config\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-bin\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-config\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-run\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gsj\" (UniqueName: \"kubernetes.io/projected/bf847c2e-14a7-4d96-b898-bd618ae46f0a-kube-api-access-x7gsj\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1425bdc3-ca38-44d4-b1ac-c4a39a889451-hosts-file\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-multus-certs\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-kubernetes\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-sys\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64fb8be3-2289-407c-855b-04ce0591b265-host-slash\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-netns\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-modprobe-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-lib-modules\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.367582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f99dde7-d0a9-4841-bd41-36e6318af67c-serviceca\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgqf\" (UniqueName: \"kubernetes.io/projected/4d4c092f-fbd6-4ce0-8868-6677172f902d-kube-api-access-tcgqf\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.366031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovnkube-script-lib\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367098 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64fb8be3-2289-407c-855b-04ce0591b265-iptables-alerter-script\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-os-release\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.367195 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.367274 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:17:44.867251477 +0000 UTC m=+2.945399716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367315 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-ovn\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367374 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-modprobe-d\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-run-netns\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.367564 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:44.368358 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.367613 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:17:44.867597384 +0000 UTC m=+2.945745618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-lib-modules\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-cni-bin\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367656 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-kubernetes\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-host\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-sys\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-run\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-kubelet\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-var-lib-kubelet\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64fb8be3-2289-407c-855b-04ce0591b265-host-slash\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-os-release\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367864 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-kubelet\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-kubelet-config\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-var-lib-kubelet\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-systemd-units\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369185 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.367992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7073a4f0-8b38-482f-a977-2f1ceeba037a-kubelet-config\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-systemd-units\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngc6\" (UniqueName: \"kubernetes.io/projected/cd528e43-bc45-40c0-ad47-4ec9638b7774-kube-api-access-4ngc6\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjn2z\" (UniqueName: \"kubernetes.io/projected/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-kube-api-access-mjn2z\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cnibin\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cnibin\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-etc-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-env-overrides\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-etc-openvswitch\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-system-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-bin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd6m9\" (UniqueName: \"kubernetes.io/projected/ac03a354-9088-42a7-affe-c92e3569fd41-kube-api-access-bd6m9\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.369956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-systemd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysconfig\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-run-systemd\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-conf\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368706 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysconfig\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-cni-binary-copy\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-sysctl-conf\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-tmp\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-hostroot\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-slash\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-log-socket\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f99dde7-d0a9-4841-bd41-36e6318af67c-host\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.368985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-etc-kubernetes\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.370712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cc24f10-4aad-4b65-90ba-9526b46ec235-agent-certs\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-host-slash\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cc24f10-4aad-4b65-90ba-9526b46ec235-konnectivity-ca\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd528e43-bc45-40c0-ad47-4ec9638b7774-log-socket\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f99dde7-d0a9-4841-bd41-36e6318af67c-host\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4c092f-fbd6-4ce0-8868-6677172f902d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd528e43-bc45-40c0-ad47-4ec9638b7774-env-overrides\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.369669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf847c2e-14a7-4d96-b898-bd618ae46f0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.370473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-etc-tuned\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.371318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.370836 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd528e43-bc45-40c0-ad47-4ec9638b7774-ovn-node-metrics-cert\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.371855 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.371554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-tmp\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.374087 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.373988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6b5\" (UniqueName: \"kubernetes.io/projected/64fb8be3-2289-407c-855b-04ce0591b265-kube-api-access-zm6b5\") pod \"iptables-alerter-gmdqn\" (UID: \"64fb8be3-2289-407c-855b-04ce0591b265\") " pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.374087 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.374035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2sd\" (UniqueName: \"kubernetes.io/projected/1e79cb33-2aae-49de-afef-e45c39fe247d-kube-api-access-px2sd\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.374597 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.374549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfr94\" (UniqueName: \"kubernetes.io/projected/9f99dde7-d0a9-4841-bd41-36e6318af67c-kube-api-access-dfr94\") pod \"node-ca-bwlhx\" (UID: \"9f99dde7-d0a9-4841-bd41-36e6318af67c\") " pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.375581 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.375537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gsj\" (UniqueName: \"kubernetes.io/projected/bf847c2e-14a7-4d96-b898-bd618ae46f0a-kube-api-access-x7gsj\") pod \"multus-additional-cni-plugins-cdf7p\" (UID: \"bf847c2e-14a7-4d96-b898-bd618ae46f0a\") " pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.377161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.377138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8cw\" (UniqueName: \"kubernetes.io/projected/1425bdc3-ca38-44d4-b1ac-c4a39a889451-kube-api-access-fs8cw\") pod \"node-resolver-57772\" (UID: \"1425bdc3-ca38-44d4-b1ac-c4a39a889451\") " pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.380638 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.380572 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:17:44.381113 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.380761 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:17:44.381113 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.380783 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:44.381113 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.380885 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:17:44.880863844 +0000 UTC m=+2.959012069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:44.383628 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.383464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgqf\" (UniqueName: \"kubernetes.io/projected/4d4c092f-fbd6-4ce0-8868-6677172f902d-kube-api-access-tcgqf\") pod \"aws-ebs-csi-driver-node-vdb2f\" (UID: \"4d4c092f-fbd6-4ce0-8868-6677172f902d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.384955 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.384910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjn2z\" (UniqueName: \"kubernetes.io/projected/1f03aa8a-080b-41ae-bf13-ab966e96d7c5-kube-api-access-mjn2z\") pod \"tuned-stkgm\" (UID: \"1f03aa8a-080b-41ae-bf13-ab966e96d7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.385063 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.385040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngc6\" (UniqueName: \"kubernetes.io/projected/cd528e43-bc45-40c0-ad47-4ec9638b7774-kube-api-access-4ngc6\") pod \"ovnkube-node-k4bl6\" (UID: \"cd528e43-bc45-40c0-ad47-4ec9638b7774\") " pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.406863 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.406832 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:17:44.470016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.469986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-bin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6m9\" (UniqueName: \"kubernetes.io/projected/ac03a354-9088-42a7-affe-c92e3569fd41-kube-api-access-bd6m9\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-cni-binary-copy\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-hostroot\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-etc-kubernetes\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cc24f10-4aad-4b65-90ba-9526b46ec235-agent-certs\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-bin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-etc-kubernetes\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-hostroot\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cc24f10-4aad-4b65-90ba-9526b46ec235-konnectivity-ca\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-multus\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470237 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-socket-dir-parent\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-cnibin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-k8s-cni-cncf-io\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-conf-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-socket-dir-parent\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-netns\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-kubelet\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-cni-multus\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-multus-daemon-config\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-cnibin\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-netns\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-multus-certs\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-k8s-cni-cncf-io\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-conf-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-os-release\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-var-lib-kubelet\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-host-run-multus-certs\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.470752 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-system-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-os-release\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-system-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac03a354-9088-42a7-affe-c92e3569fd41-multus-cni-dir\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-cni-binary-copy\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cc24f10-4aad-4b65-90ba-9526b46ec235-konnectivity-ca\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.471443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.470983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac03a354-9088-42a7-affe-c92e3569fd41-multus-daemon-config\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.473082 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.473064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cc24f10-4aad-4b65-90ba-9526b46ec235-agent-certs\") pod \"konnectivity-agent-sjz89\" (UID: \"6cc24f10-4aad-4b65-90ba-9526b46ec235\") " pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.478392 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.478369 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd6m9\" (UniqueName: \"kubernetes.io/projected/ac03a354-9088-42a7-affe-c92e3569fd41-kube-api-access-bd6m9\") pod \"multus-fcchx\" (UID: \"ac03a354-9088-42a7-affe-c92e3569fd41\") " pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.543016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.542782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57772" Jun 09 17:17:44.552954 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.552925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:17:44.553594 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.553554 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1425bdc3_ca38_44d4_b1ac_c4a39a889451.slice/crio-a8bee5b36790b1efa51bdb2183c1aabe826038499263a935b675df9c51afe726 WatchSource:0}: Error finding container a8bee5b36790b1efa51bdb2183c1aabe826038499263a935b675df9c51afe726: Status 404 returned error can't find the container with id a8bee5b36790b1efa51bdb2183c1aabe826038499263a935b675df9c51afe726 Jun 09 17:17:44.561903 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.561872 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd528e43_bc45_40c0_ad47_4ec9638b7774.slice/crio-829c4cd84633117a5a2372faebd1bf642589ccfa6741b43a090d73d3cf65e833 WatchSource:0}: Error finding container 829c4cd84633117a5a2372faebd1bf642589ccfa6741b43a090d73d3cf65e833: Status 404 returned error can't find the container with id 829c4cd84633117a5a2372faebd1bf642589ccfa6741b43a090d73d3cf65e833 Jun 09 17:17:44.562712 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.562688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwlhx" Jun 09 17:17:44.569703 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.569682 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stkgm" Jun 09 17:17:44.571827 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.571784 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f99dde7_d0a9_4841_bd41_36e6318af67c.slice/crio-74e84987c76ba2f7ca5a085a12ca4c79ec2311d03cb5ca48c9dfc89eeac1cf3a WatchSource:0}: Error finding container 74e84987c76ba2f7ca5a085a12ca4c79ec2311d03cb5ca48c9dfc89eeac1cf3a: Status 404 returned error can't find the container with id 74e84987c76ba2f7ca5a085a12ca4c79ec2311d03cb5ca48c9dfc89eeac1cf3a Jun 09 17:17:44.577291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.577270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" Jun 09 17:17:44.579572 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.579508 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f03aa8a_080b_41ae_bf13_ab966e96d7c5.slice/crio-ce6f35c9f2ccc8179c5301ef40e523af258711c290f77689a28eb2759737664f WatchSource:0}: Error finding container ce6f35c9f2ccc8179c5301ef40e523af258711c290f77689a28eb2759737664f: Status 404 returned error can't find the container with id ce6f35c9f2ccc8179c5301ef40e523af258711c290f77689a28eb2759737664f Jun 09 17:17:44.583650 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.583622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" Jun 09 17:17:44.589827 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.589788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4c092f_fbd6_4ce0_8868_6677172f902d.slice/crio-ae500d4cd99fc43884f8b6d710341b16f39a8510e5457b693c8a9127658840e8 WatchSource:0}: Error finding container ae500d4cd99fc43884f8b6d710341b16f39a8510e5457b693c8a9127658840e8: Status 404 returned error can't find the container with id ae500d4cd99fc43884f8b6d710341b16f39a8510e5457b693c8a9127658840e8 Jun 09 17:17:44.590745 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.590591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gmdqn" Jun 09 17:17:44.595209 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.595183 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf847c2e_14a7_4d96_b898_bd618ae46f0a.slice/crio-5f15f88659e4f774933c4102eb2d40d11f7389437239ff082873b9879d4f1dad WatchSource:0}: Error finding container 5f15f88659e4f774933c4102eb2d40d11f7389437239ff082873b9879d4f1dad: Status 404 returned error can't find the container with id 5f15f88659e4f774933c4102eb2d40d11f7389437239ff082873b9879d4f1dad Jun 09 17:17:44.597763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.597557 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcchx" Jun 09 17:17:44.601271 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.601243 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fb8be3_2289_407c_855b_04ce0591b265.slice/crio-5f7101399d1b6b15d4911ad3f517f8bf188fcd463e8e8f6ef8f9f586e58fdcc9 WatchSource:0}: Error finding container 5f7101399d1b6b15d4911ad3f517f8bf188fcd463e8e8f6ef8f9f586e58fdcc9: Status 404 returned error can't find the container with id 5f7101399d1b6b15d4911ad3f517f8bf188fcd463e8e8f6ef8f9f586e58fdcc9 Jun 09 17:17:44.603477 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.603455 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:17:44.608291 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.608257 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac03a354_9088_42a7_affe_c92e3569fd41.slice/crio-7e4a79a2f201a6c35ee8280a6be30ea860e6d433f2d228e36b492486c445c11c WatchSource:0}: Error finding container 7e4a79a2f201a6c35ee8280a6be30ea860e6d433f2d228e36b492486c445c11c: Status 404 returned error can't find the container with id 7e4a79a2f201a6c35ee8280a6be30ea860e6d433f2d228e36b492486c445c11c Jun 09 17:17:44.613615 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:17:44.613592 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc24f10_4aad_4b65_90ba_9526b46ec235.slice/crio-6c0a6c7ab09526b10336d471f2aec53de53bcd3626dc53655ade3ff576de7058 WatchSource:0}: Error finding container 6c0a6c7ab09526b10336d471f2aec53de53bcd3626dc53655ade3ff576de7058: Status 404 returned error can't find the container with id 6c0a6c7ab09526b10336d471f2aec53de53bcd3626dc53655ade3ff576de7058 Jun 09 17:17:44.874219 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.874169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:44.874362 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.874238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:44.874362 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.874300 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:44.874362 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.874344 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:44.874483 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.874367 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:17:45.874347587 +0000 UTC m=+3.952495818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:44.874483 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.874384 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:17:45.874375716 +0000 UTC m=+3.952523936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:44.975388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:44.975353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:44.975555 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.975481 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:17:44.975555 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.975496 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:17:44.975555 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.975507 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:44.975687 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:44.975555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:17:45.975541787 +0000 UTC m=+4.053690006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:45.288565 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.288455 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 17:12:44 +0000 UTC" deadline="2028-01-20 18:35:25.32448063 +0000 UTC" Jun 09 17:17:45.288565 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.288508 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14161h17m40.035977379s" Jun 09 17:17:45.356308 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.356264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sjz89" event={"ID":"6cc24f10-4aad-4b65-90ba-9526b46ec235","Type":"ContainerStarted","Data":"6c0a6c7ab09526b10336d471f2aec53de53bcd3626dc53655ade3ff576de7058"} Jun 09 17:17:45.365625 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.365585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" event={"ID":"4d4c092f-fbd6-4ce0-8868-6677172f902d","Type":"ContainerStarted","Data":"ae500d4cd99fc43884f8b6d710341b16f39a8510e5457b693c8a9127658840e8"} Jun 09 17:17:45.374568 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.374531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stkgm" event={"ID":"1f03aa8a-080b-41ae-bf13-ab966e96d7c5","Type":"ContainerStarted","Data":"ce6f35c9f2ccc8179c5301ef40e523af258711c290f77689a28eb2759737664f"} Jun 09 17:17:45.378541 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.378497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwlhx" event={"ID":"9f99dde7-d0a9-4841-bd41-36e6318af67c","Type":"ContainerStarted","Data":"74e84987c76ba2f7ca5a085a12ca4c79ec2311d03cb5ca48c9dfc89eeac1cf3a"} Jun 09 17:17:45.386195 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.386158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"829c4cd84633117a5a2372faebd1bf642589ccfa6741b43a090d73d3cf65e833"} Jun 09 17:17:45.389694 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.389660 2561 generic.go:356] "Generic (PLEG): container finished" podID="a69666f4c6a13164ab6093b94da8a9d9" containerID="8633deb9947b626ee0e64f179b28e398fdf57642cf4b7b2b51460c6203a096c4" exitCode=0 Jun 09 17:17:45.390303 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.390271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"a69666f4c6a13164ab6093b94da8a9d9","Type":"ContainerDied","Data":"8633deb9947b626ee0e64f179b28e398fdf57642cf4b7b2b51460c6203a096c4"} Jun 09 17:17:45.399400 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.399357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcchx" event={"ID":"ac03a354-9088-42a7-affe-c92e3569fd41","Type":"ContainerStarted","Data":"7e4a79a2f201a6c35ee8280a6be30ea860e6d433f2d228e36b492486c445c11c"} Jun 09 17:17:45.406200 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.406162 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gmdqn" event={"ID":"64fb8be3-2289-407c-855b-04ce0591b265","Type":"ContainerStarted","Data":"5f7101399d1b6b15d4911ad3f517f8bf188fcd463e8e8f6ef8f9f586e58fdcc9"} Jun 09 17:17:45.413109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.413072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerStarted","Data":"5f15f88659e4f774933c4102eb2d40d11f7389437239ff082873b9879d4f1dad"} Jun 09 17:17:45.422455 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.422170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57772" event={"ID":"1425bdc3-ca38-44d4-b1ac-c4a39a889451","Type":"ContainerStarted","Data":"a8bee5b36790b1efa51bdb2183c1aabe826038499263a935b675df9c51afe726"} Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.889097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.889150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.889301 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.889360 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:17:47.889342546 +0000 UTC m=+5.967490768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.889790 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:45.889902 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.889861 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:17:47.889844075 +0000 UTC m=+5.967992295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:45.989858 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:45.989764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:45.990030 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.990006 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:17:45.990030 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.990030 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:17:45.990164 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.990043 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:45.990164 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:45.990101 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:17:47.990081541 +0000 UTC m=+6.068229765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:46.289404 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.289338 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 17:12:44 +0000 UTC" deadline="2028-01-26 07:59:47.437155728 +0000 UTC" Jun 09 17:17:46.289404 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.289403 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14294h42m1.147757453s" Jun 09 17:17:46.325685 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.325611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:46.325860 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:46.325741 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:46.326153 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.326134 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:46.326255 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:46.326235 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:46.326322 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.326309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:46.326430 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:46.326394 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:46.431720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.431683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" event={"ID":"3f6ad2919053178a56c098c140bfb06e","Type":"ContainerStarted","Data":"4fd06c7bae95ad6b9fe90585bab69af55d819e9dd6e657f1c94840c02ccec3b2"} Jun 09 17:17:46.445820 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.445746 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-117.ec2.internal" podStartSLOduration=3.44572545 podStartE2EDuration="3.44572545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:17:46.44472398 +0000 UTC m=+4.522872222" watchObservedRunningTime="2026-06-09 17:17:46.44572545 +0000 UTC m=+4.523873692" Jun 09 17:17:46.449875 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:46.449843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" event={"ID":"a69666f4c6a13164ab6093b94da8a9d9","Type":"ContainerStarted","Data":"75423c44cb3a13e97a587d8af26bb507564b304472fccaf488595b08e4eda55a"} Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:47.909852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:47.909904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:47.910142 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:47.910223 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:17:51.910202848 +0000 UTC m=+9.988351071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:47.910710 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:47.910823 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:47.910768 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:17:51.910751532 +0000 UTC m=+9.988899750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:48.010258 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:48.010220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:48.010439 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.010370 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:17:48.010439 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.010396 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:17:48.010439 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.010409 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:48.010595 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.010465 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:17:52.01044708 +0000 UTC m=+10.088595318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:48.323655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:48.323655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:48.323810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.323809 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.323921 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:48.324232 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:48.323997 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:50.322891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:50.323045 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:50.323477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:50.323582 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:50.323656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:50.324058 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:50.323726 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:51.938698 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:51.938564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:51.938698 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:51.938629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:51.939319 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:51.938775 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:51.939319 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:51.938859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:17:59.938837529 +0000 UTC m=+18.016985747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:51.939319 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:51.938995 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:51.939319 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:51.939062 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:17:59.939044629 +0000 UTC m=+18.017192862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:52.040104 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:52.039927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:52.040282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.040159 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:17:52.040282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.040182 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:17:52.040282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.040193 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:52.040282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.040257 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:00.040239299 +0000 UTC m=+18.118387534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:17:52.325403 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:52.325313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:52.325403 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:52.325347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:52.325609 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:52.325309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:52.325609 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.325426 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:52.325609 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.325525 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:52.325609 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:52.325593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:54.323029 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:54.322994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:54.323501 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:54.323132 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:54.323501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:54.323192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:54.323501 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:54.323327 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:54.323501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:54.323386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:54.323501 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:54.323459 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:56.323374 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:56.323337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:56.323962 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:56.323477 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:56.323962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:56.323830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:56.323962 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:56.323933 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:56.324129 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:56.323981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:56.324129 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:56.324058 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:58.323202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:58.323162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:58.323654 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:58.323171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:17:58.323654 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:58.323297 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:58.323654 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:58.323303 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:17:58.323654 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:58.323393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:17:58.323654 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:58.323491 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:17:59.997060 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:59.997019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:17:59.997060 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:17:59.997065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:17:59.997551 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:59.997178 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:59.997551 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:59.997187 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:17:59.997551 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:59.997239 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:18:15.997218776 +0000 UTC m=+34.075366998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:17:59.997551 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:17:59.997259 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:18:15.997249528 +0000 UTC m=+34.075397747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:18:00.098112 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:00.098070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:00.098287 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.098260 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:18:00.098287 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.098287 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:18:00.098402 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.098301 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:18:00.098402 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.098369 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:16.098350968 +0000 UTC m=+34.176499204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:18:00.323259 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:00.323183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:00.323259 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:00.323221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:00.323479 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:00.323185 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:00.323479 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.323315 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:00.323479 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.323399 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:00.323624 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:00.323489 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:02.323446 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:02.323415 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:02.323908 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:02.323509 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:02.323908 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:02.323523 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:02.323908 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:02.323647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:02.323908 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:02.323683 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:02.323908 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:02.323790 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:04.323701 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.323319 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:04.324659 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.323320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:04.324659 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:04.323829 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:04.324659 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.323391 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:04.324659 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:04.323932 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:04.324659 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:04.323970 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:04.492572 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.492543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcchx" event={"ID":"ac03a354-9088-42a7-affe-c92e3569fd41","Type":"ContainerStarted","Data":"ac3150e37f867fb8d99ecead37b48182ce5c31b6e9e88af942af2e6f7ae0cb03"} Jun 09 17:18:04.494029 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.494004 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="bacb2a9f728728df5ff0ce67c68326c54ed5a77232fb10fc90c8f3509a381bc5" exitCode=0 Jun 09 17:18:04.494150 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.494044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"bacb2a9f728728df5ff0ce67c68326c54ed5a77232fb10fc90c8f3509a381bc5"} Jun 09 17:18:04.495444 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.495410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57772" event={"ID":"1425bdc3-ca38-44d4-b1ac-c4a39a889451","Type":"ContainerStarted","Data":"3e2436844b9b6a360cb6ef92e57d09ddb063e75b4b7123e12f994341fb15693e"} Jun 09 17:18:04.496952 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.496928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sjz89" event={"ID":"6cc24f10-4aad-4b65-90ba-9526b46ec235","Type":"ContainerStarted","Data":"c8de2b5ba41dce25f5d8a37f46bd29d6142a98db3cafcfd1c88e1f88ed6a44e0"} Jun 09 17:18:04.498368 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.498349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" event={"ID":"4d4c092f-fbd6-4ce0-8868-6677172f902d","Type":"ContainerStarted","Data":"b9adc2cdb6748b64acbe198293224a970fc9c5b572e1ad2a44385d80285ef6a4"} Jun 09 17:18:04.499650 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.499631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stkgm" event={"ID":"1f03aa8a-080b-41ae-bf13-ab966e96d7c5","Type":"ContainerStarted","Data":"55048256e1bc8c7725c88b2afff0e7e91642b76a5591be8205370e77d4209471"} Jun 09 17:18:04.500943 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.500920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwlhx" event={"ID":"9f99dde7-d0a9-4841-bd41-36e6318af67c","Type":"ContainerStarted","Data":"e2f7986840c90436ff23f9b47048c67563d81fc4c22ab762bf37ac88492e99b5"} Jun 09 17:18:04.503475 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:18:04.503811 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503774 2561 generic.go:356] "Generic (PLEG): container finished" podID="cd528e43-bc45-40c0-ad47-4ec9638b7774" containerID="f0ab9b61693160097ddf28382058ca50852d1d202dc53078029b0e404a26b9b2" exitCode=1 Jun 09 17:18:04.503863 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"31886a1c307cf97070b964963ebfa9a4a007739228af37b6a5eac34695fb51ec"} Jun 09 17:18:04.503905 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503870 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"9e5c93ac91ca305788ec8eedadcfc8208ec3fa8ec854288666c143d11272929b"} Jun 09 17:18:04.503905 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"51c3bff7824cc67d57343ceeb7f39d389d806e94aa867805fe6bacdc752d6c69"} Jun 09 17:18:04.503968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"4e1f0e0f48a2f6d1ea295401c1499a960e929b146846597abb4526c3b91197a1"} Jun 09 17:18:04.503968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerDied","Data":"f0ab9b61693160097ddf28382058ca50852d1d202dc53078029b0e404a26b9b2"} Jun 09 17:18:04.504023 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.503982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"d1cd376ea936557bd0bbf2881e0ba846f8881613e5daede9fd2f91d29459b51b"} Jun 09 17:18:04.508751 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.508716 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-117.ec2.internal" podStartSLOduration=21.508705135 podStartE2EDuration="21.508705135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:17:46.464321843 +0000 UTC m=+4.542470087" watchObservedRunningTime="2026-06-09 17:18:04.508705135 +0000 UTC m=+22.586853384" Jun 09 17:18:04.509100 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.509080 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fcchx" podStartSLOduration=3.663109091 podStartE2EDuration="22.509074218s" totalImagesPullingTime="18.845965127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:04.508416781 +0000 UTC m=+22.586565039" watchObservedRunningTime="2026-06-09 17:18:04.509074218 +0000 UTC m=+22.587222458" Jun 09 17:18:04.542168 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.542126 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sjz89" podStartSLOduration=8.393786085 podStartE2EDuration="22.542111169s" totalImagesPullingTime="14.148325084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:04.541946409 +0000 UTC m=+22.620094652" watchObservedRunningTime="2026-06-09 17:18:04.542111169 +0000 UTC m=+22.620259410" Jun 09 17:18:04.555089 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.555048 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bwlhx" podStartSLOduration=3.7088125400000003 podStartE2EDuration="22.555033826s" totalImagesPullingTime="18.846221286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:04.554683568 +0000 UTC m=+22.632831809" watchObservedRunningTime="2026-06-09 17:18:04.555033826 +0000 UTC m=+22.633182067" Jun 09 17:18:04.570541 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.570494 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-stkgm" podStartSLOduration=3.733234837 podStartE2EDuration="22.570476365s" totalImagesPullingTime="18.837241528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:04.5702405 +0000 UTC m=+22.648388741" watchObservedRunningTime="2026-06-09 17:18:04.570476365 +0000 UTC m=+22.648624605" Jun 09 17:18:04.584459 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:04.584408 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-57772" podStartSLOduration=3.73863365 podStartE2EDuration="22.584390861s" totalImagesPullingTime="18.845757211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:04.58405478 +0000 UTC m=+22.662203019" watchObservedRunningTime="2026-06-09 17:18:04.584390861 +0000 UTC m=+22.662539101" Jun 09 17:18:05.275517 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.275469 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 17:18:05.316704 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.316545 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T17:18:05.27549594Z","UUID":"d90100bf-c2eb-4734-acb8-aa5bfdad9763","Handler":null,"Name":"","Endpoint":""} Jun 09 17:18:05.318284 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.318261 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 17:18:05.318401 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.318307 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 17:18:05.358610 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.358578 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:18:05.508104 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.508022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" event={"ID":"4d4c092f-fbd6-4ce0-8868-6677172f902d","Type":"ContainerStarted","Data":"f235fb6849d043fd122f07c865a9c9a2008c0d6061555eb2d2fee26c39152d21"} Jun 09 17:18:05.509661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.509630 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gmdqn" event={"ID":"64fb8be3-2289-407c-855b-04ce0591b265","Type":"ContainerStarted","Data":"7956ca65e17e65e196f604c24a89c514cd24d873000cd64bd42e149b321590e1"} Jun 09 17:18:05.525017 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:05.524959 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gmdqn" podStartSLOduration=4.676791643 podStartE2EDuration="23.5249456s" totalImagesPullingTime="18.848153957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:05.524069844 +0000 UTC m=+23.602218085" watchObservedRunningTime="2026-06-09 17:18:05.5249456 +0000 UTC m=+23.603093841" Jun 09 17:18:06.323031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:06.322810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:06.323168 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:06.322811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:06.323168 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:06.323137 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:06.323282 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:06.322864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:06.323282 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:06.323217 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:06.323392 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:06.323280 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:06.515968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:06.515900 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:18:06.516633 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:06.516601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"a4fcd254e5c8de35109ebc5e81d3cadd51af230884127265965f66e51b335801"} Jun 09 17:18:07.521909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:07.521864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" event={"ID":"4d4c092f-fbd6-4ce0-8868-6677172f902d","Type":"ContainerStarted","Data":"7ade8d49c7e942933187b1e9bfcb5ac7be94c1dac2ce9ffcd0690444d9415551"} Jun 09 17:18:07.538767 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:07.538690 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdb2f" podStartSLOduration=4.042660585 podStartE2EDuration="25.538673125s" totalImagesPullingTime="21.49601254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:07.538644083 +0000 UTC m=+25.616792324" watchObservedRunningTime="2026-06-09 17:18:07.538673125 +0000 UTC m=+25.616821344" Jun 09 17:18:08.323349 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:08.323299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:08.323510 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:08.323299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:08.323510 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:08.323449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:08.323510 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:08.323441 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:08.323655 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:08.323558 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:08.323700 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:08.323665 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:08.670623 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:08.670432 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:18:08.671162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:08.671145 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:18:09.529111 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.529075 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="fbb698f638a87d136caf2886b37b13f106916625cd9beaf2faf5a77ef5c55375" exitCode=0 Jun 09 17:18:09.529345 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.529154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"fbb698f638a87d136caf2886b37b13f106916625cd9beaf2faf5a77ef5c55375"} Jun 09 17:18:09.532703 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.532688 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:18:09.533076 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533050 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"3485ca85bb33e1eee7cfc9a6bf96661fe4d1de4970111a9b114248293193623e"} Jun 09 17:18:09.533385 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533364 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:09.533563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533434 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:09.533563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533487 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:09.533563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533518 2561 scope.go:117] "RemoveContainer" containerID="f0ab9b61693160097ddf28382058ca50852d1d202dc53078029b0e404a26b9b2" Jun 09 17:18:09.533729 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.533715 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sjz89" Jun 09 17:18:09.550583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.550557 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:09.550841 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:09.550823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:10.323144 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.323112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:10.323144 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.323131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:10.323578 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.323112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:10.323578 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.323269 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:10.323578 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.323405 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:10.323578 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.323484 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:10.497550 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.497367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f4772"] Jun 09 17:18:10.500426 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.500396 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2t24f"] Jun 09 17:18:10.508475 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.508448 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cf7tq"] Jun 09 17:18:10.538225 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.538145 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="99eca1611a03f6b1483fb37969030146f884378d6e56ef9a24c1b48815e82e0d" exitCode=0 Jun 09 17:18:10.538379 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.538229 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"99eca1611a03f6b1483fb37969030146f884378d6e56ef9a24c1b48815e82e0d"} Jun 09 17:18:10.542728 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.542710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:18:10.543151 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.543113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" event={"ID":"cd528e43-bc45-40c0-ad47-4ec9638b7774","Type":"ContainerStarted","Data":"38c89fe3a08816da28c1cfca81d31fa4466546d8d60c4cf1ba7316d0aa44d11d"} Jun 09 17:18:10.543418 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.543397 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:10.543534 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.543491 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:10.543534 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.543528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:10.543666 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.543639 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:10.543666 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.543655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:10.543791 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:10.543756 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:10.582187 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:10.582138 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" podStartSLOduration=9.62599428 podStartE2EDuration="28.582123787s" totalImagesPullingTime="18.956129507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:10.580812826 +0000 UTC m=+28.658961059" watchObservedRunningTime="2026-06-09 17:18:10.582123787 +0000 UTC m=+28.660272006" Jun 09 17:18:11.548101 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:11.548060 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="d51bd801d264f100197a7efee34a171c2266658e3581a5a6f26ba3e8878053d6" exitCode=0 Jun 09 17:18:11.548551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:11.548153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"d51bd801d264f100197a7efee34a171c2266658e3581a5a6f26ba3e8878053d6"} Jun 09 17:18:12.324633 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:12.324602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:12.324820 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:12.324708 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:12.324820 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:12.324747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:12.324820 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:12.324750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:12.324992 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:12.324848 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:12.324992 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:12.324922 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:14.323178 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:14.323114 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:14.324022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:14.323131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:14.324022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:14.323248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:14.324022 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:14.323245 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf7tq" podUID="7073a4f0-8b38-482f-a977-2f1ceeba037a" Jun 09 17:18:14.324022 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:14.323335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:18:14.324022 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:14.323418 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t24f" podUID="c63158db-8088-4f01-aea8-012cac9161a4" Jun 09 17:18:16.010884 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.010839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:16.011595 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.010897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:16.011595 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.011020 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:18:16.011595 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.011057 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:18:16.011595 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.011106 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret podName:7073a4f0-8b38-482f-a977-2f1ceeba037a nodeName:}" failed. No retries permitted until 2026-06-09 17:18:48.011083572 +0000 UTC m=+66.089231792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret") pod "global-pull-secret-syncer-cf7tq" (UID: "7073a4f0-8b38-482f-a977-2f1ceeba037a") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:18:16.011595 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.011128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:18:48.011116684 +0000 UTC m=+66.089264904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:18:16.112187 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.112154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:16.112363 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.112319 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:18:16.112363 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.112335 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:18:16.112363 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.112345 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rwmfl for pod openshift-network-diagnostics/network-check-target-2t24f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:18:16.112506 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.112399 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl podName:c63158db-8088-4f01-aea8-012cac9161a4 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:48.1123832 +0000 UTC m=+66.190531440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwmfl" (UniqueName: "kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl") pod "network-check-target-2t24f" (UID: "c63158db-8088-4f01-aea8-012cac9161a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:18:16.267663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.267588 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-117.ec2.internal" event="NodeReady" Jun 09 17:18:16.267838 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.267710 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 17:18:16.310602 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.310567 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9f6sv"] Jun 09 17:18:16.329995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.329967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.332471 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.332443 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 17:18:16.332607 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.332443 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 17:18:16.332607 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.332445 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hczml\"" Jun 09 17:18:16.333102 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.333078 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-67c5n"] Jun 09 17:18:16.354094 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354065 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9f6sv"] Jun 09 17:18:16.354208 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354101 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-67c5n"] Jun 09 17:18:16.354208 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.354273 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:16.354318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:16.354542 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.354521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:16.356530 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.356513 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 17:18:16.356862 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.356839 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 17:18:16.356987 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.356879 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-krk66\"" Jun 09 17:18:16.356987 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.356950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 17:18:16.356987 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.356977 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdmkc\"" Jun 09 17:18:16.357160 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.357067 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 17:18:16.357551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.357536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 17:18:16.357649 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.357555 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 17:18:16.357649 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.357568 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 17:18:16.357649 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.357569 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mf9vr\"" Jun 09 17:18:16.414854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.414822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-config-volume\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.414854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.414855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.415066 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.414877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntk5x\" (UniqueName: \"kubernetes.io/projected/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-kube-api-access-ntk5x\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.415066 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.414948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-tmp-dir\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516179 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmhn\" (UniqueName: \"kubernetes.io/projected/70c0d637-d3dc-4e28-beab-1aeef4d36c05-kube-api-access-pfmhn\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.516363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-config-volume\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70c0d637-d3dc-4e28-beab-1aeef4d36c05-cert\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.516363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntk5x\" (UniqueName: \"kubernetes.io/projected/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-kube-api-access-ntk5x\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-tmp-dir\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516627 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.516376 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:16.516627 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:16.516446 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:17.016426387 +0000 UTC m=+35.094574621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:16.516867 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-tmp-dir\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.516925 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.516908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-config-volume\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.528950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.528883 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntk5x\" (UniqueName: \"kubernetes.io/projected/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-kube-api-access-ntk5x\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:16.617527 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.617494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmhn\" (UniqueName: \"kubernetes.io/projected/70c0d637-d3dc-4e28-beab-1aeef4d36c05-kube-api-access-pfmhn\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.617715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.617582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70c0d637-d3dc-4e28-beab-1aeef4d36c05-cert\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.620060 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.620035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70c0d637-d3dc-4e28-beab-1aeef4d36c05-cert\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.625950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.625928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmhn\" (UniqueName: \"kubernetes.io/projected/70c0d637-d3dc-4e28-beab-1aeef4d36c05-kube-api-access-pfmhn\") pod \"ingress-canary-67c5n\" (UID: \"70c0d637-d3dc-4e28-beab-1aeef4d36c05\") " pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.663873 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.663845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-67c5n" Jun 09 17:18:16.855557 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:16.855496 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-67c5n"] Jun 09 17:18:16.860176 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:18:16.860141 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c0d637_d3dc_4e28_beab_1aeef4d36c05.slice/crio-1e9747ec40243129a23b9bbddcc6b19772915dafb2ab43d5d7e426ace95bbd1b WatchSource:0}: Error finding container 1e9747ec40243129a23b9bbddcc6b19772915dafb2ab43d5d7e426ace95bbd1b: Status 404 returned error can't find the container with id 1e9747ec40243129a23b9bbddcc6b19772915dafb2ab43d5d7e426ace95bbd1b Jun 09 17:18:17.021365 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:17.021319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:17.022014 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:17.021508 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:17.022014 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:17.021598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:18.021577214 +0000 UTC m=+36.099725433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:17.563879 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:17.563842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-67c5n" event={"ID":"70c0d637-d3dc-4e28-beab-1aeef4d36c05","Type":"ContainerStarted","Data":"1e9747ec40243129a23b9bbddcc6b19772915dafb2ab43d5d7e426ace95bbd1b"} Jun 09 17:18:17.566489 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:17.566464 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="4128b97441d5b801adcb2c82c68245cb0a441bb494410d69f48c258f7cb0d182" exitCode=0 Jun 09 17:18:17.566605 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:17.566506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"4128b97441d5b801adcb2c82c68245cb0a441bb494410d69f48c258f7cb0d182"} Jun 09 17:18:18.028587 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:18.028550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:18.029021 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:18.028708 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:18.029021 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:18.028769 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:20.028754259 +0000 UTC m=+38.106902482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:18.576482 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:18.576247 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf847c2e-14a7-4d96-b898-bd618ae46f0a" containerID="67295791b3f6cc5ebfd908c7428880c912971c81d4564cf6629ce8605a4f0c19" exitCode=0 Jun 09 17:18:18.576482 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:18.576321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerDied","Data":"67295791b3f6cc5ebfd908c7428880c912971c81d4564cf6629ce8605a4f0c19"} Jun 09 17:18:19.583641 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:19.583605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" event={"ID":"bf847c2e-14a7-4d96-b898-bd618ae46f0a","Type":"ContainerStarted","Data":"76a76cbfcb59cbf0c8654b9ea559d203e40864c1a65f2d1ec0e296a9caaad324"} Jun 09 17:18:19.605914 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:19.605846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cdf7p" podStartSLOduration=8.205431033 podStartE2EDuration="37.605823219s" totalImagesPullingTime="29.400392186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:19.605571623 +0000 UTC m=+37.683719864" watchObservedRunningTime="2026-06-09 17:18:19.605823219 +0000 UTC m=+37.683971452" Jun 09 17:18:20.045014 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:20.044978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:20.045123 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:20.045104 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:20.045163 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:20.045156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:24.045141281 +0000 UTC m=+42.123289500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:20.587333 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:20.587237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-67c5n" event={"ID":"70c0d637-d3dc-4e28-beab-1aeef4d36c05","Type":"ContainerStarted","Data":"e10d8b269ebb34f1b3517c384a9e848b44adde22122bd12faa2d64d18ad4d0b2"} Jun 09 17:18:20.600688 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:20.600622 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-67c5n" podStartSLOduration=1.243934088 podStartE2EDuration="4.600607085s" totalImagesPullingTime="3.356672997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:20.600502405 +0000 UTC m=+38.678650647" watchObservedRunningTime="2026-06-09 17:18:20.600607085 +0000 UTC m=+38.678755320" Jun 09 17:18:24.071699 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:24.071651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:24.072124 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:24.071829 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:24.072124 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:24.071898 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:32.071878259 +0000 UTC m=+50.150026497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:32.129350 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:32.129307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:32.129937 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:32.129458 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:32.129937 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:32.129530 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:18:48.129514059 +0000 UTC m=+66.207662278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:41.558161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:41.558131 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k4bl6" Jun 09 17:18:48.033264 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.033219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:48.033264 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.033265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:18:48.035695 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.035674 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 17:18:48.035927 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.035915 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 17:18:48.044121 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:48.044105 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 17:18:48.044179 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:48.044162 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:19:52.044146325 +0000 UTC m=+130.122294544 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : secret "metrics-daemon-secret" not found Jun 09 17:18:48.047467 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.047436 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7073a4f0-8b38-482f-a977-2f1ceeba037a-original-pull-secret\") pod \"global-pull-secret-syncer-cf7tq\" (UID: \"7073a4f0-8b38-482f-a977-2f1ceeba037a\") " pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:48.133753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.133706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:18:48.133753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.133753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:48.134031 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:48.133877 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:18:48.134031 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:18:48.133953 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:19:20.133933103 +0000 UTC m=+98.212081339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:18:48.136786 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.136766 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 17:18:48.146760 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.146737 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 17:18:48.157940 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.157916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmfl\" (UniqueName: \"kubernetes.io/projected/c63158db-8088-4f01-aea8-012cac9161a4-kube-api-access-rwmfl\") pod \"network-check-target-2t24f\" (UID: \"c63158db-8088-4f01-aea8-012cac9161a4\") " pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:48.172199 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.172168 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdmkc\"" Jun 09 17:18:48.175960 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.175944 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf7tq" Jun 09 17:18:48.180091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.180070 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:48.355522 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.355496 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cf7tq"] Jun 09 17:18:48.358228 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:18:48.358198 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7073a4f0_8b38_482f_a977_2f1ceeba037a.slice/crio-5227b692164fbd594b5afee0a7146ba85095d38d0aafd97a7da1f8a2a1ffdff0 WatchSource:0}: Error finding container 5227b692164fbd594b5afee0a7146ba85095d38d0aafd97a7da1f8a2a1ffdff0: Status 404 returned error can't find the container with id 5227b692164fbd594b5afee0a7146ba85095d38d0aafd97a7da1f8a2a1ffdff0 Jun 09 17:18:48.377326 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.377298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2t24f"] Jun 09 17:18:48.380221 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:18:48.380195 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63158db_8088_4f01_aea8_012cac9161a4.slice/crio-49282af190cdf9f640feabd035c29469d282a887bf508c89c82265c3f0f8f1ca WatchSource:0}: Error finding container 49282af190cdf9f640feabd035c29469d282a887bf508c89c82265c3f0f8f1ca: Status 404 returned error can't find the container with id 49282af190cdf9f640feabd035c29469d282a887bf508c89c82265c3f0f8f1ca Jun 09 17:18:48.658453 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.658417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cf7tq" event={"ID":"7073a4f0-8b38-482f-a977-2f1ceeba037a","Type":"ContainerStarted","Data":"5227b692164fbd594b5afee0a7146ba85095d38d0aafd97a7da1f8a2a1ffdff0"} Jun 09 17:18:48.659695 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:48.659674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2t24f" event={"ID":"c63158db-8088-4f01-aea8-012cac9161a4","Type":"ContainerStarted","Data":"49282af190cdf9f640feabd035c29469d282a887bf508c89c82265c3f0f8f1ca"} Jun 09 17:18:53.675122 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:53.675078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2t24f" event={"ID":"c63158db-8088-4f01-aea8-012cac9161a4","Type":"ContainerStarted","Data":"479723e81e8cc9e7db2fc59e40ae475f2e5d5a5ac96ff399c3be3eb6c29d3af1"} Jun 09 17:18:53.675586 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:53.675169 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:18:53.676460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:53.676437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cf7tq" event={"ID":"7073a4f0-8b38-482f-a977-2f1ceeba037a","Type":"ContainerStarted","Data":"3b0ba6b750861fbc9d4eb135073e72ab2e1743ecf8757117ca699b75bf4f4f86"} Jun 09 17:18:53.691883 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:18:53.691840 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2t24f" podStartSLOduration=67.254973276 podStartE2EDuration="1m11.691826648s" totalImagesPullingTime="4.436853372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:53.690115834 +0000 UTC m=+71.768264074" watchObservedRunningTime="2026-06-09 17:18:53.691826648 +0000 UTC m=+71.769974888" Jun 09 17:19:20.166280 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:19:20.166243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:19:20.166638 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:19:20.166398 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:19:20.166638 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:19:20.166463 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:24.166448981 +0000 UTC m=+162.244597200 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:19:24.681900 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:19:24.681870 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2t24f" Jun 09 17:19:24.696227 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:19:24.696176 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cf7tq" podStartSLOduration=98.232895126 podStartE2EDuration="1m42.696159621s" totalImagesPullingTime="4.463264495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:18:53.702938954 +0000 UTC m=+71.781087196" watchObservedRunningTime="2026-06-09 17:19:24.696159621 +0000 UTC m=+102.774307861" Jun 09 17:19:52.082198 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:19:52.082139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:19:52.082692 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:19:52.082298 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 17:19:52.082692 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:19:52.082369 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs podName:1e79cb33-2aae-49de-afef-e45c39fe247d nodeName:}" failed. No retries permitted until 2026-06-09 17:21:54.082351664 +0000 UTC m=+252.160499882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs") pod "network-metrics-daemon-f4772" (UID: "1e79cb33-2aae-49de-afef-e45c39fe247d") : secret "metrics-daemon-secret" not found Jun 09 17:20:19.339362 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:19.339296 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9f6sv" podUID="32e20b2e-1a4e-4ef3-97ae-9933d40b8048" Jun 09 17:20:19.379922 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:19.379884 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f4772" podUID="1e79cb33-2aae-49de-afef-e45c39fe247d" Jun 09 17:20:19.877868 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:19.877841 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:20:24.202637 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:24.202595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:20:24.203079 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:24.202755 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:20:24.203079 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:24.202858 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls podName:32e20b2e-1a4e-4ef3-97ae-9933d40b8048 nodeName:}" failed. No retries permitted until 2026-06-09 17:22:26.202839269 +0000 UTC m=+284.280987505 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls") pod "dns-default-9f6sv" (UID: "32e20b2e-1a4e-4ef3-97ae-9933d40b8048") : secret "dns-default-metrics-tls" not found Jun 09 17:20:26.538513 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.538429 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz"] Jun 09 17:20:26.541152 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.541135 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln"] Jun 09 17:20:26.541282 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.541262 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.543659 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.543638 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42"] Jun 09 17:20:26.543811 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.543755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.546254 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.546236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.550558 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.550262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 17:20:26.550558 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.550372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fkg7j\"" Jun 09 17:20:26.550558 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.550502 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 17:20:26.553440 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.553418 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 17:20:26.553603 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.553425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 17:20:26.563191 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.563315 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563223 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wwtgl\"" Jun 09 17:20:26.563315 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563279 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.563315 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563297 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 17:20:26.563480 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.563480 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563384 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 17:20:26.563582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tqtw9\"" Jun 09 17:20:26.563636 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.563579 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.567667 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.567571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42"] Jun 09 17:20:26.567821 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.567768 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln"] Jun 09 17:20:26.568221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.568203 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz"] Jun 09 17:20:26.619463 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.619463 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-config\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wfb\" (UniqueName: \"kubernetes.io/projected/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-kube-api-access-79wfb\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bjt\" (UniqueName: \"kubernetes.io/projected/f2d2e1d9-1846-4797-8202-a789070a4c7f-kube-api-access-86bjt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45cd3753-5f35-47da-b4a3-651f2ebdf097-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2d2e1d9-1846-4797-8202-a789070a4c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.619715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.619705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2d2e1d9-1846-4797-8202-a789070a4c7f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.637313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.637278 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g"] Jun 09 17:20:26.640264 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.640245 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb"] Jun 09 17:20:26.640378 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.640359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" Jun 09 17:20:26.642924 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.642903 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4q5n"] Jun 09 17:20:26.643055 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.643018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.645411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.645390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zx6zb\"" Jun 09 17:20:26.645573 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.645440 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.645643 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.645570 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-7ttfv"] Jun 09 17:20:26.645700 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.645643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.646655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.646635 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.648388 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.648370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.649917 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.649895 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.649999 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.649965 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6nw9r\"" Jun 09 17:20:26.649999 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.649892 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 17:20:26.649999 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.649898 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.651419 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.651395 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 17:20:26.654727 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.654706 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.654865 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.654750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-26w9n\"" Jun 09 17:20:26.654865 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.654774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.654865 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.654813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 17:20:26.665881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.665858 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.667976 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.667955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.668116 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.668020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 17:20:26.668228 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.668144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ncs55\"" Jun 09 17:20:26.668228 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.668047 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 17:20:26.668999 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.668983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb"] Jun 09 17:20:26.711629 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.711596 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 17:20:26.714242 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.714214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4q5n"] Jun 09 17:20:26.716641 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.716621 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7ttfv"] Jun 09 17:20:26.717267 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.717254 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g"] Jun 09 17:20:26.720170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-trusted-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.720291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bjt\" (UniqueName: \"kubernetes.io/projected/f2d2e1d9-1846-4797-8202-a789070a4c7f-kube-api-access-86bjt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.720291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-config\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.720291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45cd3753-5f35-47da-b4a3-651f2ebdf097-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.720291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2d2e1d9-1846-4797-8202-a789070a4c7f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.720291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-service-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17cae500-d885-4537-93f7-8dc2bf6c966d-serving-cert\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvvp\" (UniqueName: \"kubernetes.io/projected/5070ce3a-0ffa-4cd1-b243-4ec6f54df564-kube-api-access-4zvvp\") pod \"volume-data-source-validator-78dd696465-cxb8g\" (UID: \"5070ce3a-0ffa-4cd1-b243-4ec6f54df564\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720429 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9nq8\" (UniqueName: \"kubernetes.io/projected/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-kube-api-access-p9nq8\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xd82\" (UniqueName: \"kubernetes.io/projected/17cae500-d885-4537-93f7-8dc2bf6c966d-kube-api-access-2xd82\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.720593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2d2e1d9-1846-4797-8202-a789070a4c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbrgl\" (UniqueName: \"kubernetes.io/projected/40be495a-bd22-43d6-a996-c8bb2c140eb3-kube-api-access-pbrgl\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-snapshots\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-tmp\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.720734 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-serving-cert\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.720825 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:27.220782103 +0000 UTC m=+165.298930322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-trusted-ca\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-config\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2d2e1d9-1846-4797-8202-a789070a4c7f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.720976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wfb\" (UniqueName: \"kubernetes.io/projected/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-kube-api-access-79wfb\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.721049 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.721016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45cd3753-5f35-47da-b4a3-651f2ebdf097-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:26.721453 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.721364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-config\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.722820 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.722781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2d2e1d9-1846-4797-8202-a789070a4c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.722900 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.722782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.732819 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.732783 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h"] Jun 09 17:20:26.732928 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.732902 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wfb\" (UniqueName: \"kubernetes.io/projected/2a313a8d-bbf3-4956-a0c4-a776bb0324d7-kube-api-access-79wfb\") pod \"service-ca-operator-6bc5ff68f5-r5t42\" (UID: \"2a313a8d-bbf3-4956-a0c4-a776bb0324d7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.734365 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.734343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bjt\" (UniqueName: \"kubernetes.io/projected/f2d2e1d9-1846-4797-8202-a789070a4c7f-kube-api-access-86bjt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-ksbln\" (UID: \"f2d2e1d9-1846-4797-8202-a789070a4c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.736716 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.736700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.739369 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.739350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 17:20:26.739452 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.739366 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fqwff\"" Jun 09 17:20:26.739860 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.739842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 17:20:26.742209 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.742190 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 17:20:26.742641 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.742617 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 17:20:26.758955 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.758923 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h"] Jun 09 17:20:26.822204 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xd82\" (UniqueName: \"kubernetes.io/projected/17cae500-d885-4537-93f7-8dc2bf6c966d-kube-api-access-2xd82\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822204 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822148 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbrgl\" (UniqueName: \"kubernetes.io/projected/40be495a-bd22-43d6-a996-c8bb2c140eb3-kube-api-access-pbrgl\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.822204 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-snapshots\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822204 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-tmp\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-serving-cert\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-trusted-ca\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-trusted-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6r7\" (UniqueName: \"kubernetes.io/projected/7a5bc36e-9c21-4947-b782-e815047a8e6d-kube-api-access-5w6r7\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-config\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.822594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a5bc36e-9c21-4947-b782-e815047a8e6d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.822910 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-service-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822910 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17cae500-d885-4537-93f7-8dc2bf6c966d-serving-cert\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822910 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-tmp\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.822910 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17cae500-d885-4537-93f7-8dc2bf6c966d-snapshots\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvvp\" (UniqueName: \"kubernetes.io/projected/5070ce3a-0ffa-4cd1-b243-4ec6f54df564-kube-api-access-4zvvp\") pod \"volume-data-source-validator-78dd696465-cxb8g\" (UID: \"5070ce3a-0ffa-4cd1-b243-4ec6f54df564\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.822986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9nq8\" (UniqueName: \"kubernetes.io/projected/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-kube-api-access-p9nq8\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.823035 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:20:26.823109 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.823108 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls podName:40be495a-bd22-43d6-a996-c8bb2c140eb3 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:27.32308737 +0000 UTC m=+165.401235604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qk7gb" (UID: "40be495a-bd22-43d6-a996-c8bb2c140eb3") : secret "samples-operator-tls" not found Jun 09 17:20:26.823416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.823390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-trusted-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.823508 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.823487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-trusted-ca\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.823628 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.823605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cae500-d885-4537-93f7-8dc2bf6c966d-service-ca-bundle\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.823682 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.823664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-config\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.824938 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.824913 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-serving-cert\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.825291 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.825276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17cae500-d885-4537-93f7-8dc2bf6c966d-serving-cert\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.832246 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.832208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbrgl\" (UniqueName: \"kubernetes.io/projected/40be495a-bd22-43d6-a996-c8bb2c140eb3-kube-api-access-pbrgl\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:26.832430 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.832410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvvp\" (UniqueName: \"kubernetes.io/projected/5070ce3a-0ffa-4cd1-b243-4ec6f54df564-kube-api-access-4zvvp\") pod \"volume-data-source-validator-78dd696465-cxb8g\" (UID: \"5070ce3a-0ffa-4cd1-b243-4ec6f54df564\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" Jun 09 17:20:26.832766 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.832747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xd82\" (UniqueName: \"kubernetes.io/projected/17cae500-d885-4537-93f7-8dc2bf6c966d-kube-api-access-2xd82\") pod \"insights-operator-896549976-7ttfv\" (UID: \"17cae500-d885-4537-93f7-8dc2bf6c966d\") " pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:26.833056 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.833038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9nq8\" (UniqueName: \"kubernetes.io/projected/02bb28ee-1fb5-4b9e-ae61-168fae629ec9-kube-api-access-p9nq8\") pod \"console-operator-668fdbf85c-s4q5n\" (UID: \"02bb28ee-1fb5-4b9e-ae61-168fae629ec9\") " pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.859046 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.859019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" Jun 09 17:20:26.864131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.864112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" Jun 09 17:20:26.924278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.923547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.924278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.923679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6r7\" (UniqueName: \"kubernetes.io/projected/7a5bc36e-9c21-4947-b782-e815047a8e6d-kube-api-access-5w6r7\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.924278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.923717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a5bc36e-9c21-4947-b782-e815047a8e6d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.924278 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.924156 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:26.924278 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:26.924246 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:27.424223009 +0000 UTC m=+165.502371228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:26.925048 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.925023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a5bc36e-9c21-4947-b782-e815047a8e6d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.934269 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.934212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6r7\" (UniqueName: \"kubernetes.io/projected/7a5bc36e-9c21-4947-b782-e815047a8e6d-kube-api-access-5w6r7\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:26.950630 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.950558 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" Jun 09 17:20:26.964938 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.964898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:26.970623 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:26.970597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7ttfv" Jun 09 17:20:27.001739 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.001683 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln"] Jun 09 17:20:27.005878 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:27.005842 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d2e1d9_1846_4797_8202_a789070a4c7f.slice/crio-cec4b3c79319b25e6a8f79fb729f8f5cc26ed53520f2bd35a42df377c2153013 WatchSource:0}: Error finding container cec4b3c79319b25e6a8f79fb729f8f5cc26ed53520f2bd35a42df377c2153013: Status 404 returned error can't find the container with id cec4b3c79319b25e6a8f79fb729f8f5cc26ed53520f2bd35a42df377c2153013 Jun 09 17:20:27.021136 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.021058 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42"] Jun 09 17:20:27.108663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.108623 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g"] Jun 09 17:20:27.113029 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:27.113003 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5070ce3a_0ffa_4cd1_b243_4ec6f54df564.slice/crio-d3a9c15e42b25b24938d86ebb028c26b00b924d63b441020851b9c07fcf296ce WatchSource:0}: Error finding container d3a9c15e42b25b24938d86ebb028c26b00b924d63b441020851b9c07fcf296ce: Status 404 returned error can't find the container with id d3a9c15e42b25b24938d86ebb028c26b00b924d63b441020851b9c07fcf296ce Jun 09 17:20:27.126568 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.126546 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7ttfv"] Jun 09 17:20:27.128843 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:27.128781 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cae500_d885_4537_93f7_8dc2bf6c966d.slice/crio-34b49e40949da7e14e628ba30b9f3609509c77c1344856f991fb5b42a33486bb WatchSource:0}: Error finding container 34b49e40949da7e14e628ba30b9f3609509c77c1344856f991fb5b42a33486bb: Status 404 returned error can't find the container with id 34b49e40949da7e14e628ba30b9f3609509c77c1344856f991fb5b42a33486bb Jun 09 17:20:27.143054 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.143026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-s4q5n"] Jun 09 17:20:27.145954 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:27.145926 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bb28ee_1fb5_4b9e_ae61_168fae629ec9.slice/crio-e3cf293cc3b07031d4c5f14e28f0497e14149fa51fadcaf0d9eeffcecfb5fb4b WatchSource:0}: Error finding container e3cf293cc3b07031d4c5f14e28f0497e14149fa51fadcaf0d9eeffcecfb5fb4b: Status 404 returned error can't find the container with id e3cf293cc3b07031d4c5f14e28f0497e14149fa51fadcaf0d9eeffcecfb5fb4b Jun 09 17:20:27.225582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.225551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:27.225754 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.225702 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:27.225793 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.225767 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:28.225751176 +0000 UTC m=+166.303899396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:27.326154 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.326069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:27.326297 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.326185 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:20:27.326297 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.326241 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls podName:40be495a-bd22-43d6-a996-c8bb2c140eb3 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:28.326226713 +0000 UTC m=+166.404374955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qk7gb" (UID: "40be495a-bd22-43d6-a996-c8bb2c140eb3") : secret "samples-operator-tls" not found Jun 09 17:20:27.427027 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.426989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:27.427202 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.427148 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:27.427250 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:27.427214 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:28.427198175 +0000 UTC m=+166.505346394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:27.899437 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.899353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" event={"ID":"02bb28ee-1fb5-4b9e-ae61-168fae629ec9","Type":"ContainerStarted","Data":"e3cf293cc3b07031d4c5f14e28f0497e14149fa51fadcaf0d9eeffcecfb5fb4b"} Jun 09 17:20:27.901112 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.901004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" event={"ID":"2a313a8d-bbf3-4956-a0c4-a776bb0324d7","Type":"ContainerStarted","Data":"f76052280b3568985a081b1f0d945d55b73a9b12530406a401edc042e7b66931"} Jun 09 17:20:27.902929 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.902855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" event={"ID":"f2d2e1d9-1846-4797-8202-a789070a4c7f","Type":"ContainerStarted","Data":"cec4b3c79319b25e6a8f79fb729f8f5cc26ed53520f2bd35a42df377c2153013"} Jun 09 17:20:27.904648 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.904590 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7ttfv" event={"ID":"17cae500-d885-4537-93f7-8dc2bf6c966d","Type":"ContainerStarted","Data":"34b49e40949da7e14e628ba30b9f3609509c77c1344856f991fb5b42a33486bb"} Jun 09 17:20:27.906196 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:27.906137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" event={"ID":"5070ce3a-0ffa-4cd1-b243-4ec6f54df564","Type":"ContainerStarted","Data":"d3a9c15e42b25b24938d86ebb028c26b00b924d63b441020851b9c07fcf296ce"} Jun 09 17:20:28.234779 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:28.234130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:28.234779 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.234285 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:28.234779 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.234348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:30.234330068 +0000 UTC m=+168.312478290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:28.335251 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:28.335120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:28.335432 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.335304 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:20:28.335432 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.335373 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls podName:40be495a-bd22-43d6-a996-c8bb2c140eb3 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:30.335350267 +0000 UTC m=+168.413498493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qk7gb" (UID: "40be495a-bd22-43d6-a996-c8bb2c140eb3") : secret "samples-operator-tls" not found Jun 09 17:20:28.436215 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:28.436175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:28.436404 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.436348 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:28.436463 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:28.436431 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:30.436408875 +0000 UTC m=+168.514557096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:28.910609 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:28.910574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" event={"ID":"5070ce3a-0ffa-4cd1-b243-4ec6f54df564","Type":"ContainerStarted","Data":"0cbde9d83fab8b1f319a2e7b111d722b337b37507db64e42b660c105bd4b079c"} Jun 09 17:20:28.924825 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:28.924748 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cxb8g" podStartSLOduration=1.481795466 podStartE2EDuration="2.924727963s" totalImagesPullingTime="1.442932497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:28.924087968 +0000 UTC m=+167.002236213" watchObservedRunningTime="2026-06-09 17:20:28.924727963 +0000 UTC m=+167.002876204" Jun 09 17:20:30.251149 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:30.251107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:30.251574 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.251255 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:30.251574 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.251337 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:34.25131926 +0000 UTC m=+172.329467482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:30.352477 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:30.352436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:30.352631 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.352583 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:20:30.352681 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.352647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls podName:40be495a-bd22-43d6-a996-c8bb2c140eb3 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:34.352629096 +0000 UTC m=+172.430777333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qk7gb" (UID: "40be495a-bd22-43d6-a996-c8bb2c140eb3") : secret "samples-operator-tls" not found Jun 09 17:20:30.453562 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:30.453521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:30.453727 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.453670 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:30.453777 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:30.453736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:34.453715672 +0000 UTC m=+172.531863892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:31.323899 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.323781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:20:31.921671 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.920895 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7ttfv" event={"ID":"17cae500-d885-4537-93f7-8dc2bf6c966d","Type":"ContainerStarted","Data":"d7adf17064357f0c6683b2f9716f0b3ee28738bc80dd359cf2bbaf5820e6abc1"} Jun 09 17:20:31.923790 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.923765 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/0.log" Jun 09 17:20:31.923957 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.923824 2561 generic.go:356] "Generic (PLEG): container finished" podID="02bb28ee-1fb5-4b9e-ae61-168fae629ec9" containerID="f0e22ffb9e705eb6c1f94ccd74a4097afc4d03143bd8fea49750dec7a1b0b0f7" exitCode=255 Jun 09 17:20:31.923957 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.923912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" event={"ID":"02bb28ee-1fb5-4b9e-ae61-168fae629ec9","Type":"ContainerDied","Data":"f0e22ffb9e705eb6c1f94ccd74a4097afc4d03143bd8fea49750dec7a1b0b0f7"} Jun 09 17:20:31.924207 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.924186 2561 scope.go:117] "RemoveContainer" containerID="f0e22ffb9e705eb6c1f94ccd74a4097afc4d03143bd8fea49750dec7a1b0b0f7" Jun 09 17:20:31.925868 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.925837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" event={"ID":"2a313a8d-bbf3-4956-a0c4-a776bb0324d7","Type":"ContainerStarted","Data":"be7edb4116f61ca5e5531025c014b96a7d3f778e2d7494839cea10f35313ac83"} Jun 09 17:20:31.927501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.927477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" event={"ID":"f2d2e1d9-1846-4797-8202-a789070a4c7f","Type":"ContainerStarted","Data":"08cbf17e8476d000a6821a609aab29b4ec3d5d99953fd35ff144fd3e7fcbe33d"} Jun 09 17:20:31.938510 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.938444 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-7ttfv" podStartSLOduration=2.098353255 podStartE2EDuration="5.938426387s" totalImagesPullingTime="3.840073132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:31.936987046 +0000 UTC m=+170.015135285" watchObservedRunningTime="2026-06-09 17:20:31.938426387 +0000 UTC m=+170.016574606" Jun 09 17:20:31.952973 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.952918 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" podStartSLOduration=1.991347878 podStartE2EDuration="5.95289691s" totalImagesPullingTime="3.961549032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:31.951375537 +0000 UTC m=+170.029523779" watchObservedRunningTime="2026-06-09 17:20:31.95289691 +0000 UTC m=+170.031045156" Jun 09 17:20:31.965617 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:31.965570 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" podStartSLOduration=2.018963983 podStartE2EDuration="5.965551247s" totalImagesPullingTime="3.946587264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:31.964440043 +0000 UTC m=+170.042588284" watchObservedRunningTime="2026-06-09 17:20:31.965551247 +0000 UTC m=+170.043699466" Jun 09 17:20:32.935535 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.935508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:20:32.935930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.935890 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/0.log" Jun 09 17:20:32.935930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.935919 2561 generic.go:356] "Generic (PLEG): container finished" podID="02bb28ee-1fb5-4b9e-ae61-168fae629ec9" containerID="614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff" exitCode=255 Jun 09 17:20:32.936022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.935994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" event={"ID":"02bb28ee-1fb5-4b9e-ae61-168fae629ec9","Type":"ContainerDied","Data":"614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff"} Jun 09 17:20:32.936075 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.936064 2561 scope.go:117] "RemoveContainer" containerID="f0e22ffb9e705eb6c1f94ccd74a4097afc4d03143bd8fea49750dec7a1b0b0f7" Jun 09 17:20:32.936326 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:32.936305 2561 scope.go:117] "RemoveContainer" containerID="614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff" Jun 09 17:20:32.936542 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:32.936505 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4q5n_openshift-console-operator(02bb28ee-1fb5-4b9e-ae61-168fae629ec9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" podUID="02bb28ee-1fb5-4b9e-ae61-168fae629ec9" Jun 09 17:20:33.940892 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:33.940862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:20:33.941269 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:33.941195 2561 scope.go:117] "RemoveContainer" containerID="614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff" Jun 09 17:20:33.941358 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:33.941338 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4q5n_openshift-console-operator(02bb28ee-1fb5-4b9e-ae61-168fae629ec9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" podUID="02bb28ee-1fb5-4b9e-ae61-168fae629ec9" Jun 09 17:20:34.285904 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:34.285761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:34.286058 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.285913 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:34.286058 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.285991 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:42.285966836 +0000 UTC m=+180.364115055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:34.386624 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:34.386585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:34.386870 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.386756 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:20:34.386870 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.386849 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls podName:40be495a-bd22-43d6-a996-c8bb2c140eb3 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:42.38683072 +0000 UTC m=+180.464978958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qk7gb" (UID: "40be495a-bd22-43d6-a996-c8bb2c140eb3") : secret "samples-operator-tls" not found Jun 09 17:20:34.487270 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:34.487237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:34.487420 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.487346 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:34.487420 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:34.487406 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:42.487390214 +0000 UTC m=+180.565538433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:35.657045 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:35.657012 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57772_1425bdc3-ca38-44d4-b1ac-c4a39a889451/dns-node-resolver/0.log" Jun 09 17:20:36.656363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:36.656330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwlhx_9f99dde7-d0a9-4841-bd41-36e6318af67c/node-ca/0.log" Jun 09 17:20:36.965438 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:36.965345 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:36.965438 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:36.965403 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:36.966005 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:36.965866 2561 scope.go:117] "RemoveContainer" containerID="614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff" Jun 09 17:20:36.966087 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:36.966063 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-s4q5n_openshift-console-operator(02bb28ee-1fb5-4b9e-ae61-168fae629ec9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" podUID="02bb28ee-1fb5-4b9e-ae61-168fae629ec9" Jun 09 17:20:37.456028 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:37.455997 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67c5n_70c0d637-d3dc-4e28-beab-1aeef4d36c05/serve-healthcheck-canary/0.log" Jun 09 17:20:38.257744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:38.257711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-ksbln_f2d2e1d9-1846-4797-8202-a789070a4c7f/kube-storage-version-migrator-operator/0.log" Jun 09 17:20:42.352328 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.352296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:42.352708 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:42.352396 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 17:20:42.352708 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:42.352444 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert podName:45cd3753-5f35-47da-b4a3-651f2ebdf097 nodeName:}" failed. No retries permitted until 2026-06-09 17:20:58.352430813 +0000 UTC m=+196.430579032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-92ltz" (UID: "45cd3753-5f35-47da-b4a3-651f2ebdf097") : secret "networking-console-plugin-cert" not found Jun 09 17:20:42.452607 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.452568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:42.454990 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.454959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40be495a-bd22-43d6-a996-c8bb2c140eb3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qk7gb\" (UID: \"40be495a-bd22-43d6-a996-c8bb2c140eb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:42.553824 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.553762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:42.554003 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:42.553915 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:42.554003 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:20:42.553987 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls podName:7a5bc36e-9c21-4947-b782-e815047a8e6d nodeName:}" failed. No retries permitted until 2026-06-09 17:20:58.553971179 +0000 UTC m=+196.632119399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-89t8h" (UID: "7a5bc36e-9c21-4947-b782-e815047a8e6d") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:20:42.559765 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.559737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6nw9r\"" Jun 09 17:20:42.568509 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.568478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" Jun 09 17:20:42.696690 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.696658 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb"] Jun 09 17:20:42.971541 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:42.971500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" event={"ID":"40be495a-bd22-43d6-a996-c8bb2c140eb3","Type":"ContainerStarted","Data":"f71ccf3e8d47ff2c5a836ed8bca3bce6c4221912f64b260cad13be3e8ed089d7"} Jun 09 17:20:44.979906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:44.979861 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" event={"ID":"40be495a-bd22-43d6-a996-c8bb2c140eb3","Type":"ContainerStarted","Data":"1a85b441daafd947a65c259d9e143e57c7a487bec5290bbd58640c5b51211fda"} Jun 09 17:20:44.980273 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:44.979925 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" event={"ID":"40be495a-bd22-43d6-a996-c8bb2c140eb3","Type":"ContainerStarted","Data":"db63a0eb9b0e4fe30826654ec4fc8b0f8c9c7de9007f9089113bbecdfd69900f"} Jun 09 17:20:45.006116 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:45.006013 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qk7gb" podStartSLOduration=16.991147034 podStartE2EDuration="19.005998087s" totalImagesPullingTime="2.014851053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:45.005689212 +0000 UTC m=+183.083837453" watchObservedRunningTime="2026-06-09 17:20:45.005998087 +0000 UTC m=+183.084146328" Jun 09 17:20:49.323493 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:49.323458 2561 scope.go:117] "RemoveContainer" containerID="614da193b731963b0f61845671d8ce3b50c53cfd1fe0e79db707732ee77451ff" Jun 09 17:20:49.996054 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:49.996025 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:20:49.996203 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:49.996080 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" event={"ID":"02bb28ee-1fb5-4b9e-ae61-168fae629ec9","Type":"ContainerStarted","Data":"585b3f21802c16444d6042330f520c037a6d4a31adc01a03694a2ce5cd2b002a"} Jun 09 17:20:49.996422 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:49.996398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:50.011111 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:50.011056 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" podStartSLOduration=20.18213717 podStartE2EDuration="24.011040485s" totalImagesPullingTime="3.828903315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:50.010563854 +0000 UTC m=+188.088712095" watchObservedRunningTime="2026-06-09 17:20:50.011040485 +0000 UTC m=+188.089188755" Jun 09 17:20:50.189848 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:50.189821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-s4q5n" Jun 09 17:20:57.132485 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.132451 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjs7b"] Jun 09 17:20:57.135749 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.135726 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.139794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.139774 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cfcw\"" Jun 09 17:20:57.140849 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.140792 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 17:20:57.140849 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.140841 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 17:20:57.148116 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.148091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjs7b"] Jun 09 17:20:57.278059 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.278027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2smv\" (UniqueName: \"kubernetes.io/projected/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-api-access-g2smv\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.278234 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.278079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19f0eac2-78a6-4245-8c5e-8353c8b1894d-crio-socket\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.278234 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.278102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19f0eac2-78a6-4245-8c5e-8353c8b1894d-data-volume\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.278234 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.278125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19f0eac2-78a6-4245-8c5e-8353c8b1894d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.278234 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.278181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.324242 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.324210 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6998555b4-gcj8w"] Jun 09 17:20:57.327112 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.327095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.329515 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.329491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 17:20:57.329810 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.329782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 17:20:57.329921 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.329902 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 17:20:57.329921 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.329916 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjt47\"" Jun 09 17:20:57.335622 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.335598 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 17:20:57.339791 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.339771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6998555b4-gcj8w"] Jun 09 17:20:57.378783 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19f0eac2-78a6-4245-8c5e-8353c8b1894d-crio-socket\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.378783 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19f0eac2-78a6-4245-8c5e-8353c8b1894d-data-volume\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.378978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19f0eac2-78a6-4245-8c5e-8353c8b1894d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.378978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19f0eac2-78a6-4245-8c5e-8353c8b1894d-crio-socket\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.378978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.378978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.378950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2smv\" (UniqueName: \"kubernetes.io/projected/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-api-access-g2smv\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.379125 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.379089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19f0eac2-78a6-4245-8c5e-8353c8b1894d-data-volume\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.379406 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.379383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.381238 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.381215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19f0eac2-78a6-4245-8c5e-8353c8b1894d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.392085 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.392031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2smv\" (UniqueName: \"kubernetes.io/projected/19f0eac2-78a6-4245-8c5e-8353c8b1894d-kube-api-access-g2smv\") pod \"insights-runtime-extractor-cjs7b\" (UID: \"19f0eac2-78a6-4245-8c5e-8353c8b1894d\") " pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.444706 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.444675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjs7b" Jun 09 17:20:57.479538 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-bound-sa-token\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479685 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-installation-pull-secrets\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479685 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-trusted-ca\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479769 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-image-registry-private-configuration\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479836 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-certificates\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479836 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-ca-trust-extracted\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479920 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8cjq\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-kube-api-access-x8cjq\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.479965 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.479925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-tls\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.577637 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.577504 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjs7b"] Jun 09 17:20:57.580418 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-tls\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580554 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-bound-sa-token\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580554 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-installation-pull-secrets\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580554 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-trusted-ca\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580705 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:57.580558 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f0eac2_78a6_4245_8c5e_8353c8b1894d.slice/crio-50f3090c6d54c66c18a0e2850ab0c7cf71e6a965d259802d04d26b28e493f449 WatchSource:0}: Error finding container 50f3090c6d54c66c18a0e2850ab0c7cf71e6a965d259802d04d26b28e493f449: Status 404 returned error can't find the container with id 50f3090c6d54c66c18a0e2850ab0c7cf71e6a965d259802d04d26b28e493f449 Jun 09 17:20:57.580705 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-image-registry-private-configuration\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580705 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-certificates\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580705 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-ca-trust-extracted\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.580926 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.580738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8cjq\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-kube-api-access-x8cjq\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.581794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.581695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-trusted-ca\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.582431 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.582408 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-certificates\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.582571 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.582552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-ca-trust-extracted\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.583375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.583351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-registry-tls\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.583749 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.583727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-installation-pull-secrets\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.583858 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.583841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-image-registry-private-configuration\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.588078 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.588051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-bound-sa-token\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.588188 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.588168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8cjq\" (UniqueName: \"kubernetes.io/projected/99ea0b3f-6e41-4e08-99ce-9b8543ba43d2-kube-api-access-x8cjq\") pod \"image-registry-6998555b4-gcj8w\" (UID: \"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2\") " pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.637058 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.637035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:57.766355 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:57.766307 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6998555b4-gcj8w"] Jun 09 17:20:57.770840 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:57.769141 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ea0b3f_6e41_4e08_99ce_9b8543ba43d2.slice/crio-8ade3c477f26ab9ec9eb1f55f916349dd201ee618c402003f96d373652537620 WatchSource:0}: Error finding container 8ade3c477f26ab9ec9eb1f55f916349dd201ee618c402003f96d373652537620: Status 404 returned error can't find the container with id 8ade3c477f26ab9ec9eb1f55f916349dd201ee618c402003f96d373652537620 Jun 09 17:20:58.021629 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.021535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" event={"ID":"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2","Type":"ContainerStarted","Data":"1b98600a1a5c202cee6ebfea8e34896426b0d724194f88786d6d5251de598472"} Jun 09 17:20:58.021629 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.021596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" event={"ID":"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2","Type":"ContainerStarted","Data":"8ade3c477f26ab9ec9eb1f55f916349dd201ee618c402003f96d373652537620"} Jun 09 17:20:58.021869 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.021651 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:20:58.023044 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.023016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjs7b" event={"ID":"19f0eac2-78a6-4245-8c5e-8353c8b1894d","Type":"ContainerStarted","Data":"2e69dca81a9b41721cbe9761781281835ad4f970f7fe3d3a4dfc121e9cb5f004"} Jun 09 17:20:58.023176 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.023066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjs7b" event={"ID":"19f0eac2-78a6-4245-8c5e-8353c8b1894d","Type":"ContainerStarted","Data":"50f3090c6d54c66c18a0e2850ab0c7cf71e6a965d259802d04d26b28e493f449"} Jun 09 17:20:58.039732 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.039679 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podStartSLOduration=1.039661542 podStartE2EDuration="1.039661542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:20:58.038414672 +0000 UTC m=+196.116562925" watchObservedRunningTime="2026-06-09 17:20:58.039661542 +0000 UTC m=+196.117809760" Jun 09 17:20:58.387374 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.387337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:58.389685 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.389662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45cd3753-5f35-47da-b4a3-651f2ebdf097-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-92ltz\" (UID: \"45cd3753-5f35-47da-b4a3-651f2ebdf097\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:58.589895 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.589774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:58.592212 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.592191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a5bc36e-9c21-4947-b782-e815047a8e6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-89t8h\" (UID: \"7a5bc36e-9c21-4947-b782-e815047a8e6d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:58.655017 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.654988 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fkg7j\"" Jun 09 17:20:58.661767 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.661745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" Jun 09 17:20:58.783371 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.783339 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz"] Jun 09 17:20:58.786445 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:58.786420 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cd3753_5f35_47da_b4a3_651f2ebdf097.slice/crio-50721bda68f13c95c2c8d43c2a6efde90d6ddeccd02c3969ffdb6372a1dc839f WatchSource:0}: Error finding container 50721bda68f13c95c2c8d43c2a6efde90d6ddeccd02c3969ffdb6372a1dc839f: Status 404 returned error can't find the container with id 50721bda68f13c95c2c8d43c2a6efde90d6ddeccd02c3969ffdb6372a1dc839f Jun 09 17:20:58.851713 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.851629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fqwff\"" Jun 09 17:20:58.859647 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.859620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" Jun 09 17:20:58.989004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:58.988970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h"] Jun 09 17:20:58.992377 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:20:58.992344 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5bc36e_9c21_4947_b782_e815047a8e6d.slice/crio-dd36dba7195818b0caaef55ae594cdc52b91d7aa17efc6e8deb0236daf6e2b27 WatchSource:0}: Error finding container dd36dba7195818b0caaef55ae594cdc52b91d7aa17efc6e8deb0236daf6e2b27: Status 404 returned error can't find the container with id dd36dba7195818b0caaef55ae594cdc52b91d7aa17efc6e8deb0236daf6e2b27 Jun 09 17:20:59.028578 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:59.028511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjs7b" event={"ID":"19f0eac2-78a6-4245-8c5e-8353c8b1894d","Type":"ContainerStarted","Data":"520e516da98841d6e9c0b4f9586a01bcda5ddc6e098879b11923990031a29c56"} Jun 09 17:20:59.029979 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:59.029951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" event={"ID":"45cd3753-5f35-47da-b4a3-651f2ebdf097","Type":"ContainerStarted","Data":"50721bda68f13c95c2c8d43c2a6efde90d6ddeccd02c3969ffdb6372a1dc839f"} Jun 09 17:20:59.031193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:20:59.031171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" event={"ID":"7a5bc36e-9c21-4947-b782-e815047a8e6d","Type":"ContainerStarted","Data":"dd36dba7195818b0caaef55ae594cdc52b91d7aa17efc6e8deb0236daf6e2b27"} Jun 09 17:21:00.483607 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.483579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:00.486714 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.486693 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.488992 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.488968 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 17:21:00.489100 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 17:21:00.489100 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.488972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 17:21:00.489205 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489128 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 17:21:00.489889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489869 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 17:21:00.489889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489879 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 17:21:00.490061 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 17:21:00.490061 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.489923 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gvnrv\"" Jun 09 17:21:00.497335 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.497313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:00.606614 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.606780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxgv\" (UniqueName: \"kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.606780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.606780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.606780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.606780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.606721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707381 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707381 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxgv\" (UniqueName: \"kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707381 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.707862 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.707835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.708194 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.708171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.708297 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.708205 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.708297 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.708205 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.710264 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.710241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.710360 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.710337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.716922 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.716872 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxgv\" (UniqueName: \"kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv\") pod \"console-7c6b7498bc-txf5x\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:00.796554 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:00.796517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:01.041728 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.041628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjs7b" event={"ID":"19f0eac2-78a6-4245-8c5e-8353c8b1894d","Type":"ContainerStarted","Data":"52af321bc80cf432ed94c680d0399d0f9edc72f240fe1b0e93c101e2a0c86cd9"} Jun 09 17:21:01.043210 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.043173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" event={"ID":"45cd3753-5f35-47da-b4a3-651f2ebdf097","Type":"ContainerStarted","Data":"ebd1559abcd394336109362e10fe5ceca8c0632900d5d44e6580f89c71a4129b"} Jun 09 17:21:01.059027 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.058963 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjs7b" podStartSLOduration=1.356701786 podStartE2EDuration="4.058947771s" totalImagesPullingTime="2.702245985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:20:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:01.057425569 +0000 UTC m=+199.135573812" watchObservedRunningTime="2026-06-09 17:21:01.058947771 +0000 UTC m=+199.137096011" Jun 09 17:21:01.072658 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.072602 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-92ltz" podStartSLOduration=33.462242528 podStartE2EDuration="35.072583269s" totalImagesPullingTime="1.610340741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:01.071341457 +0000 UTC m=+199.149489698" watchObservedRunningTime="2026-06-09 17:21:01.072583269 +0000 UTC m=+199.150731523" Jun 09 17:21:01.213756 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.213722 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:01.217703 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:01.217671 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bcb1ba_a09c_47ae_9864_29bec8409950.slice/crio-b57870a931a5fabde861486ca2948e025ef71b8d469b6968698a1c33cf2bce7b WatchSource:0}: Error finding container b57870a931a5fabde861486ca2948e025ef71b8d469b6968698a1c33cf2bce7b: Status 404 returned error can't find the container with id b57870a931a5fabde861486ca2948e025ef71b8d469b6968698a1c33cf2bce7b Jun 09 17:21:01.620288 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.620248 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4"] Jun 09 17:21:01.623558 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.623539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:01.626016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.625993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 17:21:01.626016 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.626008 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cj84g\"" Jun 09 17:21:01.632006 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.631981 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4"] Jun 09 17:21:01.715900 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.715858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1728e357-fd0d-4a3c-87d9-74b41f6939fe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2zkz4\" (UID: \"1728e357-fd0d-4a3c-87d9-74b41f6939fe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:01.817277 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.817242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1728e357-fd0d-4a3c-87d9-74b41f6939fe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2zkz4\" (UID: \"1728e357-fd0d-4a3c-87d9-74b41f6939fe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:01.819962 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.819933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1728e357-fd0d-4a3c-87d9-74b41f6939fe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2zkz4\" (UID: \"1728e357-fd0d-4a3c-87d9-74b41f6939fe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:01.932795 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:01.932756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:02.049340 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:02.049301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" event={"ID":"7a5bc36e-9c21-4947-b782-e815047a8e6d","Type":"ContainerStarted","Data":"78c30fe97a83607bcbcd51ae5801b61ab9a761373152e9bfe314d5fec3ccee6d"} Jun 09 17:21:02.050616 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:02.050584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b7498bc-txf5x" event={"ID":"a7bcb1ba-a09c-47ae-9864-29bec8409950","Type":"ContainerStarted","Data":"b57870a931a5fabde861486ca2948e025ef71b8d469b6968698a1c33cf2bce7b"} Jun 09 17:21:02.063094 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:02.063061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4"] Jun 09 17:21:02.065305 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:02.065252 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-89t8h" podStartSLOduration=33.925729954 podStartE2EDuration="36.065230319s" totalImagesPullingTime="2.139500365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:02.06467571 +0000 UTC m=+200.142823953" watchObservedRunningTime="2026-06-09 17:21:02.065230319 +0000 UTC m=+200.143378561" Jun 09 17:21:02.066757 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:02.066730 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1728e357_fd0d_4a3c_87d9_74b41f6939fe.slice/crio-2657f0fd6df91965d5c71a055571bb7a0e7780209828dade4d659baf759e3b9a WatchSource:0}: Error finding container 2657f0fd6df91965d5c71a055571bb7a0e7780209828dade4d659baf759e3b9a: Status 404 returned error can't find the container with id 2657f0fd6df91965d5c71a055571bb7a0e7780209828dade4d659baf759e3b9a Jun 09 17:21:03.056888 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:03.056840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" event={"ID":"1728e357-fd0d-4a3c-87d9-74b41f6939fe","Type":"ContainerStarted","Data":"2657f0fd6df91965d5c71a055571bb7a0e7780209828dade4d659baf759e3b9a"} Jun 09 17:21:04.064254 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:04.064220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" event={"ID":"1728e357-fd0d-4a3c-87d9-74b41f6939fe","Type":"ContainerStarted","Data":"de28ddfe33f19d4148f46e591797890f614e48957b481f4df9199e6aef17347a"} Jun 09 17:21:04.064713 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:04.064470 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:04.070385 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:04.070357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" Jun 09 17:21:04.080415 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:04.080367 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2zkz4" podStartSLOduration=1.572496916 podStartE2EDuration="3.080347437s" totalImagesPullingTime="1.507850521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:04.079112609 +0000 UTC m=+202.157260851" watchObservedRunningTime="2026-06-09 17:21:04.080347437 +0000 UTC m=+202.158495655" Jun 09 17:21:07.078219 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:07.078175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b7498bc-txf5x" event={"ID":"a7bcb1ba-a09c-47ae-9864-29bec8409950","Type":"ContainerStarted","Data":"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2"} Jun 09 17:21:07.093777 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:07.093721 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6b7498bc-txf5x" podStartSLOduration=2.348367341 podStartE2EDuration="7.09370607s" totalImagesPullingTime="4.745338729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:07.093412688 +0000 UTC m=+205.171560929" watchObservedRunningTime="2026-06-09 17:21:07.09370607 +0000 UTC m=+205.171854310" Jun 09 17:21:10.019607 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.019572 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x"] Jun 09 17:21:10.021784 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.021761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.024948 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.024924 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 17:21:10.024948 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.024936 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 17:21:10.025136 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.024956 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 17:21:10.025136 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.024969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kk9fx\"" Jun 09 17:21:10.029241 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.029222 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8"] Jun 09 17:21:10.031243 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.031220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.033364 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.033343 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 17:21:10.033487 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.033367 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 17:21:10.033487 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.033383 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b2df4\"" Jun 09 17:21:10.033487 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.033410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 17:21:10.036448 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.036426 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x"] Jun 09 17:21:10.042382 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.042355 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8"] Jun 09 17:21:10.045948 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.045927 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n5xnb"] Jun 09 17:21:10.051881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.051857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.054147 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.054119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kszm\"" Jun 09 17:21:10.054265 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.054161 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 17:21:10.054265 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.054205 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 17:21:10.054372 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.054359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 17:21:10.186432 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-textfile\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.186615 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-wtmp\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.186615 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.186615 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-metrics-client-ca\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.186615 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.186764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186627 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.186764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.186764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9104b9f4-5964-4356-8daf-dd8ac5d37546-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.186764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.186764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.187004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljdr\" (UniqueName: \"kubernetes.io/projected/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-api-access-6ljdr\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.187004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-root\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.187004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8g82\" (UniqueName: \"kubernetes.io/projected/995ce29b-6058-4158-b87a-51a971ea173d-kube-api-access-q8g82\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.187004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.186983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.187161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.187006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.187161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.187024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.187161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.187040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlgbf\" (UniqueName: \"kubernetes.io/projected/9104b9f4-5964-4356-8daf-dd8ac5d37546-kube-api-access-jlgbf\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.187161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.187064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.187161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.187080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-sys\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.287746 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.287746 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.287746 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljdr\" (UniqueName: \"kubernetes.io/projected/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-api-access-6ljdr\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.287746 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-root\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8g82\" (UniqueName: \"kubernetes.io/projected/995ce29b-6058-4158-b87a-51a971ea173d-kube-api-access-q8g82\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.287856 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-root\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.287938 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls podName:9104b9f4-5964-4356-8daf-dd8ac5d37546 nodeName:}" failed. No retries permitted until 2026-06-09 17:21:10.787916654 +0000 UTC m=+208.866064884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-xs84x" (UID: "9104b9f4-5964-4356-8daf-dd8ac5d37546") : secret "openshift-state-metrics-tls" not found Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.287983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlgbf\" (UniqueName: \"kubernetes.io/projected/9104b9f4-5964-4356-8daf-dd8ac5d37546-kube-api-access-jlgbf\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-sys\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-textfile\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-wtmp\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-metrics-client-ca\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.288246 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.288307 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls podName:1bcce16e-263e-4b5b-ac6b-a97eb0cdf736 nodeName:}" failed. No retries permitted until 2026-06-09 17:21:10.788291846 +0000 UTC m=+208.866440068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-8l4d8" (UID: "1bcce16e-263e-4b5b-ac6b-a97eb0cdf736") : secret "kube-state-metrics-tls" not found Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-wtmp\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9104b9f4-5964-4356-8daf-dd8ac5d37546-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288595 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.288651 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.288705 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls podName:995ce29b-6058-4158-b87a-51a971ea173d nodeName:}" failed. No retries permitted until 2026-06-09 17:21:10.788689638 +0000 UTC m=+208.866837859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls") pod "node-exporter-n5xnb" (UID: "995ce29b-6058-4158-b87a-51a971ea173d") : secret "node-exporter-tls" not found Jun 09 17:21:10.288719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/995ce29b-6058-4158-b87a-51a971ea173d-sys\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.289465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.288943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-textfile\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.289465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.289005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.289465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.289089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995ce29b-6058-4158-b87a-51a971ea173d-metrics-client-ca\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.289465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.289164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9104b9f4-5964-4356-8daf-dd8ac5d37546-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.290997 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.290963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.291112 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.291032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.291112 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.291077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.298075 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.298047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljdr\" (UniqueName: \"kubernetes.io/projected/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-api-access-6ljdr\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.298675 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.298654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlgbf\" (UniqueName: \"kubernetes.io/projected/9104b9f4-5964-4356-8daf-dd8ac5d37546-kube-api-access-jlgbf\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.298747 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.298653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8g82\" (UniqueName: \"kubernetes.io/projected/995ce29b-6058-4158-b87a-51a971ea173d-kube-api-access-q8g82\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.794166 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.794127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:10.794366 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.794183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.794366 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.794215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:10.794366 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.794297 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 17:21:10.794546 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.794372 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls podName:1bcce16e-263e-4b5b-ac6b-a97eb0cdf736 nodeName:}" failed. No retries permitted until 2026-06-09 17:21:11.794356603 +0000 UTC m=+209.872504822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-8l4d8" (UID: "1bcce16e-263e-4b5b-ac6b-a97eb0cdf736") : secret "kube-state-metrics-tls" not found Jun 09 17:21:10.794546 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.794302 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 17:21:10.794546 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:10.794431 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls podName:9104b9f4-5964-4356-8daf-dd8ac5d37546 nodeName:}" failed. No retries permitted until 2026-06-09 17:21:11.794419203 +0000 UTC m=+209.872567422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-xs84x" (UID: "9104b9f4-5964-4356-8daf-dd8ac5d37546") : secret "openshift-state-metrics-tls" not found Jun 09 17:21:10.796711 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.796682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/995ce29b-6058-4158-b87a-51a971ea173d-node-exporter-tls\") pod \"node-exporter-n5xnb\" (UID: \"995ce29b-6058-4158-b87a-51a971ea173d\") " pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.796838 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.796757 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:10.797015 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.796996 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:10.798348 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.798325 2561 patch_prober.go:28] interesting pod/console-7c6b7498bc-txf5x container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 09 17:21:10.798441 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.798361 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c6b7498bc-txf5x" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 09 17:21:10.961022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:10.960989 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n5xnb" Jun 09 17:21:10.973629 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:10.973593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995ce29b_6058_4158_b87a_51a971ea173d.slice/crio-28aee5e97240ac3ab3e6e1a3120d74c25c7356e56ef6ee02ab7461742cb009f7 WatchSource:0}: Error finding container 28aee5e97240ac3ab3e6e1a3120d74c25c7356e56ef6ee02ab7461742cb009f7: Status 404 returned error can't find the container with id 28aee5e97240ac3ab3e6e1a3120d74c25c7356e56ef6ee02ab7461742cb009f7 Jun 09 17:21:11.093297 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.093200 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5xnb" event={"ID":"995ce29b-6058-4158-b87a-51a971ea173d","Type":"ContainerStarted","Data":"28aee5e97240ac3ab3e6e1a3120d74c25c7356e56ef6ee02ab7461742cb009f7"} Jun 09 17:21:11.805022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.804987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:11.805177 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.805091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:11.807580 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.807557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9104b9f4-5964-4356-8daf-dd8ac5d37546-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xs84x\" (UID: \"9104b9f4-5964-4356-8daf-dd8ac5d37546\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:11.807694 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.807672 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bcce16e-263e-4b5b-ac6b-a97eb0cdf736-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8l4d8\" (UID: \"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:11.830592 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.830567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" Jun 09 17:21:11.841615 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.841509 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" Jun 09 17:21:11.983710 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:11.983668 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x"] Jun 09 17:21:11.993836 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:11.993786 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9104b9f4_5964_4356_8daf_dd8ac5d37546.slice/crio-cdae96351f0d627c37c0c6505abe08f46e270da44c44126276f30d0fdadf0291 WatchSource:0}: Error finding container cdae96351f0d627c37c0c6505abe08f46e270da44c44126276f30d0fdadf0291: Status 404 returned error can't find the container with id cdae96351f0d627c37c0c6505abe08f46e270da44c44126276f30d0fdadf0291 Jun 09 17:21:12.002356 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.002328 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8"] Jun 09 17:21:12.005676 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:12.005636 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcce16e_263e_4b5b_ac6b_a97eb0cdf736.slice/crio-42e8886c8d1374fa8c53912ecff492380223e7c06227cdf047a15b0406a94a0a WatchSource:0}: Error finding container 42e8886c8d1374fa8c53912ecff492380223e7c06227cdf047a15b0406a94a0a: Status 404 returned error can't find the container with id 42e8886c8d1374fa8c53912ecff492380223e7c06227cdf047a15b0406a94a0a Jun 09 17:21:12.099309 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.099279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" event={"ID":"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736","Type":"ContainerStarted","Data":"42e8886c8d1374fa8c53912ecff492380223e7c06227cdf047a15b0406a94a0a"} Jun 09 17:21:12.101078 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.101044 2561 generic.go:356] "Generic (PLEG): container finished" podID="995ce29b-6058-4158-b87a-51a971ea173d" containerID="4f437ad4a9aec791b76243feee7799c2bdc91aa83004d6d838ffb246c77c9bfd" exitCode=0 Jun 09 17:21:12.101256 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.101131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5xnb" event={"ID":"995ce29b-6058-4158-b87a-51a971ea173d","Type":"ContainerDied","Data":"4f437ad4a9aec791b76243feee7799c2bdc91aa83004d6d838ffb246c77c9bfd"} Jun 09 17:21:12.102860 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.102776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" event={"ID":"9104b9f4-5964-4356-8daf-dd8ac5d37546","Type":"ContainerStarted","Data":"cde947ea777865c84d19657c09aabb48340c2c2119722024a90a5eae6553e4ef"} Jun 09 17:21:12.102951 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:12.102875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" event={"ID":"9104b9f4-5964-4356-8daf-dd8ac5d37546","Type":"ContainerStarted","Data":"cdae96351f0d627c37c0c6505abe08f46e270da44c44126276f30d0fdadf0291"} Jun 09 17:21:13.109021 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:13.108979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5xnb" event={"ID":"995ce29b-6058-4158-b87a-51a971ea173d","Type":"ContainerStarted","Data":"b42f9bdc0119cd0808d8d9e9fec64bcc9001328a296ed7553907afaa7339e099"} Jun 09 17:21:13.109473 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:13.109079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5xnb" event={"ID":"995ce29b-6058-4158-b87a-51a971ea173d","Type":"ContainerStarted","Data":"3ba385303806be39f326c15ff1b4ac558c15bcefdc9ffb0bff673d2230cba653"} Jun 09 17:21:13.110875 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:13.110847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" event={"ID":"9104b9f4-5964-4356-8daf-dd8ac5d37546","Type":"ContainerStarted","Data":"adaf3ba2f7171f925715288ea75ed944808db34a55f616d011ea4f8e39e5f6de"} Jun 09 17:21:13.144645 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:13.144579 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n5xnb" podStartSLOduration=2.268605488 podStartE2EDuration="3.144559962s" totalImagesPullingTime="786.595324ms" totalInitContainerRuntime="89.35915ms" isStatefulPod=true podCreationTimestamp="2026-06-09 17:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:13.143237661 +0000 UTC m=+211.221385902" watchObservedRunningTime="2026-06-09 17:21:13.144559962 +0000 UTC m=+211.222708206" Jun 09 17:21:14.116995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.116958 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" event={"ID":"9104b9f4-5964-4356-8daf-dd8ac5d37546","Type":"ContainerStarted","Data":"1f2138b44eb101015cf3e2b75857fbf16e553ac4b0cf0ad4d9882debf45b5cfe"} Jun 09 17:21:14.119012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.118983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" event={"ID":"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736","Type":"ContainerStarted","Data":"182f8c277998f2a427dbcdee257bef5d5094e696c3c3a7506bb02997bf0662b0"} Jun 09 17:21:14.119147 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.119036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" event={"ID":"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736","Type":"ContainerStarted","Data":"f977716c8b83a6df2062cae4b17f4de9890fb7a3a05e4c63a5072b6e7dbb0e49"} Jun 09 17:21:14.119147 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.119058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" event={"ID":"1bcce16e-263e-4b5b-ac6b-a97eb0cdf736","Type":"ContainerStarted","Data":"aa47e2cf3bb85c2cf104a36d02da3f7feb96bd41afac736b2a1e85d39e6d2ab2"} Jun 09 17:21:14.136268 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.136212 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xs84x" podStartSLOduration=2.791015179 podStartE2EDuration="4.13619322s" totalImagesPullingTime="1.345178041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:14.135332606 +0000 UTC m=+212.213480860" watchObservedRunningTime="2026-06-09 17:21:14.13619322 +0000 UTC m=+212.214341461" Jun 09 17:21:14.153130 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.153078 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8l4d8" podStartSLOduration=3.003150106 podStartE2EDuration="4.153056896s" totalImagesPullingTime="1.14990679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:14.153004401 +0000 UTC m=+212.231152670" watchObservedRunningTime="2026-06-09 17:21:14.153056896 +0000 UTC m=+212.231205138" Jun 09 17:21:14.816709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.816672 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:14.847689 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.847655 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:21:14.850993 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.850973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.858430 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.858402 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 17:21:14.860876 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.860853 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:21:14.932857 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.932792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.932869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.932898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pmbk\" (UniqueName: \"kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.932918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.932977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.933047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:14.933170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:14.933075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pmbk\" (UniqueName: \"kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.034794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.034766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.035445 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.035423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.035567 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.035544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.035709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.035691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.035941 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.035919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.037097 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.037069 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.037335 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.037317 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.043617 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.043586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pmbk\" (UniqueName: \"kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk\") pod \"console-76647c9799-9c9dd\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.161867 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.161821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:15.310886 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:15.310851 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:21:15.313894 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:15.313869 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2830b0_6c9a_4a83_9faa_35b4bdf42eb1.slice/crio-940b03903a9917ab00a4be50c868d49a13d51bdbb39073b8ef4f1fb19e16b1dc WatchSource:0}: Error finding container 940b03903a9917ab00a4be50c868d49a13d51bdbb39073b8ef4f1fb19e16b1dc: Status 404 returned error can't find the container with id 940b03903a9917ab00a4be50c868d49a13d51bdbb39073b8ef4f1fb19e16b1dc Jun 09 17:21:16.128176 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.128141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76647c9799-9c9dd" event={"ID":"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1","Type":"ContainerStarted","Data":"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0"} Jun 09 17:21:16.128367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.128192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76647c9799-9c9dd" event={"ID":"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1","Type":"ContainerStarted","Data":"940b03903a9917ab00a4be50c868d49a13d51bdbb39073b8ef4f1fb19e16b1dc"} Jun 09 17:21:16.150619 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.150562 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76647c9799-9c9dd" podStartSLOduration=2.150545929 podStartE2EDuration="2.150545929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:16.149509077 +0000 UTC m=+214.227657317" watchObservedRunningTime="2026-06-09 17:21:16.150545929 +0000 UTC m=+214.228694171" Jun 09 17:21:16.237689 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.237648 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 17:21:16.242041 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.242016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.244418 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.244397 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 17:21:16.245593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.245560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 17:21:16.245695 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.245608 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 17:21:16.246443 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246424 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-74dhw\"" Jun 09 17:21:16.246507 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246465 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 17:21:16.246632 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 17:21:16.246632 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 17:21:16.246854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246681 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 17:21:16.246854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246681 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 17:21:16.246854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 17:21:16.246980 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.246966 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 17:21:16.247027 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.247010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 17:21:16.247083 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.247037 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 17:21:16.247131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.247085 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 17:21:16.247763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.247745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 17:21:16.247763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.247759 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8gecdu7vmgndc\"" Jun 09 17:21:16.248581 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.248558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 17:21:16.259879 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.259843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 17:21:16.347186 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347186 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347400 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347400 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347400 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347532 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347532 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347532 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347532 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347726 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347726 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347726 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347726 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.347950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.348091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.348091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.347982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.348091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.348005 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.348091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.348029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtr5p\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-kube-api-access-qtr5p\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449082 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.448988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449082 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449278 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449472 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtr5p\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-kube-api-access-qtr5p\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449524 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449585 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449585 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449688 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449688 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449688 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.449881 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450156 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450156 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.449945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450156 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.450003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450454 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.450424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.450483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450658 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.450632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.450838 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.450680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.451552 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.451524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.452983 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.452956 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.453538 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.453372 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.453742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.454062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.454397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2904826-7a74-4a46-9b73-286a18703aeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.454471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454544 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.454538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.454981 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.454962 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.455473 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.455449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.455567 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.455551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.455567 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.455557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2904826-7a74-4a46-9b73-286a18703aeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.455721 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.455693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2904826-7a74-4a46-9b73-286a18703aeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.457373 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.457357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtr5p\" (UniqueName: \"kubernetes.io/projected/b2904826-7a74-4a46-9b73-286a18703aeb-kube-api-access-qtr5p\") pod \"prometheus-k8s-0\" (UID: \"b2904826-7a74-4a46-9b73-286a18703aeb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.552193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.552151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:16.696597 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:16.696571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 17:21:16.698776 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:16.698742 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2904826_7a74_4a46_9b73_286a18703aeb.slice/crio-03ed8f9f082ab9af58007058c6971b03b16cff111a66e6b6232bafab61591605 WatchSource:0}: Error finding container 03ed8f9f082ab9af58007058c6971b03b16cff111a66e6b6232bafab61591605: Status 404 returned error can't find the container with id 03ed8f9f082ab9af58007058c6971b03b16cff111a66e6b6232bafab61591605 Jun 09 17:21:17.133963 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:17.133879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"03ed8f9f082ab9af58007058c6971b03b16cff111a66e6b6232bafab61591605"} Jun 09 17:21:17.641868 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:17.641832 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:17.642272 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:17.641896 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:18.143744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:18.143707 2561 generic.go:356] "Generic (PLEG): container finished" podID="b2904826-7a74-4a46-9b73-286a18703aeb" containerID="64ae5fa7314c00fbde5068b780526442d079f5f47338473f76045c64c23f0eae" exitCode=0 Jun 09 17:21:18.143939 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:18.143779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerDied","Data":"64ae5fa7314c00fbde5068b780526442d079f5f47338473f76045c64c23f0eae"} Jun 09 17:21:19.035995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:19.035958 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:19.036402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:19.036014 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:23.167966 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:23.167929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"332f35c30ac4f1beed6cd1a5b500da078c9be74c552921ba7c8c9128d5b5aeb6"} Jun 09 17:21:23.168355 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:23.168026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"0b341b2788af88d4efdb401672007d35b8cfdf692dbba5d091c3bced27d44c38"} Jun 09 17:21:25.162951 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.162903 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:25.163353 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.162979 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:21:25.164409 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.164382 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 17:21:25.164514 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.164425 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 17:21:25.180286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.180253 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"0f70c98469ddc9ecaa4858f1517b8daa4fdcf320a5773add09b511ea97ff11f4"} Jun 09 17:21:25.180411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.180313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"111750f18eb93b37c020016a0e7a664d6648e474911e3e8afc2fd33c9be3f9bc"} Jun 09 17:21:25.180411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.180341 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"db108d7bbcf336343cba0730c73eec6cabb0f1d8797ac3af191a79ac2b42d433"} Jun 09 17:21:25.180411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.180365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2904826-7a74-4a46-9b73-286a18703aeb","Type":"ContainerStarted","Data":"9368cc433f07bb0e8f4571e36a74f086cc2c2504e65f98ba24b2acbbd35eedf2"} Jun 09 17:21:25.208107 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:25.208053 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.042968612 podStartE2EDuration="9.208033876s" totalImagesPullingTime="7.146150631s" totalInitContainerRuntime="18.914633ms" isStatefulPod=false podCreationTimestamp="2026-06-09 17:21:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:25.205494727 +0000 UTC m=+223.283642968" watchObservedRunningTime="2026-06-09 17:21:25.208033876 +0000 UTC m=+223.286182117" Jun 09 17:21:26.552573 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:26.552525 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:21:27.642155 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:27.642118 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:27.642581 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:27.642178 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:29.035853 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:29.035815 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:29.036227 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:29.035871 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:35.162530 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:35.162483 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 17:21:35.163047 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:35.162549 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 17:21:37.641322 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.641287 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:37.641720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.641353 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:37.641720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.641394 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:21:37.642004 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.641967 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"1b98600a1a5c202cee6ebfea8e34896426b0d724194f88786d6d5251de598472"} pod="openshift-image-registry/image-registry-6998555b4-gcj8w" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 17:21:37.645703 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.645675 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:37.645883 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:37.645725 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:39.837667 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:39.837616 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c6b7498bc-txf5x" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerName="console" containerID="cri-o://2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2" gracePeriod=15 Jun 09 17:21:42.249460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:42.249422 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2d2e1d9-1846-4797-8202-a789070a4c7f" containerID="08cbf17e8476d000a6821a609aab29b4ec3d5d99953fd35ff144fd3e7fcbe33d" exitCode=0 Jun 09 17:21:42.249878 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:42.249482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" event={"ID":"f2d2e1d9-1846-4797-8202-a789070a4c7f","Type":"ContainerDied","Data":"08cbf17e8476d000a6821a609aab29b4ec3d5d99953fd35ff144fd3e7fcbe33d"} Jun 09 17:21:42.249878 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:42.249830 2561 scope.go:117] "RemoveContainer" containerID="08cbf17e8476d000a6821a609aab29b4ec3d5d99953fd35ff144fd3e7fcbe33d" Jun 09 17:21:43.255758 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:43.255718 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-ksbln" event={"ID":"f2d2e1d9-1846-4797-8202-a789070a4c7f","Type":"ContainerStarted","Data":"7ac59906d915f517dc93104170f95848c1f881e4abc65e708d83907a3da93cec"} Jun 09 17:21:45.162916 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:45.162880 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 17:21:45.163402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:45.162935 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 17:21:47.646389 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:47.646355 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:47.646793 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:47.646429 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:54.121579 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.121543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:21:54.123839 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.123814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e79cb33-2aae-49de-afef-e45c39fe247d-metrics-certs\") pod \"network-metrics-daemon-f4772\" (UID: \"1e79cb33-2aae-49de-afef-e45c39fe247d\") " pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:21:54.127286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.127264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mf9vr\"" Jun 09 17:21:54.135135 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.135115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4772" Jun 09 17:21:54.264647 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.264614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f4772"] Jun 09 17:21:54.268215 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:21:54.268188 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e79cb33_2aae_49de_afef_e45c39fe247d.slice/crio-b3f86c0d19b2fc113d18d82abf394a9a975b2c40340080033413081b103cd8cc WatchSource:0}: Error finding container b3f86c0d19b2fc113d18d82abf394a9a975b2c40340080033413081b103cd8cc: Status 404 returned error can't find the container with id b3f86c0d19b2fc113d18d82abf394a9a975b2c40340080033413081b103cd8cc Jun 09 17:21:54.298504 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:54.298468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4772" event={"ID":"1e79cb33-2aae-49de-afef-e45c39fe247d","Type":"ContainerStarted","Data":"b3f86c0d19b2fc113d18d82abf394a9a975b2c40340080033413081b103cd8cc"} Jun 09 17:21:55.141175 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.141152 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6b7498bc-txf5x_a7bcb1ba-a09c-47ae-9864-29bec8409950/console/0.log" Jun 09 17:21:55.143348 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.143325 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:55.162516 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.162486 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 17:21:55.162695 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.162535 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 17:21:55.233433 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233405 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233549 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233452 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233549 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233495 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233625 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233610 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jxgv\" (UniqueName: \"kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233643 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233707 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233680 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config\") pod \"a7bcb1ba-a09c-47ae-9864-29bec8409950\" (UID: \"a7bcb1ba-a09c-47ae-9864-29bec8409950\") " Jun 09 17:21:55.233904 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233875 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:21:55.233995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233899 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config" (OuterVolumeSpecName: "console-config") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:21:55.233995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.233886 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:21:55.234117 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.234100 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.234180 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.234119 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.234180 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.234129 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bcb1ba-a09c-47ae-9864-29bec8409950-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.235764 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.235737 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv" (OuterVolumeSpecName: "kube-api-access-2jxgv") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "kube-api-access-2jxgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:21:55.235865 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.235764 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:21:55.235865 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.235782 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7bcb1ba-a09c-47ae-9864-29bec8409950" (UID: "a7bcb1ba-a09c-47ae-9864-29bec8409950"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:21:55.305960 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.305901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4772" event={"ID":"1e79cb33-2aae-49de-afef-e45c39fe247d","Type":"ContainerStarted","Data":"b25953eb27f9a437620bbdc2a9aec7d974a8bf1d3aea64b5980ffdf33cfd05c7"} Jun 09 17:21:55.308477 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6b7498bc-txf5x_a7bcb1ba-a09c-47ae-9864-29bec8409950/console/0.log" Jun 09 17:21:55.308601 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308501 2561 generic.go:356] "Generic (PLEG): container finished" podID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerID="2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2" exitCode=137 Jun 09 17:21:55.308601 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b7498bc-txf5x" event={"ID":"a7bcb1ba-a09c-47ae-9864-29bec8409950","Type":"ContainerDied","Data":"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2"} Jun 09 17:21:55.308601 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b7498bc-txf5x" event={"ID":"a7bcb1ba-a09c-47ae-9864-29bec8409950","Type":"ContainerDied","Data":"b57870a931a5fabde861486ca2948e025ef71b8d469b6968698a1c33cf2bce7b"} Jun 09 17:21:55.308601 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308591 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b7498bc-txf5x" Jun 09 17:21:55.308830 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.308615 2561 scope.go:117] "RemoveContainer" containerID="2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2" Jun 09 17:21:55.320737 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.320710 2561 scope.go:117] "RemoveContainer" containerID="2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2" Jun 09 17:21:55.321204 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:21:55.321173 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2\": container with ID starting with 2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2 not found: ID does not exist" containerID="2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2" Jun 09 17:21:55.321315 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.321214 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2"} err="failed to get container status \"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2\": rpc error: code = NotFound desc = could not find container \"2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2\": container with ID starting with 2fc32ca0c9fd8e2473e22b61ffc39014de4acb741b4f098e761debc75af343d2 not found: ID does not exist" Jun 09 17:21:55.332725 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.332694 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:55.335836 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.335187 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jxgv\" (UniqueName: \"kubernetes.io/projected/a7bcb1ba-a09c-47ae-9864-29bec8409950-kube-api-access-2jxgv\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.335836 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.335215 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.335836 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.335230 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7bcb1ba-a09c-47ae-9864-29bec8409950-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:21:55.337339 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:55.337319 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6b7498bc-txf5x"] Jun 09 17:21:56.314842 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:56.314790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4772" event={"ID":"1e79cb33-2aae-49de-afef-e45c39fe247d","Type":"ContainerStarted","Data":"a8a4882319988fafb75eb658b9f8be5d1a35d6f863ad3fd075de14ddeb0988ba"} Jun 09 17:21:56.328671 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:56.328642 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" path="/var/lib/kubelet/pods/a7bcb1ba-a09c-47ae-9864-29bec8409950/volumes" Jun 09 17:21:56.331280 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:56.331231 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f4772" podStartSLOduration=253.42848958 podStartE2EDuration="4m14.331216182s" totalImagesPullingTime="902.726602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:21:56.329201572 +0000 UTC m=+254.407349812" watchObservedRunningTime="2026-06-09 17:21:56.331216182 +0000 UTC m=+254.409364423" Jun 09 17:21:57.321160 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:57.321129 2561 generic.go:356] "Generic (PLEG): container finished" podID="2a313a8d-bbf3-4956-a0c4-a776bb0324d7" containerID="be7edb4116f61ca5e5531025c014b96a7d3f778e2d7494839cea10f35313ac83" exitCode=0 Jun 09 17:21:57.321646 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:57.321207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" event={"ID":"2a313a8d-bbf3-4956-a0c4-a776bb0324d7","Type":"ContainerDied","Data":"be7edb4116f61ca5e5531025c014b96a7d3f778e2d7494839cea10f35313ac83"} Jun 09 17:21:57.321721 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:57.321659 2561 scope.go:117] "RemoveContainer" containerID="be7edb4116f61ca5e5531025c014b96a7d3f778e2d7494839cea10f35313ac83" Jun 09 17:21:57.646326 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:57.646284 2561 patch_prober.go:28] interesting pod/image-registry-6998555b4-gcj8w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:21:57.646520 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:57.646341 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:21:58.332672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:21:58.332612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r5t42" event={"ID":"2a313a8d-bbf3-4956-a0c4-a776bb0324d7","Type":"ContainerStarted","Data":"1e921dfde230c4b76ccce75df2a73b9e8e10237f8ee0b3290e9125add1289daa"} Jun 09 17:22:02.348751 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:02.348657 2561 generic.go:356] "Generic (PLEG): container finished" podID="17cae500-d885-4537-93f7-8dc2bf6c966d" containerID="d7adf17064357f0c6683b2f9716f0b3ee28738bc80dd359cf2bbaf5820e6abc1" exitCode=0 Jun 09 17:22:02.348751 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:02.348734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7ttfv" event={"ID":"17cae500-d885-4537-93f7-8dc2bf6c966d","Type":"ContainerDied","Data":"d7adf17064357f0c6683b2f9716f0b3ee28738bc80dd359cf2bbaf5820e6abc1"} Jun 09 17:22:02.349282 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:02.349207 2561 scope.go:117] "RemoveContainer" containerID="d7adf17064357f0c6683b2f9716f0b3ee28738bc80dd359cf2bbaf5820e6abc1" Jun 09 17:22:02.662504 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:02.662461 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" podUID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerName="registry" containerID="cri-o://1b98600a1a5c202cee6ebfea8e34896426b0d724194f88786d6d5251de598472" gracePeriod=30 Jun 09 17:22:03.358956 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:03.358908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7ttfv" event={"ID":"17cae500-d885-4537-93f7-8dc2bf6c966d","Type":"ContainerStarted","Data":"3991fb577dc5c4adef92f0750e20f0a2051445a18253ed1a3a5396251a09fba3"} Jun 09 17:22:04.364960 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:04.364928 2561 generic.go:356] "Generic (PLEG): container finished" podID="99ea0b3f-6e41-4e08-99ce-9b8543ba43d2" containerID="1b98600a1a5c202cee6ebfea8e34896426b0d724194f88786d6d5251de598472" exitCode=0 Jun 09 17:22:04.365375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:04.364986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" event={"ID":"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2","Type":"ContainerDied","Data":"1b98600a1a5c202cee6ebfea8e34896426b0d724194f88786d6d5251de598472"} Jun 09 17:22:04.365375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:04.365027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" event={"ID":"99ea0b3f-6e41-4e08-99ce-9b8543ba43d2","Type":"ContainerStarted","Data":"373c90bd88714c62fb529c459b30d4f92da8dd02f0cc0b557f46b8bee67494de"} Jun 09 17:22:04.365375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:04.365186 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:22:05.162926 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:05.162890 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 17:22:05.163095 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:05.162938 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 17:22:06.441545 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:06.441513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-89t8h_7a5bc36e-9c21-4947-b782-e815047a8e6d/cluster-monitoring-operator/0.log" Jun 09 17:22:06.639152 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:06.639113 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-state-metrics/0.log" Jun 09 17:22:06.838726 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:06.838625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-rbac-proxy-main/0.log" Jun 09 17:22:07.038369 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:07.038343 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-rbac-proxy-self/0.log" Jun 09 17:22:07.638017 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:07.637991 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/init-textfile/0.log" Jun 09 17:22:07.838977 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:07.838928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/node-exporter/0.log" Jun 09 17:22:08.037981 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:08.037905 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/kube-rbac-proxy/0.log" Jun 09 17:22:09.438095 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:09.438053 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/kube-rbac-proxy-main/0.log" Jun 09 17:22:09.639043 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:09.639015 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/kube-rbac-proxy-self/0.log" Jun 09 17:22:09.840121 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:09.840040 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/openshift-state-metrics/0.log" Jun 09 17:22:10.038285 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:10.038257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/init-config-reloader/0.log" Jun 09 17:22:10.239337 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:10.239307 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/prometheus/0.log" Jun 09 17:22:10.438514 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:10.438485 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/config-reloader/0.log" Jun 09 17:22:10.640594 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:10.640572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/thanos-sidecar/0.log" Jun 09 17:22:10.839498 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:10.839464 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy-web/0.log" Jun 09 17:22:11.038583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:11.038490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy/0.log" Jun 09 17:22:11.244434 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:11.244399 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy-thanos/0.log" Jun 09 17:22:11.838736 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:11.838706 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-2zkz4_1728e357-fd0d-4a3c-87d9-74b41f6939fe/prometheus-operator-admission-webhook/0.log" Jun 09 17:22:13.244065 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:13.244022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-92ltz_45cd3753-5f35-47da-b4a3-651f2ebdf097/networking-console-plugin/0.log" Jun 09 17:22:13.438186 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:13.438156 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:22:13.648122 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:13.648082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/2.log" Jun 09 17:22:13.842658 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:13.842631 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76647c9799-9c9dd_0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1/console/0.log" Jun 09 17:22:15.166435 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:15.166400 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:22:15.170356 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:15.170331 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:22:15.838659 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:15.838628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57772_1425bdc3-ca38-44d4-b1ac-c4a39a889451/dns-node-resolver/0.log" Jun 09 17:22:16.238838 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:16.238790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6998555b4-gcj8w_99ea0b3f-6e41-4e08-99ce-9b8543ba43d2/registry/1.log" Jun 09 17:22:16.552579 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:16.552500 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:22:16.573792 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:16.573748 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:22:16.839036 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:16.838965 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwlhx_9f99dde7-d0a9-4841-bd41-36e6318af67c/node-ca/0.log" Jun 09 17:22:17.444886 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:17.444857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 17:22:17.638745 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:17.638712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67c5n_70c0d637-d3dc-4e28-beab-1aeef4d36c05/serve-healthcheck-canary/0.log" Jun 09 17:22:22.878669 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:22:22.878618 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9f6sv" podUID="32e20b2e-1a4e-4ef3-97ae-9933d40b8048" Jun 09 17:22:23.454370 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:23.454334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:25.374202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:25.374174 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6998555b4-gcj8w" Jun 09 17:22:26.226011 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:26.225972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:26.228345 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:26.228312 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32e20b2e-1a4e-4ef3-97ae-9933d40b8048-metrics-tls\") pod \"dns-default-9f6sv\" (UID: \"32e20b2e-1a4e-4ef3-97ae-9933d40b8048\") " pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:26.458145 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:26.458114 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hczml\"" Jun 09 17:22:26.466335 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:26.466303 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:26.599019 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:26.598994 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9f6sv"] Jun 09 17:22:26.601357 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:22:26.601317 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e20b2e_1a4e_4ef3_97ae_9933d40b8048.slice/crio-d41ac3a343e711688d6167a8856fc3e9bac4a4f1b53959b9225d368a97d2ce44 WatchSource:0}: Error finding container d41ac3a343e711688d6167a8856fc3e9bac4a4f1b53959b9225d368a97d2ce44: Status 404 returned error can't find the container with id d41ac3a343e711688d6167a8856fc3e9bac4a4f1b53959b9225d368a97d2ce44 Jun 09 17:22:27.471526 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:27.471474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f6sv" event={"ID":"32e20b2e-1a4e-4ef3-97ae-9933d40b8048","Type":"ContainerStarted","Data":"d41ac3a343e711688d6167a8856fc3e9bac4a4f1b53959b9225d368a97d2ce44"} Jun 09 17:22:28.477270 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:28.477228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f6sv" event={"ID":"32e20b2e-1a4e-4ef3-97ae-9933d40b8048","Type":"ContainerStarted","Data":"1a3da97caab3a1304bcfee9e54e86eb80c75355767c3af43fafdb27b90d0986d"} Jun 09 17:22:28.477654 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:28.477285 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f6sv" event={"ID":"32e20b2e-1a4e-4ef3-97ae-9933d40b8048","Type":"ContainerStarted","Data":"4ccab87936c11872620a1ffe729d20019ac2d030be70894082dfa0551f01719b"} Jun 09 17:22:28.477654 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:28.477323 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:28.493717 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:28.493667 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9f6sv" podStartSLOduration=251.027229038 podStartE2EDuration="4m12.493652051s" totalImagesPullingTime="1.466423013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:22:28.491829333 +0000 UTC m=+286.569977577" watchObservedRunningTime="2026-06-09 17:22:28.493652051 +0000 UTC m=+286.571800292" Jun 09 17:22:38.484517 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:38.484477 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9f6sv" Jun 09 17:22:42.273583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:42.273552 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:22:42.274094 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:42.273950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:22:42.285667 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:42.285642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:22:42.286056 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:42.286036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:22:42.288622 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:42.288605 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 17:22:59.939377 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:22:59.939336 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:23:24.967845 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:24.967724 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" containerID="cri-o://7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0" gracePeriod=15 Jun 09 17:23:25.222558 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.222488 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:23:25.337501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337463 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337531 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337555 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pmbk\" (UniqueName: \"kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337580 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337602 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.337778 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337628 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert\") pod \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\" (UID: \"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1\") " Jun 09 17:23:25.338063 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.337969 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:23:25.338161 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.338133 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:23:25.338215 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.338163 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config" (OuterVolumeSpecName: "console-config") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:23:25.338215 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.338189 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:23:25.339847 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.339819 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:23:25.339950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.339866 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk" (OuterVolumeSpecName: "kube-api-access-8pmbk") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "kube-api-access-8pmbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:23:25.340037 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.340020 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" (UID: "0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:23:25.438899 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438854 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.438899 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438890 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-oauth-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.438899 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438905 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-trusted-ca-bundle\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.439201 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438919 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pmbk\" (UniqueName: \"kubernetes.io/projected/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-kube-api-access-8pmbk\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.439201 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438931 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-oauth-config\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.439201 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438942 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-service-ca\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.439201 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.438953 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1-console-serving-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:23:25.700950 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.700911 2561 generic.go:356] "Generic (PLEG): container finished" podID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerID="7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0" exitCode=0 Jun 09 17:23:25.701131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.700965 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76647c9799-9c9dd" Jun 09 17:23:25.701131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.700993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76647c9799-9c9dd" event={"ID":"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1","Type":"ContainerDied","Data":"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0"} Jun 09 17:23:25.701131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.701045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76647c9799-9c9dd" event={"ID":"0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1","Type":"ContainerDied","Data":"940b03903a9917ab00a4be50c868d49a13d51bdbb39073b8ef4f1fb19e16b1dc"} Jun 09 17:23:25.701131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.701065 2561 scope.go:117] "RemoveContainer" containerID="7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0" Jun 09 17:23:25.709935 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.709915 2561 scope.go:117] "RemoveContainer" containerID="7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0" Jun 09 17:23:25.710206 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:23:25.710187 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0\": container with ID starting with 7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0 not found: ID does not exist" containerID="7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0" Jun 09 17:23:25.710256 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.710217 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0"} err="failed to get container status \"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0\": rpc error: code = NotFound desc = could not find container \"7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0\": container with ID starting with 7365cdb7c7182cdd2759858b9ff9caef80f50cf46b97de3520bc2aced41504b0 not found: ID does not exist" Jun 09 17:23:25.720763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.720735 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:23:25.724519 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:25.724493 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76647c9799-9c9dd"] Jun 09 17:23:26.168156 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:26.168107 2561 patch_prober.go:28] interesting pod/console-76647c9799-9c9dd container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 09 17:23:26.168539 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:26.168174 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-76647c9799-9c9dd" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jun 09 17:23:26.328044 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:23:26.328006 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" path="/var/lib/kubelet/pods/0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1/volumes" Jun 09 17:24:11.413904 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.413863 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-tdckl"] Jun 09 17:24:11.414313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414245 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerName="console" Jun 09 17:24:11.414313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414258 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerName="console" Jun 09 17:24:11.414313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414276 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" Jun 09 17:24:11.414313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414282 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" Jun 09 17:24:11.414460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414336 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7bcb1ba-a09c-47ae-9864-29bec8409950" containerName="console" Jun 09 17:24:11.414460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.414345 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2830b0-6c9a-4a83-9faa-35b4bdf42eb1" containerName="console" Jun 09 17:24:11.416855 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.416839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.418999 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.418971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 17:24:11.419119 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.419064 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-47phg\"" Jun 09 17:24:11.419885 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.419868 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 17:24:11.426402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.426380 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-tdckl"] Jun 09 17:24:11.518258 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.518219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-bound-sa-token\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.518459 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.518289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbmkr\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-kube-api-access-qbmkr\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.619666 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.619629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-bound-sa-token\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.619862 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.619696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbmkr\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-kube-api-access-qbmkr\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.627410 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.627373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-bound-sa-token\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.627555 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.627449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbmkr\" (UniqueName: \"kubernetes.io/projected/005ac700-4443-4228-b7f3-7cdab1c905cf-kube-api-access-qbmkr\") pod \"cert-manager-59c77684cc-tdckl\" (UID: \"005ac700-4443-4228-b7f3-7cdab1c905cf\") " pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.739225 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.739123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-tdckl" Jun 09 17:24:11.874500 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.874473 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-tdckl"] Jun 09 17:24:11.877215 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:24:11.877180 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod005ac700_4443_4228_b7f3_7cdab1c905cf.slice/crio-c81dc82dfc163aa123fb9a5d344d25806c66b10578862cce215191642209debe WatchSource:0}: Error finding container c81dc82dfc163aa123fb9a5d344d25806c66b10578862cce215191642209debe: Status 404 returned error can't find the container with id c81dc82dfc163aa123fb9a5d344d25806c66b10578862cce215191642209debe Jun 09 17:24:11.879053 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:11.879036 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:24:12.883671 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:12.883635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-tdckl" event={"ID":"005ac700-4443-4228-b7f3-7cdab1c905cf","Type":"ContainerStarted","Data":"c81dc82dfc163aa123fb9a5d344d25806c66b10578862cce215191642209debe"} Jun 09 17:24:16.900670 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:16.900628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-tdckl" event={"ID":"005ac700-4443-4228-b7f3-7cdab1c905cf","Type":"ContainerStarted","Data":"c2cd987a7ebd9dc9c807956a26e51f26de3d1165a85d982b25a33cc49da43e3c"} Jun 09 17:24:16.918953 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:16.918896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-tdckl" podStartSLOduration=1.889596768 podStartE2EDuration="5.918879942s" totalImagesPullingTime="4.029283174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:24:16.91662524 +0000 UTC m=+394.994773482" watchObservedRunningTime="2026-06-09 17:24:16.918879942 +0000 UTC m=+394.997028183" Jun 09 17:24:20.908467 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.908432 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz"] Jun 09 17:24:20.911792 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.911773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:20.914317 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.914288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 17:24:20.914454 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.914295 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:24:20.915252 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.915230 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 17:24:20.915398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.915233 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 17:24:20.915398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.915265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 17:24:20.915398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.915332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rb55b\"" Jun 09 17:24:20.920521 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:20.920497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz"] Jun 09 17:24:21.005511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.005479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-manager-config\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.005731 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.005527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-metrics-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.005731 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.005638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlv4\" (UniqueName: \"kubernetes.io/projected/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-kube-api-access-8dlv4\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.005731 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.005695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.106879 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.106843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-manager-config\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.107088 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.106907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-metrics-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.107088 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.106943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlv4\" (UniqueName: \"kubernetes.io/projected/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-kube-api-access-8dlv4\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.107088 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.106980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.107587 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.107559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-manager-config\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.109511 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.109486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-metrics-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.109591 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.109576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-cert\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.115219 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.115198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlv4\" (UniqueName: \"kubernetes.io/projected/9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb-kube-api-access-8dlv4\") pod \"lws-controller-manager-59b6c4b7cf-kz2hz\" (UID: \"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb\") " pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.222897 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.222774 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:21.357488 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.357453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz"] Jun 09 17:24:21.361163 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:24:21.361129 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6a7cee_7a2a_4d01_8e6b_18f4b49967bb.slice/crio-a69efe24d04a0c652d192aae9212f66ab515ab46acc30982e7294c2a0fa6a428 WatchSource:0}: Error finding container a69efe24d04a0c652d192aae9212f66ab515ab46acc30982e7294c2a0fa6a428: Status 404 returned error can't find the container with id a69efe24d04a0c652d192aae9212f66ab515ab46acc30982e7294c2a0fa6a428 Jun 09 17:24:21.921286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:21.921249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" event={"ID":"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb","Type":"ContainerStarted","Data":"a69efe24d04a0c652d192aae9212f66ab515ab46acc30982e7294c2a0fa6a428"} Jun 09 17:24:23.931421 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:23.931384 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" event={"ID":"9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb","Type":"ContainerStarted","Data":"f938f20f4112f0f573cf098e985ef7948cd58ac2c901df905ab70c1a25a6cdf6"} Jun 09 17:24:23.931765 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:23.931532 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:23.946978 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:23.946920 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" podStartSLOduration=1.451373322 podStartE2EDuration="3.946903831s" totalImagesPullingTime="2.495530509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:24:23.94522337 +0000 UTC m=+402.023371624" watchObservedRunningTime="2026-06-09 17:24:23.946903831 +0000 UTC m=+402.025052072" Jun 09 17:24:30.889340 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.889293 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4"] Jun 09 17:24:30.892905 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.892885 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:30.895878 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.895849 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 17:24:30.896047 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.896005 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 17:24:30.896147 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.896127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6mndt\"" Jun 09 17:24:30.896243 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.896227 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 17:24:30.896723 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.896708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 17:24:30.910610 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.910575 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4"] Jun 09 17:24:30.994171 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.994124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9s7n\" (UniqueName: \"kubernetes.io/projected/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-kube-api-access-w9s7n\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:30.994171 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.994177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-webhook-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:30.994429 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.994211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:30.994429 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.994277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-tmp\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:30.994429 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:30.994319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-manifests\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.095673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.095633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-webhook-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.095673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.095675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.095966 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.095702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-tmp\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.095966 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.095740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-manifests\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.095966 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.095856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9s7n\" (UniqueName: \"kubernetes.io/projected/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-kube-api-access-w9s7n\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.096267 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.096236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-manifests\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.098341 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.098309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-tmp\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.098466 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.098365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.098466 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.098431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-webhook-cert\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.103890 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.103863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9s7n\" (UniqueName: \"kubernetes.io/projected/3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476-kube-api-access-w9s7n\") pod \"opendatahub-operator-controller-manager-7456486947-v6gq4\" (UID: \"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476\") " pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.203991 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.203894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:31.376887 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.370563 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4"] Jun 09 17:24:31.968705 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:31.968663 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" event={"ID":"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476","Type":"ContainerStarted","Data":"5734b54c53a0dd62c4c32de39dff9c182d7b3270449e5a31df037586d74db4b2"} Jun 09 17:24:34.938448 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:34.938416 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59b6c4b7cf-kz2hz" Jun 09 17:24:34.986352 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:34.986315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" event={"ID":"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476","Type":"ContainerStarted","Data":"b6ee5b54e76d3c334578ae0f2a3c3c9ee0d3841368e43eb6895122908c9b090c"} Jun 09 17:24:35.992402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:35.992367 2561 generic.go:356] "Generic (PLEG): container finished" podID="3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476" containerID="b6ee5b54e76d3c334578ae0f2a3c3c9ee0d3841368e43eb6895122908c9b090c" exitCode=0 Jun 09 17:24:35.992402 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:35.992405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" event={"ID":"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476","Type":"ContainerDied","Data":"b6ee5b54e76d3c334578ae0f2a3c3c9ee0d3841368e43eb6895122908c9b090c"} Jun 09 17:24:36.999284 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:36.999244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" event={"ID":"3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476","Type":"ContainerStarted","Data":"3c9fe2b24c25a54bc276a1efb5dde1cb3c26e7c530c6652e791722aa6160de40"} Jun 09 17:24:36.999828 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:36.999367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:24:37.019199 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:37.019136 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" podStartSLOduration=2.769572995 podStartE2EDuration="7.019117826s" totalImagesPullingTime="3.242195972s" totalInitContainerRuntime="1.007348859s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:24:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:24:37.01721934 +0000 UTC m=+415.095367581" watchObservedRunningTime="2026-06-09 17:24:37.019117826 +0000 UTC m=+415.097266066" Jun 09 17:24:48.006350 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:24:48.006319 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7456486947-v6gq4" Jun 09 17:25:23.656708 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.656665 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx"] Jun 09 17:25:23.668122 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.668090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.670909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.670785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 17:25:23.671300 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.671276 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9wnpn\"" Jun 09 17:25:23.671418 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.671294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 17:25:23.671418 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.671376 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 17:25:23.673170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.673135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx"] Jun 09 17:25:23.776029 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.775982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k875z\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-kube-api-access-k875z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776221 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.776411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.776319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.877718 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.877969 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.877969 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.877969 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k875z\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-kube-api-access-k875z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.877969 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878210 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.877982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878210 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878210 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878210 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878416 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878567 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.878861 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.878840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.880392 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.880370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.880593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.880572 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.889644 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.889596 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k875z\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-kube-api-access-k875z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.889862 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.889838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daa6b463-a570-42a3-b3bf-59b3ccacbff5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xgqbx\" (UID: \"daa6b463-a570-42a3-b3bf-59b3ccacbff5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:23.981320 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:23.981224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:24.134748 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:24.134707 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx"] Jun 09 17:25:24.137990 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:25:24.137955 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa6b463_a570_42a3_b3bf_59b3ccacbff5.slice/crio-9b68eef1bb28c98f884d2ce643974afc6cda74e00e7cda09d6d3e43576873507 WatchSource:0}: Error finding container 9b68eef1bb28c98f884d2ce643974afc6cda74e00e7cda09d6d3e43576873507: Status 404 returned error can't find the container with id 9b68eef1bb28c98f884d2ce643974afc6cda74e00e7cda09d6d3e43576873507 Jun 09 17:25:24.221976 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:24.221938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" event={"ID":"daa6b463-a570-42a3-b3bf-59b3ccacbff5","Type":"ContainerStarted","Data":"9b68eef1bb28c98f884d2ce643974afc6cda74e00e7cda09d6d3e43576873507"} Jun 09 17:25:29.155262 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.155216 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:25:29.155586 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.155301 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:25:29.155586 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.155331 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:25:29.248453 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.248411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" event={"ID":"daa6b463-a570-42a3-b3bf-59b3ccacbff5","Type":"ContainerStarted","Data":"879c124f530744e05de36a8f7c69ee2bb677b9b61197a778b0355df00ae509ca"} Jun 09 17:25:29.271744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.270758 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" podStartSLOduration=1.255849134 podStartE2EDuration="6.270731442s" totalImagesPullingTime="5.014882308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:25:29.268019145 +0000 UTC m=+467.346167386" watchObservedRunningTime="2026-06-09 17:25:29.270731442 +0000 UTC m=+467.348879684" Jun 09 17:25:29.632116 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.632073 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86d495cbff-lh6pt"] Jun 09 17:25:29.636022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.635989 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.638763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.638728 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lkwjv\"" Jun 09 17:25:29.638763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.638749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 17:25:29.645913 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.645880 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86d495cbff-lh6pt"] Jun 09 17:25:29.740166 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.740119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q52k\" (UniqueName: \"kubernetes.io/projected/d695228c-02b0-4593-a3f0-df074699564a-kube-api-access-4q52k\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.740353 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.740266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d695228c-02b0-4593-a3f0-df074699564a-redirect-config\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.841486 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.841437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q52k\" (UniqueName: \"kubernetes.io/projected/d695228c-02b0-4593-a3f0-df074699564a-kube-api-access-4q52k\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.841702 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.841545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d695228c-02b0-4593-a3f0-df074699564a-redirect-config\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.842320 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.842291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d695228c-02b0-4593-a3f0-df074699564a-redirect-config\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.849909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.849868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q52k\" (UniqueName: \"kubernetes.io/projected/d695228c-02b0-4593-a3f0-df074699564a-kube-api-access-4q52k\") pod \"dashboard-redirect-86d495cbff-lh6pt\" (UID: \"d695228c-02b0-4593-a3f0-df074699564a\") " pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.948790 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.948698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" Jun 09 17:25:29.982102 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:29.982058 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:30.094064 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:30.094034 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86d495cbff-lh6pt"] Jun 09 17:25:30.096839 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:25:30.096778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd695228c_02b0_4593_a3f0_df074699564a.slice/crio-8dfc92dd2e72c94ca4483c7de540d6483a764237e89061e91b8cf24c57461f83 WatchSource:0}: Error finding container 8dfc92dd2e72c94ca4483c7de540d6483a764237e89061e91b8cf24c57461f83: Status 404 returned error can't find the container with id 8dfc92dd2e72c94ca4483c7de540d6483a764237e89061e91b8cf24c57461f83 Jun 09 17:25:30.255059 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:30.254954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" event={"ID":"d695228c-02b0-4593-a3f0-df074699564a","Type":"ContainerStarted","Data":"8dfc92dd2e72c94ca4483c7de540d6483a764237e89061e91b8cf24c57461f83"} Jun 09 17:25:30.988188 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:30.988158 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:31.261491 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:31.261395 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:31.262614 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:31.262582 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xgqbx" Jun 09 17:25:33.276591 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:33.276555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" event={"ID":"d695228c-02b0-4593-a3f0-df074699564a","Type":"ContainerStarted","Data":"b0955dd2fbade5c37ed66bc86c4cdb185a2409d1a61f882c141643699d2d558a"} Jun 09 17:25:33.291000 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:33.290942 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86d495cbff-lh6pt" podStartSLOduration=1.7589824950000001 podStartE2EDuration="4.290922933s" totalImagesPullingTime="2.531940438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:25:33.289612639 +0000 UTC m=+471.367760880" watchObservedRunningTime="2026-06-09 17:25:33.290922933 +0000 UTC m=+471.369071224" Jun 09 17:25:51.317232 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.317185 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:51.333672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.333639 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:51.333901 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.333736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:51.336608 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.336574 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ghzn2\"" Jun 09 17:25:51.337665 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.337633 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 17:25:51.337839 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.337676 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 17:25:51.448274 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.448233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6q4\" (UniqueName: \"kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4\") pod \"kuadrant-operator-catalog-5ptbh\" (UID: \"165c6202-34c9-4c01-8e41-bec8b337f5ae\") " pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:51.549263 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.549207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6q4\" (UniqueName: \"kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4\") pod \"kuadrant-operator-catalog-5ptbh\" (UID: \"165c6202-34c9-4c01-8e41-bec8b337f5ae\") " pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:51.561090 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.561047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6q4\" (UniqueName: \"kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4\") pod \"kuadrant-operator-catalog-5ptbh\" (UID: \"165c6202-34c9-4c01-8e41-bec8b337f5ae\") " pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:51.647947 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.647907 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:51.797736 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.797708 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:51.800574 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:25:51.800542 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165c6202_34c9_4c01_8e41_bec8b337f5ae.slice/crio-c5b0d4e2b5d9fce36111bbd5b3d7d810641baf9bf812c0a1dba5dd5f4c425e16 WatchSource:0}: Error finding container c5b0d4e2b5d9fce36111bbd5b3d7d810641baf9bf812c0a1dba5dd5f4c425e16: Status 404 returned error can't find the container with id c5b0d4e2b5d9fce36111bbd5b3d7d810641baf9bf812c0a1dba5dd5f4c425e16 Jun 09 17:25:51.918858 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.918707 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:51.938174 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.938132 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft6fk"] Jun 09 17:25:51.943476 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.943449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:25:51.948313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:51.948274 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft6fk"] Jun 09 17:25:52.053132 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.053086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94sq\" (UniqueName: \"kubernetes.io/projected/a5b19c44-2dbe-433d-821b-edbe9118606b-kube-api-access-n94sq\") pod \"kuadrant-operator-catalog-ft6fk\" (UID: \"a5b19c44-2dbe-433d-821b-edbe9118606b\") " pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:25:52.154048 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.154014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94sq\" (UniqueName: \"kubernetes.io/projected/a5b19c44-2dbe-433d-821b-edbe9118606b-kube-api-access-n94sq\") pod \"kuadrant-operator-catalog-ft6fk\" (UID: \"a5b19c44-2dbe-433d-821b-edbe9118606b\") " pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:25:52.163434 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.163384 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94sq\" (UniqueName: \"kubernetes.io/projected/a5b19c44-2dbe-433d-821b-edbe9118606b-kube-api-access-n94sq\") pod \"kuadrant-operator-catalog-ft6fk\" (UID: \"a5b19c44-2dbe-433d-821b-edbe9118606b\") " pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:25:52.256770 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.256659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:25:52.375327 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.375281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" event={"ID":"165c6202-34c9-4c01-8e41-bec8b337f5ae","Type":"ContainerStarted","Data":"c5b0d4e2b5d9fce36111bbd5b3d7d810641baf9bf812c0a1dba5dd5f4c425e16"} Jun 09 17:25:52.407432 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:52.407397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft6fk"] Jun 09 17:25:52.410279 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:25:52.410236 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b19c44_2dbe_433d_821b_edbe9118606b.slice/crio-183717ef567692e7277cd802ab54ff99fe1a619e343fe791ecc7e10ba9ec03b8 WatchSource:0}: Error finding container 183717ef567692e7277cd802ab54ff99fe1a619e343fe791ecc7e10ba9ec03b8: Status 404 returned error can't find the container with id 183717ef567692e7277cd802ab54ff99fe1a619e343fe791ecc7e10ba9ec03b8 Jun 09 17:25:53.384899 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:53.384859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" event={"ID":"a5b19c44-2dbe-433d-821b-edbe9118606b","Type":"ContainerStarted","Data":"183717ef567692e7277cd802ab54ff99fe1a619e343fe791ecc7e10ba9ec03b8"} Jun 09 17:25:55.396123 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.396084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" event={"ID":"a5b19c44-2dbe-433d-821b-edbe9118606b","Type":"ContainerStarted","Data":"44daf4f239e44b83dee7cc0878d6e40e4b8675db17ce125e8f50e3e1da18f1c2"} Jun 09 17:25:55.397604 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.397576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" event={"ID":"165c6202-34c9-4c01-8e41-bec8b337f5ae","Type":"ContainerStarted","Data":"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d"} Jun 09 17:25:55.397722 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.397690 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" podUID="165c6202-34c9-4c01-8e41-bec8b337f5ae" containerName="registry-server" containerID="cri-o://9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d" gracePeriod=2 Jun 09 17:25:55.411630 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.411553 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" podStartSLOduration=2.366922763 podStartE2EDuration="4.411531255s" totalImagesPullingTime="2.044608492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:25:55.409521244 +0000 UTC m=+493.487669487" watchObservedRunningTime="2026-06-09 17:25:55.411531255 +0000 UTC m=+493.489679498" Jun 09 17:25:55.430145 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.430087 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" podStartSLOduration=1.779520936 podStartE2EDuration="4.430072946s" totalImagesPullingTime="2.65055201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:25:55.429366617 +0000 UTC m=+493.507514860" watchObservedRunningTime="2026-06-09 17:25:55.430072946 +0000 UTC m=+493.508221187" Jun 09 17:25:55.660100 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.660006 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:55.790691 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.790636 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g6q4\" (UniqueName: \"kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4\") pod \"165c6202-34c9-4c01-8e41-bec8b337f5ae\" (UID: \"165c6202-34c9-4c01-8e41-bec8b337f5ae\") " Jun 09 17:25:55.793273 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.793235 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4" (OuterVolumeSpecName: "kube-api-access-4g6q4") pod "165c6202-34c9-4c01-8e41-bec8b337f5ae" (UID: "165c6202-34c9-4c01-8e41-bec8b337f5ae"). InnerVolumeSpecName "kube-api-access-4g6q4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:25:55.891643 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:55.891584 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g6q4\" (UniqueName: \"kubernetes.io/projected/165c6202-34c9-4c01-8e41-bec8b337f5ae-kube-api-access-4g6q4\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:25:56.403794 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.403752 2561 generic.go:356] "Generic (PLEG): container finished" podID="165c6202-34c9-4c01-8e41-bec8b337f5ae" containerID="9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d" exitCode=0 Jun 09 17:25:56.404244 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.403826 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" Jun 09 17:25:56.404244 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.403847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" event={"ID":"165c6202-34c9-4c01-8e41-bec8b337f5ae","Type":"ContainerDied","Data":"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d"} Jun 09 17:25:56.404244 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.403909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ptbh" event={"ID":"165c6202-34c9-4c01-8e41-bec8b337f5ae","Type":"ContainerDied","Data":"c5b0d4e2b5d9fce36111bbd5b3d7d810641baf9bf812c0a1dba5dd5f4c425e16"} Jun 09 17:25:56.404244 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.403931 2561 scope.go:117] "RemoveContainer" containerID="9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d" Jun 09 17:25:56.413346 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.413326 2561 scope.go:117] "RemoveContainer" containerID="9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d" Jun 09 17:25:56.413662 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:25:56.413637 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d\": container with ID starting with 9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d not found: ID does not exist" containerID="9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d" Jun 09 17:25:56.413769 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.413670 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d"} err="failed to get container status \"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d\": rpc error: code = NotFound desc = could not find container \"9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d\": container with ID starting with 9c4f0f529781760dc08367e0c529447cb8761187dde6686a08f42a7413a9101d not found: ID does not exist" Jun 09 17:25:56.421180 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.421141 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:56.425883 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:56.425846 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ptbh"] Jun 09 17:25:58.329064 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:25:58.329021 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165c6202-34c9-4c01-8e41-bec8b337f5ae" path="/var/lib/kubelet/pods/165c6202-34c9-4c01-8e41-bec8b337f5ae/volumes" Jun 09 17:26:02.257733 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:02.257694 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:26:02.258406 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:02.257783 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:26:02.281264 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:02.281227 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:26:02.461825 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:02.461778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ft6fk" Jun 09 17:26:23.696347 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.696308 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqksn"] Jun 09 17:26:23.696780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.696710 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165c6202-34c9-4c01-8e41-bec8b337f5ae" containerName="registry-server" Jun 09 17:26:23.696780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.696723 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="165c6202-34c9-4c01-8e41-bec8b337f5ae" containerName="registry-server" Jun 09 17:26:23.696780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.696777 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="165c6202-34c9-4c01-8e41-bec8b337f5ae" containerName="registry-server" Jun 09 17:26:23.701256 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.701228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:23.703986 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.703957 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8757s\"" Jun 09 17:26:23.711661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.711636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqksn"] Jun 09 17:26:23.757917 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.757740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwxn\" (UniqueName: \"kubernetes.io/projected/e55f7550-760f-4539-ba6f-5e84ae285428-kube-api-access-6xwxn\") pod \"authorino-operator-75cc8d5cb7-nqksn\" (UID: \"e55f7550-760f-4539-ba6f-5e84ae285428\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:23.858683 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.858618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwxn\" (UniqueName: \"kubernetes.io/projected/e55f7550-760f-4539-ba6f-5e84ae285428-kube-api-access-6xwxn\") pod \"authorino-operator-75cc8d5cb7-nqksn\" (UID: \"e55f7550-760f-4539-ba6f-5e84ae285428\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:23.875208 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:23.875166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwxn\" (UniqueName: \"kubernetes.io/projected/e55f7550-760f-4539-ba6f-5e84ae285428-kube-api-access-6xwxn\") pod \"authorino-operator-75cc8d5cb7-nqksn\" (UID: \"e55f7550-760f-4539-ba6f-5e84ae285428\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:24.015310 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:24.015206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:24.164964 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:24.164925 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqksn"] Jun 09 17:26:24.168520 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:26:24.168491 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55f7550_760f_4539_ba6f_5e84ae285428.slice/crio-24730f74409c16b9be1c6d12fa8443241e5247375f2bef0bdc736464b3838804 WatchSource:0}: Error finding container 24730f74409c16b9be1c6d12fa8443241e5247375f2bef0bdc736464b3838804: Status 404 returned error can't find the container with id 24730f74409c16b9be1c6d12fa8443241e5247375f2bef0bdc736464b3838804 Jun 09 17:26:24.542676 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:24.542635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" event={"ID":"e55f7550-760f-4539-ba6f-5e84ae285428","Type":"ContainerStarted","Data":"24730f74409c16b9be1c6d12fa8443241e5247375f2bef0bdc736464b3838804"} Jun 09 17:26:26.937389 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:26.937345 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp"] Jun 09 17:26:26.941634 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:26.941591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:26.943958 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:26.943929 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rh5dl\"" Jun 09 17:26:26.948241 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:26.948202 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp"] Jun 09 17:26:26.991968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:26.991931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4n4z\" (UniqueName: \"kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z\") pod \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" (UID: \"cf8774c8-6365-456a-94ad-02d871642f9b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:27.092463 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.092423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4n4z\" (UniqueName: \"kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z\") pod \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" (UID: \"cf8774c8-6365-456a-94ad-02d871642f9b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:27.103293 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.103246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4n4z\" (UniqueName: \"kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z\") pod \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" (UID: \"cf8774c8-6365-456a-94ad-02d871642f9b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:27.255677 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.255569 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:27.407672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.407645 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp"] Jun 09 17:26:27.410174 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:26:27.410137 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8774c8_6365_456a_94ad_02d871642f9b.slice/crio-7096e7e35148fa485329543a3390fcc8d8e1a1502a04418305389613dacef9ad WatchSource:0}: Error finding container 7096e7e35148fa485329543a3390fcc8d8e1a1502a04418305389613dacef9ad: Status 404 returned error can't find the container with id 7096e7e35148fa485329543a3390fcc8d8e1a1502a04418305389613dacef9ad Jun 09 17:26:27.560991 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.560876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" event={"ID":"e55f7550-760f-4539-ba6f-5e84ae285428","Type":"ContainerStarted","Data":"0c6bcd9da2c9ec83a5b51d94ddb6d9d29a9eb33418c5ea9c9ff68ea322689811"} Jun 09 17:26:27.560991 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.560955 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:27.562317 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.562286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" event={"ID":"cf8774c8-6365-456a-94ad-02d871642f9b","Type":"ContainerStarted","Data":"7096e7e35148fa485329543a3390fcc8d8e1a1502a04418305389613dacef9ad"} Jun 09 17:26:27.583541 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:27.583482 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" podStartSLOduration=1.7458955619999998 podStartE2EDuration="4.583461326s" totalImagesPullingTime="2.837565764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:26:27.583106321 +0000 UTC m=+525.661254565" watchObservedRunningTime="2026-06-09 17:26:27.583461326 +0000 UTC m=+525.661609566" Jun 09 17:26:29.580605 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:29.580501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" event={"ID":"cf8774c8-6365-456a-94ad-02d871642f9b","Type":"ContainerStarted","Data":"e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9"} Jun 09 17:26:29.581097 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:29.580608 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:29.597218 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:29.597157 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" podStartSLOduration=1.831382407 podStartE2EDuration="3.59713788s" totalImagesPullingTime="1.765755473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:26:29.595409298 +0000 UTC m=+527.673557538" watchObservedRunningTime="2026-06-09 17:26:29.59713788 +0000 UTC m=+527.675286120" Jun 09 17:26:38.569557 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:38.569525 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqksn" Jun 09 17:26:40.588909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:40.588867 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:55.764736 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.764693 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl"] Jun 09 17:26:55.769736 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.769705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.772385 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.772349 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjmd\"" Jun 09 17:26:55.782738 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.782707 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl"] Jun 09 17:26:55.861720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.861682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zn7\" (UniqueName: \"kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.861942 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.861828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.962890 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.962841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zn7\" (UniqueName: \"kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.963090 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.962958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.963414 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.963392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:55.971314 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:55.971283 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zn7\" (UniqueName: \"kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7\") pod \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.080720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.080623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.140532 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.140498 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl"] Jun 09 17:26:56.154489 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.154397 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl"] Jun 09 17:26:56.194330 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.194298 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:26:56.197561 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.197531 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp"] Jun 09 17:26:56.197735 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.197704 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.198126 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.197712 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" containerName="manager" containerID="cri-o://e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9" gracePeriod=2 Jun 09 17:26:56.205539 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.205316 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp"] Jun 09 17:26:56.211417 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.211333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:26:56.224933 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.224897 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc"] Jun 09 17:26:56.226179 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.225938 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" containerName="manager" Jun 09 17:26:56.226179 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.225971 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" containerName="manager" Jun 09 17:26:56.226179 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.226118 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" containerName="manager" Jun 09 17:26:56.227945 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.227904 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:56.229484 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.229460 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:56.229966 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.229942 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:56.237785 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.237742 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc"] Jun 09 17:26:56.256781 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.256737 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tj4wp\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:56.265391 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.265352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htppw\" (UniqueName: \"kubernetes.io/projected/22a9e47e-8a56-4cd9-8a5b-df59cfa802f0-kube-api-access-htppw\") pod \"limitador-operator-controller-manager-859d7b78bd-x5glc\" (UID: \"22a9e47e-8a56-4cd9-8a5b-df59cfa802f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:56.265605 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.265421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.265605 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.265550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhdv\" (UniqueName: \"kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.366636 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.366542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.366812 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.366642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhdv\" (UniqueName: \"kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.366812 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.366692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htppw\" (UniqueName: \"kubernetes.io/projected/22a9e47e-8a56-4cd9-8a5b-df59cfa802f0-kube-api-access-htppw\") pod \"limitador-operator-controller-manager-859d7b78bd-x5glc\" (UID: \"22a9e47e-8a56-4cd9-8a5b-df59cfa802f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:56.367057 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.367016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.377170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.377130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhdv\" (UniqueName: \"kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tggf\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.377313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.377130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htppw\" (UniqueName: \"kubernetes.io/projected/22a9e47e-8a56-4cd9-8a5b-df59cfa802f0-kube-api-access-htppw\") pod \"limitador-operator-controller-manager-859d7b78bd-x5glc\" (UID: \"22a9e47e-8a56-4cd9-8a5b-df59cfa802f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.386859 2561 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-thjdl_kuadrant-system_8bbafef9-ab8b-49f6-ade6-1c239ab120a0_0(a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-thjdl to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338" Netns:"/var/run/netns/d035ea17-7896-48a5-a380-34c302419959" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-thjdl;K8S_POD_INFRA_CONTAINER_ID=a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338;K8S_POD_UID=8bbafef9-ab8b-49f6-ade6-1c239ab120a0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl/8bbafef9-ab8b-49f6-ade6-1c239ab120a0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:21 [10.133.0.33/23] Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: ' Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: > Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.386958 2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-thjdl_kuadrant-system_8bbafef9-ab8b-49f6-ade6-1c239ab120a0_0(a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-thjdl to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338" Netns:"/var/run/netns/d035ea17-7896-48a5-a380-34c302419959" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-thjdl;K8S_POD_INFRA_CONTAINER_ID=a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338;K8S_POD_UID=8bbafef9-ab8b-49f6-ade6-1c239ab120a0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl/8bbafef9-ab8b-49f6-ade6-1c239ab120a0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl a418942da364492a4e596f4b34a692776d3b8edca71c812098393995c55ed338 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:21 [10.133.0.33/23] Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: ' Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 09 17:26:56.387033 ip-10-0-142-117 kubenswrapper[2561]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.440530 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.440500 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:56.467457 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.467425 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4n4z\" (UniqueName: \"kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z\") pod \"cf8774c8-6365-456a-94ad-02d871642f9b\" (UID: \"cf8774c8-6365-456a-94ad-02d871642f9b\") " Jun 09 17:26:56.469567 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.469534 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z" (OuterVolumeSpecName: "kube-api-access-n4n4z") pod "cf8774c8-6365-456a-94ad-02d871642f9b" (UID: "cf8774c8-6365-456a-94ad-02d871642f9b"). InnerVolumeSpecName "kube-api-access-n4n4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:26:56.568220 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.568186 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4n4z\" (UniqueName: \"kubernetes.io/projected/cf8774c8-6365-456a-94ad-02d871642f9b-kube-api-access-n4n4z\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:26:56.576980 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.576946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:26:56.583871 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.583842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:56.721788 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.721752 2561 generic.go:356] "Generic (PLEG): container finished" podID="cf8774c8-6365-456a-94ad-02d871642f9b" containerID="e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9" exitCode=0 Jun 09 17:26:56.721988 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.721829 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj4wp" Jun 09 17:26:56.721988 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.721864 2561 scope.go:117] "RemoveContainer" containerID="e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9" Jun 09 17:26:56.722101 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.722055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.729980 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.729946 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:26:56.733512 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.733481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.735502 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.735474 2561 scope.go:117] "RemoveContainer" containerID="e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9" Jun 09 17:26:56.735823 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.735780 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="8bbafef9-ab8b-49f6-ade6-1c239ab120a0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:56.735920 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:56.735890 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9\": container with ID starting with e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9 not found: ID does not exist" containerID="e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9" Jun 09 17:26:56.735983 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.735929 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9"} err="failed to get container status \"e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9\": rpc error: code = NotFound desc = could not find container \"e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9\": container with ID starting with e612b8fb5f9a8e1a24c2dcf00a7f166b640bd45fa8aff0d244d7f3f7fd4086b9 not found: ID does not exist" Jun 09 17:26:56.737102 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:26:56.737076 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1477dff_c5b6_433e_86c1_870c59e49651.slice/crio-75132667707e3e953b5d49223f9c1a62d42abe62b4bfad4a6464a286ecefaf64 WatchSource:0}: Error finding container 75132667707e3e953b5d49223f9c1a62d42abe62b4bfad4a6464a286ecefaf64: Status 404 returned error can't find the container with id 75132667707e3e953b5d49223f9c1a62d42abe62b4bfad4a6464a286ecefaf64 Jun 09 17:26:56.768654 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.768490 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc"] Jun 09 17:26:56.769717 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.769697 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7zn7\" (UniqueName: \"kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7\") pod \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " Jun 09 17:26:56.769814 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.769734 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume\") pod \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\" (UID: \"8bbafef9-ab8b-49f6-ade6-1c239ab120a0\") " Jun 09 17:26:56.770073 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.770051 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8bbafef9-ab8b-49f6-ade6-1c239ab120a0" (UID: "8bbafef9-ab8b-49f6-ade6-1c239ab120a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:26:56.771960 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.771934 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7" (OuterVolumeSpecName: "kube-api-access-x7zn7") pod "8bbafef9-ab8b-49f6-ade6-1c239ab120a0" (UID: "8bbafef9-ab8b-49f6-ade6-1c239ab120a0"). InnerVolumeSpecName "kube-api-access-x7zn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:26:56.871097 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.871055 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7zn7\" (UniqueName: \"kubernetes.io/projected/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-kube-api-access-x7zn7\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:26:56.871097 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:56.871087 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbafef9-ab8b-49f6-ade6-1c239ab120a0-extensions-socket-volume\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:26:57.730018 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.729976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" event={"ID":"a1477dff-c5b6-433e-86c1-870c59e49651","Type":"ContainerStarted","Data":"75132667707e3e953b5d49223f9c1a62d42abe62b4bfad4a6464a286ecefaf64"} Jun 09 17:26:57.731761 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.731727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" event={"ID":"22a9e47e-8a56-4cd9-8a5b-df59cfa802f0","Type":"ContainerStarted","Data":"92a620920f943179f4ffac92dae3c909eb30f3e63fe26f6d625c7650760876d8"} Jun 09 17:26:57.731945 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.731789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" event={"ID":"22a9e47e-8a56-4cd9-8a5b-df59cfa802f0","Type":"ContainerStarted","Data":"29f25515b67cc539328c73d4d78ee64beec34a5b4178317130060607e2b98e6a"} Jun 09 17:26:57.731945 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.731737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:57.732130 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.732111 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:26:57.748473 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:57.748433 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="8bbafef9-ab8b-49f6-ade6-1c239ab120a0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:57.748678 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:57.748633 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" podStartSLOduration=1.748612984 podStartE2EDuration="1.748612984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:26:57.746336838 +0000 UTC m=+555.824485098" watchObservedRunningTime="2026-06-09 17:26:57.748612984 +0000 UTC m=+555.826761226" Jun 09 17:26:57.750201 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:26:57.750173 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-thjdl\" is forbidden: User \"system:node:ip-10-0-142-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-117.ec2.internal' and this object" podUID="8bbafef9-ab8b-49f6-ade6-1c239ab120a0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-thjdl" Jun 09 17:26:58.331513 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:58.331472 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bbafef9-ab8b-49f6-ade6-1c239ab120a0" path="/var/lib/kubelet/pods/8bbafef9-ab8b-49f6-ade6-1c239ab120a0/volumes" Jun 09 17:26:58.331941 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:26:58.331823 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8774c8-6365-456a-94ad-02d871642f9b" path="/var/lib/kubelet/pods/cf8774c8-6365-456a-94ad-02d871642f9b/volumes" Jun 09 17:27:01.756406 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:01.756366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" event={"ID":"a1477dff-c5b6-433e-86c1-870c59e49651","Type":"ContainerStarted","Data":"cac11c3fdf112b5420887b278108d7c5bc2b20c5c84741c7da058067fccc653d"} Jun 09 17:27:01.756866 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:01.756456 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:27:01.774100 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:01.774048 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" podStartSLOduration=0.910750824 podStartE2EDuration="5.774030494s" totalImagesPullingTime="4.86327967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:27:01.772940815 +0000 UTC m=+559.851089056" watchObservedRunningTime="2026-06-09 17:27:01.774030494 +0000 UTC m=+559.852178733" Jun 09 17:27:08.594352 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.594307 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:27:08.594835 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.594521 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" podUID="a1477dff-c5b6-433e-86c1-870c59e49651" containerName="manager" containerID="cri-o://cac11c3fdf112b5420887b278108d7c5bc2b20c5c84741c7da058067fccc653d" gracePeriod=10 Jun 09 17:27:08.596780 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.596754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:27:08.741547 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.741508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x5glc" Jun 09 17:27:08.793942 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.793902 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1477dff-c5b6-433e-86c1-870c59e49651" containerID="cac11c3fdf112b5420887b278108d7c5bc2b20c5c84741c7da058067fccc653d" exitCode=0 Jun 09 17:27:08.794160 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.793944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" event={"ID":"a1477dff-c5b6-433e-86c1-870c59e49651","Type":"ContainerDied","Data":"cac11c3fdf112b5420887b278108d7c5bc2b20c5c84741c7da058067fccc653d"} Jun 09 17:27:08.867947 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.867915 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:27:08.981650 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.981599 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbhdv\" (UniqueName: \"kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv\") pod \"a1477dff-c5b6-433e-86c1-870c59e49651\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " Jun 09 17:27:08.981890 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.981663 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume\") pod \"a1477dff-c5b6-433e-86c1-870c59e49651\" (UID: \"a1477dff-c5b6-433e-86c1-870c59e49651\") " Jun 09 17:27:08.982286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.982260 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1477dff-c5b6-433e-86c1-870c59e49651" (UID: "a1477dff-c5b6-433e-86c1-870c59e49651"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:27:08.983942 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:08.983906 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv" (OuterVolumeSpecName: "kube-api-access-rbhdv") pod "a1477dff-c5b6-433e-86c1-870c59e49651" (UID: "a1477dff-c5b6-433e-86c1-870c59e49651"). InnerVolumeSpecName "kube-api-access-rbhdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:27:09.083202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.083156 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbhdv\" (UniqueName: \"kubernetes.io/projected/a1477dff-c5b6-433e-86c1-870c59e49651-kube-api-access-rbhdv\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:27:09.083202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.083193 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1477dff-c5b6-433e-86c1-870c59e49651-extensions-socket-volume\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:27:09.800552 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.800513 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" Jun 09 17:27:09.800552 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.800540 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf" event={"ID":"a1477dff-c5b6-433e-86c1-870c59e49651","Type":"ContainerDied","Data":"75132667707e3e953b5d49223f9c1a62d42abe62b4bfad4a6464a286ecefaf64"} Jun 09 17:27:09.801117 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.800617 2561 scope.go:117] "RemoveContainer" containerID="cac11c3fdf112b5420887b278108d7c5bc2b20c5c84741c7da058067fccc653d" Jun 09 17:27:09.830398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.830361 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:27:09.838948 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:09.838910 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tggf"] Jun 09 17:27:10.334656 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:10.334609 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1477dff-c5b6-433e-86c1-870c59e49651" path="/var/lib/kubelet/pods/a1477dff-c5b6-433e-86c1-870c59e49651/volumes" Jun 09 17:27:24.833932 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.833892 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86"] Jun 09 17:27:24.835019 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.834983 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1477dff-c5b6-433e-86c1-870c59e49651" containerName="manager" Jun 09 17:27:24.835019 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.835018 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1477dff-c5b6-433e-86c1-870c59e49651" containerName="manager" Jun 09 17:27:24.835252 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.835098 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1477dff-c5b6-433e-86c1-870c59e49651" containerName="manager" Jun 09 17:27:24.839403 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.839375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.849719 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.849584 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dkcv5\"" Jun 09 17:27:24.853763 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.853727 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86"] Jun 09 17:27:24.934256 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934256 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701bd334-3b82-4d84-a563-bf093cf8d9e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934485 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6qp\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-kube-api-access-ml6qp\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934485 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934485 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934485 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:24.934673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:24.934585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035587 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035587 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701bd334-3b82-4d84-a563-bf093cf8d9e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.035930 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6qp\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-kube-api-access-ml6qp\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036218 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.035954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036218 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.036163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036218 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.036191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.036265 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.036332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.036777 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.036752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701bd334-3b82-4d84-a563-bf093cf8d9e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.038260 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.038235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.038858 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.038840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.044409 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.044374 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.044536 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.044465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6qp\" (UniqueName: \"kubernetes.io/projected/701bd334-3b82-4d84-a563-bf093cf8d9e1-kube-api-access-ml6qp\") pod \"maas-default-gateway-openshift-default-687ff6996-7mn86\" (UID: \"701bd334-3b82-4d84-a563-bf093cf8d9e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.162460 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.162417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:25.311833 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.311785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86"] Jun 09 17:27:25.314826 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:27:25.314778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701bd334_3b82_4d84_a563_bf093cf8d9e1.slice/crio-33ae4c6fc44cc2a0995359b26fb4426cade541ebe5aef4d40a298ca98bd3b24e WatchSource:0}: Error finding container 33ae4c6fc44cc2a0995359b26fb4426cade541ebe5aef4d40a298ca98bd3b24e: Status 404 returned error can't find the container with id 33ae4c6fc44cc2a0995359b26fb4426cade541ebe5aef4d40a298ca98bd3b24e Jun 09 17:27:25.317225 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.317181 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:27:25.317336 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.317269 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:27:25.317336 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.317299 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:27:25.883003 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.882967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" event={"ID":"701bd334-3b82-4d84-a563-bf093cf8d9e1","Type":"ContainerStarted","Data":"4f084286af2987edbacd93dbf622c81d5a6e8f3cf652fcb784a1cfeac041d097"} Jun 09 17:27:25.883454 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.883020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" event={"ID":"701bd334-3b82-4d84-a563-bf093cf8d9e1","Type":"ContainerStarted","Data":"33ae4c6fc44cc2a0995359b26fb4426cade541ebe5aef4d40a298ca98bd3b24e"} Jun 09 17:27:25.902224 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:25.902167 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" podStartSLOduration=1.902146429 podStartE2EDuration="1.902146429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:27:25.900215443 +0000 UTC m=+583.978363686" watchObservedRunningTime="2026-06-09 17:27:25.902146429 +0000 UTC m=+583.980294669" Jun 09 17:27:26.163159 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:26.163064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:26.168501 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:26.168474 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:26.887952 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:26.887915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:26.889249 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:26.889226 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:27:39.416662 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.416618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:27:39.420277 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.420248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:27:39.422684 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.422651 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zgdtz\"" Jun 09 17:27:39.426261 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.426226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:27:39.478562 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.478524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvtqs\" (UniqueName: \"kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs\") pod \"authorino-75d556bd77-crsnd\" (UID: \"e2ffc6cb-b238-492a-81b7-91089317bc44\") " pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:27:39.579239 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.579194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvtqs\" (UniqueName: \"kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs\") pod \"authorino-75d556bd77-crsnd\" (UID: \"e2ffc6cb-b238-492a-81b7-91089317bc44\") " pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:27:39.588117 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.588084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvtqs\" (UniqueName: \"kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs\") pod \"authorino-75d556bd77-crsnd\" (UID: \"e2ffc6cb-b238-492a-81b7-91089317bc44\") " pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:27:39.732847 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.732724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:27:39.876479 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.876443 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:27:39.879741 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:27:39.879707 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ffc6cb_b238_492a_81b7_91089317bc44.slice/crio-521583add42ac5154400398fecdb80836d50f1e7ce8a5eddb639becf9bc8f820 WatchSource:0}: Error finding container 521583add42ac5154400398fecdb80836d50f1e7ce8a5eddb639becf9bc8f820: Status 404 returned error can't find the container with id 521583add42ac5154400398fecdb80836d50f1e7ce8a5eddb639becf9bc8f820 Jun 09 17:27:39.956031 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:39.955994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-crsnd" event={"ID":"e2ffc6cb-b238-492a-81b7-91089317bc44","Type":"ContainerStarted","Data":"521583add42ac5154400398fecdb80836d50f1e7ce8a5eddb639becf9bc8f820"} Jun 09 17:27:43.378101 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.378070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:27:43.378977 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.378954 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:27:43.387098 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.387070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:27:43.387495 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.387472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:27:43.981320 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.981270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-crsnd" event={"ID":"e2ffc6cb-b238-492a-81b7-91089317bc44","Type":"ContainerStarted","Data":"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c"} Jun 09 17:27:43.994427 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:43.994360 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-crsnd" podStartSLOduration=1.457147698 podStartE2EDuration="4.99433946s" totalImagesPullingTime="3.537191762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:27:43.99394697 +0000 UTC m=+602.072095214" watchObservedRunningTime="2026-06-09 17:27:43.99433946 +0000 UTC m=+602.072487702" Jun 09 17:27:50.927500 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.927455 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55dbd95cf5-jv7bd"] Jun 09 17:27:50.931413 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.931377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.934248 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.934216 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 17:27:50.935170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935144 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 17:27:50.935357 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 17:27:50.935357 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gvnrv\"" Jun 09 17:27:50.935551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 17:27:50.935551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935162 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 17:27:50.935551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935241 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 17:27:50.935551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.935313 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 17:27:50.939503 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.939470 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 17:27:50.941645 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.941617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55dbd95cf5-jv7bd"] Jun 09 17:27:50.986692 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-oauth-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.986920 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986709 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-service-ca\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.986920 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tklmv\" (UniqueName: \"kubernetes.io/projected/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-kube-api-access-tklmv\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.987012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.987012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-oauth-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.987012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.986995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:50.987012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:50.987011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-trusted-ca-bundle\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.087538 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087490 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.087755 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-oauth-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.087755 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.087755 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-trusted-ca-bundle\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.087755 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-oauth-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088009 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-service-ca\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088009 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.087939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tklmv\" (UniqueName: \"kubernetes.io/projected/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-kube-api-access-tklmv\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088479 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.088443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088627 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.088543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-service-ca\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088697 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.088654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-oauth-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.088697 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.088671 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-trusted-ca-bundle\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.090760 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.090727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-oauth-config\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.090885 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.090849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-console-serving-cert\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.096879 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.096851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tklmv\" (UniqueName: \"kubernetes.io/projected/3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814-kube-api-access-tklmv\") pod \"console-55dbd95cf5-jv7bd\" (UID: \"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814\") " pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.245216 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.245113 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:27:51.396061 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:51.395985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55dbd95cf5-jv7bd"] Jun 09 17:27:51.398715 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:27:51.398679 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1dc0c9_25a7_4bf1_8aec_8c3c36ffc814.slice/crio-a430bd723b330f4df6379b02e16c1171a80e58bcbf4742e829032329b3028e07 WatchSource:0}: Error finding container a430bd723b330f4df6379b02e16c1171a80e58bcbf4742e829032329b3028e07: Status 404 returned error can't find the container with id a430bd723b330f4df6379b02e16c1171a80e58bcbf4742e829032329b3028e07 Jun 09 17:27:52.024380 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:52.024337 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55dbd95cf5-jv7bd" event={"ID":"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814","Type":"ContainerStarted","Data":"11b5bb8ab2b0ebead32822704150b5cd5e7d6affb48491df221cac1f70e03b68"} Jun 09 17:27:52.024880 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:52.024406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55dbd95cf5-jv7bd" event={"ID":"3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814","Type":"ContainerStarted","Data":"a430bd723b330f4df6379b02e16c1171a80e58bcbf4742e829032329b3028e07"} Jun 09 17:27:52.042756 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:27:52.042695 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55dbd95cf5-jv7bd" podStartSLOduration=2.042675383 podStartE2EDuration="2.042675383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:27:52.040993501 +0000 UTC m=+610.119141745" watchObservedRunningTime="2026-06-09 17:27:52.042675383 +0000 UTC m=+610.120823623" Jun 09 17:28:01.245795 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:01.245752 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:28:01.248223 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:01.245847 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:28:01.250762 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:01.250729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:28:02.081385 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:02.081357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55dbd95cf5-jv7bd" Jun 09 17:28:32.281588 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.281554 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:28:32.285142 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.285116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:32.287595 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.287567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-cnrqk\"" Jun 09 17:28:32.287774 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.287597 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 17:28:32.288435 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.288381 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 17:28:32.288435 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.288426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 17:28:32.292458 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.292424 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:28:32.375788 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.375701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p6kp\" (UniqueName: \"kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp\") pod \"maas-keycloak-0\" (UID: \"1c9fc6b5-a571-4cb0-a715-63d957603bee\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:32.476424 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.476393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6kp\" (UniqueName: \"kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp\") pod \"maas-keycloak-0\" (UID: \"1c9fc6b5-a571-4cb0-a715-63d957603bee\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:32.485412 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.485377 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p6kp\" (UniqueName: \"kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp\") pod \"maas-keycloak-0\" (UID: \"1c9fc6b5-a571-4cb0-a715-63d957603bee\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:32.597859 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.597724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:32.745616 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:32.745576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:28:32.749296 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:28:32.749251 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9fc6b5_a571_4cb0_a715_63d957603bee.slice/crio-a2a34b505c34bfba8444b67804458ce32f8f8b8fa2b3f35ab6a12ad39dff60d5 WatchSource:0}: Error finding container a2a34b505c34bfba8444b67804458ce32f8f8b8fa2b3f35ab6a12ad39dff60d5: Status 404 returned error can't find the container with id a2a34b505c34bfba8444b67804458ce32f8f8b8fa2b3f35ab6a12ad39dff60d5 Jun 09 17:28:33.238589 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:33.238549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c9fc6b5-a571-4cb0-a715-63d957603bee","Type":"ContainerStarted","Data":"a2a34b505c34bfba8444b67804458ce32f8f8b8fa2b3f35ab6a12ad39dff60d5"} Jun 09 17:28:39.281734 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:39.281611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c9fc6b5-a571-4cb0-a715-63d957603bee","Type":"ContainerStarted","Data":"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4"} Jun 09 17:28:39.301270 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:39.301194 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.138394817 podStartE2EDuration="7.301165213s" totalImagesPullingTime="6.162770396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:28:39.300253597 +0000 UTC m=+657.378401839" watchObservedRunningTime="2026-06-09 17:28:39.301165213 +0000 UTC m=+657.379313461" Jun 09 17:28:39.598228 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:39.598105 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:39.600275 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:39.600232 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:40.599425 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:40.599363 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:41.598737 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:41.598683 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:42.598407 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:42.598361 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:42.599058 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:42.598776 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:43.598471 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:43.598418 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:44.599174 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:44.599105 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:45.598510 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:45.598455 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:46.598502 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:46.598450 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:47.599091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:47.599035 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:48.599099 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:48.599045 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:49.599191 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:49.599152 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:50.598656 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:50.598593 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:51.598756 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:51.598698 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:52.599213 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:52.599160 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 09 17:28:53.698392 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:53.698355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 17:28:53.716977 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:28:53.716856 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:29:03.705505 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:03.705464 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:29:06.974192 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:06.974146 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:29:06.974663 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:06.974330 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-crsnd" podUID="e2ffc6cb-b238-492a-81b7-91089317bc44" containerName="authorino" containerID="cri-o://76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c" gracePeriod=30 Jun 09 17:29:07.235837 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.235741 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:29:07.360822 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.360766 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvtqs\" (UniqueName: \"kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs\") pod \"e2ffc6cb-b238-492a-81b7-91089317bc44\" (UID: \"e2ffc6cb-b238-492a-81b7-91089317bc44\") " Jun 09 17:29:07.362991 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.362960 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs" (OuterVolumeSpecName: "kube-api-access-pvtqs") pod "e2ffc6cb-b238-492a-81b7-91089317bc44" (UID: "e2ffc6cb-b238-492a-81b7-91089317bc44"). InnerVolumeSpecName "kube-api-access-pvtqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:29:07.461882 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.461836 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvtqs\" (UniqueName: \"kubernetes.io/projected/e2ffc6cb-b238-492a-81b7-91089317bc44-kube-api-access-pvtqs\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:29:07.478178 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.478138 2561 generic.go:356] "Generic (PLEG): container finished" podID="e2ffc6cb-b238-492a-81b7-91089317bc44" containerID="76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c" exitCode=0 Jun 09 17:29:07.478358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.478184 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-crsnd" Jun 09 17:29:07.478358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.478219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-crsnd" event={"ID":"e2ffc6cb-b238-492a-81b7-91089317bc44","Type":"ContainerDied","Data":"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c"} Jun 09 17:29:07.478358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.478268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-crsnd" event={"ID":"e2ffc6cb-b238-492a-81b7-91089317bc44","Type":"ContainerDied","Data":"521583add42ac5154400398fecdb80836d50f1e7ce8a5eddb639becf9bc8f820"} Jun 09 17:29:07.478358 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.478289 2561 scope.go:117] "RemoveContainer" containerID="76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c" Jun 09 17:29:07.487651 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.487630 2561 scope.go:117] "RemoveContainer" containerID="76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c" Jun 09 17:29:07.488008 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:07.487989 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c\": container with ID starting with 76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c not found: ID does not exist" containerID="76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c" Jun 09 17:29:07.488084 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.488022 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c"} err="failed to get container status \"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c\": rpc error: code = NotFound desc = could not find container \"76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c\": container with ID starting with 76593d7442881c0020a2ae8d721ad07b97dad5bffedd43836e336d96986e055c not found: ID does not exist" Jun 09 17:29:07.499756 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.499714 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:29:07.503301 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:07.503270 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-crsnd"] Jun 09 17:29:08.330153 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:08.330112 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ffc6cb-b238-492a-81b7-91089317bc44" path="/var/lib/kubelet/pods/e2ffc6cb-b238-492a-81b7-91089317bc44/volumes" Jun 09 17:29:10.488336 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.488292 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:10.489012 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.488987 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ffc6cb-b238-492a-81b7-91089317bc44" containerName="authorino" Jun 09 17:29:10.489118 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.489015 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ffc6cb-b238-492a-81b7-91089317bc44" containerName="authorino" Jun 09 17:29:10.489173 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.489122 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ffc6cb-b238-492a-81b7-91089317bc44" containerName="authorino" Jun 09 17:29:10.494073 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.494043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.496630 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.496589 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 17:29:10.496630 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.496614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-67k4s\"" Jun 09 17:29:10.497406 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.497388 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 17:29:10.503713 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.503665 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:10.592753 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.592711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.592975 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.592856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8jf\" (UniqueName: \"kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.661921 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.661884 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66d4c94557-kvjc9"] Jun 09 17:29:10.665417 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.665385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.674880 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.674846 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d4c94557-kvjc9"] Jun 09 17:29:10.693375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.693336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.693606 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.693439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8jf\" (UniqueName: \"kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.693606 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:10.693517 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 17:29:10.693706 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:10.693608 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert podName:d19dafb6-e5ef-41e7-8ad6-c24d345e29aa nodeName:}" failed. No retries permitted until 2026-06-09 17:29:11.193589229 +0000 UTC m=+689.271737447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert") pod "maas-controller-54d48c7b95-zm5gg" (UID: "d19dafb6-e5ef-41e7-8ad6-c24d345e29aa") : secret "maas-controller-webhook-cert" not found Jun 09 17:29:10.702218 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.702186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8jf\" (UniqueName: \"kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:10.794507 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.794406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfed52b-d085-4adf-95d6-5d1b85401eaf-webhook-cert\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.794673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.794557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpcqf\" (UniqueName: \"kubernetes.io/projected/5cfed52b-d085-4adf-95d6-5d1b85401eaf-kube-api-access-dpcqf\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.895197 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.895154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpcqf\" (UniqueName: \"kubernetes.io/projected/5cfed52b-d085-4adf-95d6-5d1b85401eaf-kube-api-access-dpcqf\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.895421 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.895273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfed52b-d085-4adf-95d6-5d1b85401eaf-webhook-cert\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.898024 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.897992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfed52b-d085-4adf-95d6-5d1b85401eaf-webhook-cert\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.904595 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.904553 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpcqf\" (UniqueName: \"kubernetes.io/projected/5cfed52b-d085-4adf-95d6-5d1b85401eaf-kube-api-access-dpcqf\") pod \"maas-controller-66d4c94557-kvjc9\" (UID: \"5cfed52b-d085-4adf-95d6-5d1b85401eaf\") " pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:10.977451 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:10.977395 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:11.143464 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.143434 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d4c94557-kvjc9"] Jun 09 17:29:11.145862 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:29:11.145790 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfed52b_d085_4adf_95d6_5d1b85401eaf.slice/crio-d07063a254b6756d6dcc3e18dca9705e734c9adc10aafae8f09a824be1c3c32b WatchSource:0}: Error finding container d07063a254b6756d6dcc3e18dca9705e734c9adc10aafae8f09a824be1c3c32b: Status 404 returned error can't find the container with id d07063a254b6756d6dcc3e18dca9705e734c9adc10aafae8f09a824be1c3c32b Jun 09 17:29:11.197531 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.197467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:11.200080 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.200050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") pod \"maas-controller-54d48c7b95-zm5gg\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:11.412565 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.412516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:11.501634 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.501598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d4c94557-kvjc9" event={"ID":"5cfed52b-d085-4adf-95d6-5d1b85401eaf","Type":"ContainerStarted","Data":"d07063a254b6756d6dcc3e18dca9705e734c9adc10aafae8f09a824be1c3c32b"} Jun 09 17:29:11.562889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:11.562864 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:11.566221 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:29:11.566189 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19dafb6_e5ef_41e7_8ad6_c24d345e29aa.slice/crio-1a54a76a2ec69b8ce00410a7993746e7f5de46877e470a6e18ecc195f857d11e WatchSource:0}: Error finding container 1a54a76a2ec69b8ce00410a7993746e7f5de46877e470a6e18ecc195f857d11e: Status 404 returned error can't find the container with id 1a54a76a2ec69b8ce00410a7993746e7f5de46877e470a6e18ecc195f857d11e Jun 09 17:29:12.512238 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:12.512179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" event={"ID":"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa","Type":"ContainerStarted","Data":"1a54a76a2ec69b8ce00410a7993746e7f5de46877e470a6e18ecc195f857d11e"} Jun 09 17:29:14.526854 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.526795 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d4c94557-kvjc9" event={"ID":"5cfed52b-d085-4adf-95d6-5d1b85401eaf","Type":"ContainerStarted","Data":"15ec57fb849d8a21094eb4c005b4ab652c722d7169eacb083e871ddb99579763"} Jun 09 17:29:14.527365 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.526886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:14.528623 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.528597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" event={"ID":"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa","Type":"ContainerStarted","Data":"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94"} Jun 09 17:29:14.528786 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.528772 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:14.548351 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.548288 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66d4c94557-kvjc9" podStartSLOduration=1.710267279 podStartE2EDuration="4.5482671s" totalImagesPullingTime="2.837999821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:29:14.546601999 +0000 UTC m=+692.624750241" watchObservedRunningTime="2026-06-09 17:29:14.5482671 +0000 UTC m=+692.626415373" Jun 09 17:29:14.563074 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:14.563008 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" podStartSLOduration=2.1315626229999998 podStartE2EDuration="4.562986157s" totalImagesPullingTime="2.431423534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:29:14.562448242 +0000 UTC m=+692.640596482" watchObservedRunningTime="2026-06-09 17:29:14.562986157 +0000 UTC m=+692.641134414" Jun 09 17:29:25.539844 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.539720 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66d4c94557-kvjc9" Jun 09 17:29:25.539844 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.539826 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:25.615765 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.615714 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:25.616285 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.616245 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" podUID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" containerName="manager" containerID="cri-o://ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94" gracePeriod=30 Jun 09 17:29:25.872661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.872625 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:25.956984 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.956939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") pod \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " Jun 09 17:29:25.957188 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.957043 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb8jf\" (UniqueName: \"kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf\") pod \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\" (UID: \"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa\") " Jun 09 17:29:25.959411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.959370 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" (UID: "d19dafb6-e5ef-41e7-8ad6-c24d345e29aa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:29:25.959411 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:25.959385 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf" (OuterVolumeSpecName: "kube-api-access-gb8jf") pod "d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" (UID: "d19dafb6-e5ef-41e7-8ad6-c24d345e29aa"). InnerVolumeSpecName "kube-api-access-gb8jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:29:26.058286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.058248 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-webhook-cert\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:29:26.058286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.058278 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb8jf\" (UniqueName: \"kubernetes.io/projected/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa-kube-api-access-gb8jf\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:29:26.594038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.593942 2561 generic.go:356] "Generic (PLEG): container finished" podID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" containerID="ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94" exitCode=0 Jun 09 17:29:26.594038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.593998 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" Jun 09 17:29:26.594038 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.594023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" event={"ID":"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa","Type":"ContainerDied","Data":"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94"} Jun 09 17:29:26.594606 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.594085 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54d48c7b95-zm5gg" event={"ID":"d19dafb6-e5ef-41e7-8ad6-c24d345e29aa","Type":"ContainerDied","Data":"1a54a76a2ec69b8ce00410a7993746e7f5de46877e470a6e18ecc195f857d11e"} Jun 09 17:29:26.594606 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.594117 2561 scope.go:117] "RemoveContainer" containerID="ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94" Jun 09 17:29:26.603900 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.603858 2561 scope.go:117] "RemoveContainer" containerID="ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94" Jun 09 17:29:26.604309 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:26.604282 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94\": container with ID starting with ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94 not found: ID does not exist" containerID="ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94" Jun 09 17:29:26.604391 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.604323 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94"} err="failed to get container status \"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94\": rpc error: code = NotFound desc = could not find container \"ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94\": container with ID starting with ebf64db64fe18d8bfd943d8bdf5e5985eab9aba7b77b943e4cdba3f86e106e94 not found: ID does not exist" Jun 09 17:29:26.609527 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.609442 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:26.611730 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:26.611693 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54d48c7b95-zm5gg"] Jun 09 17:29:28.330285 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:28.330231 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" path="/var/lib/kubelet/pods/d19dafb6-e5ef-41e7-8ad6-c24d345e29aa/volumes" Jun 09 17:29:45.450352 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.450311 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-644d88bdf4-hcsls"] Jun 09 17:29:45.450894 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.450768 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" containerName="manager" Jun 09 17:29:45.450894 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.450784 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" containerName="manager" Jun 09 17:29:45.450894 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.450886 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d19dafb6-e5ef-41e7-8ad6-c24d345e29aa" containerName="manager" Jun 09 17:29:45.457202 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.457172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.459458 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.459430 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 17:29:45.464091 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.464059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-644d88bdf4-hcsls"] Jun 09 17:29:45.552342 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.552296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45fnl\" (UniqueName: \"kubernetes.io/projected/051e92bd-6d92-496e-8508-34de07352e4a-kube-api-access-45fnl\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.552542 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.552432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.653679 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.653637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.653914 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.653738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45fnl\" (UniqueName: \"kubernetes.io/projected/051e92bd-6d92-496e-8508-34de07352e4a-kube-api-access-45fnl\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.653914 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:45.653828 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 17:29:45.654034 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:45.653918 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls podName:051e92bd-6d92-496e-8508-34de07352e4a nodeName:}" failed. No retries permitted until 2026-06-09 17:29:46.153894119 +0000 UTC m=+724.232042359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls") pod "maas-api-644d88bdf4-hcsls" (UID: "051e92bd-6d92-496e-8508-34de07352e4a") : secret "maas-api-serving-cert" not found Jun 09 17:29:45.662487 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.662443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45fnl\" (UniqueName: \"kubernetes.io/projected/051e92bd-6d92-496e-8508-34de07352e4a-kube-api-access-45fnl\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:45.944668 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.944623 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-qm9z2"] Jun 09 17:29:45.948465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.948441 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:45.950709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.950672 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 17:29:45.950900 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.950754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xcgwz\"" Jun 09 17:29:45.957871 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.957795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-qm9z2"] Jun 09 17:29:45.978043 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.977993 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-zmlwp"] Jun 09 17:29:45.982959 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.982924 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:45.986907 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:45.986875 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-zmlwp"] Jun 09 17:29:46.057169 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.057115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dcd\" (UniqueName: \"kubernetes.io/projected/4a25f4ea-eaf5-4779-8381-300f585c9d66-kube-api-access-n8dcd\") pod \"payload-processing-7c6c859784-zmlwp\" (UID: \"4a25f4ea-eaf5-4779-8381-300f585c9d66\") " pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:46.057364 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.057207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftw8m\" (UniqueName: \"kubernetes.io/projected/dd4e4c5f-79ee-4ca9-bac6-adacd3744d37-kube-api-access-ftw8m\") pod \"payload-pre-processing-67d7689b65-qm9z2\" (UID: \"dd4e4c5f-79ee-4ca9-bac6-adacd3744d37\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:46.158077 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.158037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:46.158282 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.158107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dcd\" (UniqueName: \"kubernetes.io/projected/4a25f4ea-eaf5-4779-8381-300f585c9d66-kube-api-access-n8dcd\") pod \"payload-processing-7c6c859784-zmlwp\" (UID: \"4a25f4ea-eaf5-4779-8381-300f585c9d66\") " pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:46.158282 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.158143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftw8m\" (UniqueName: \"kubernetes.io/projected/dd4e4c5f-79ee-4ca9-bac6-adacd3744d37-kube-api-access-ftw8m\") pod \"payload-pre-processing-67d7689b65-qm9z2\" (UID: \"dd4e4c5f-79ee-4ca9-bac6-adacd3744d37\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:46.160974 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.160948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051e92bd-6d92-496e-8508-34de07352e4a-maas-api-tls\") pod \"maas-api-644d88bdf4-hcsls\" (UID: \"051e92bd-6d92-496e-8508-34de07352e4a\") " pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:46.166335 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.166288 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftw8m\" (UniqueName: \"kubernetes.io/projected/dd4e4c5f-79ee-4ca9-bac6-adacd3744d37-kube-api-access-ftw8m\") pod \"payload-pre-processing-67d7689b65-qm9z2\" (UID: \"dd4e4c5f-79ee-4ca9-bac6-adacd3744d37\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:46.166477 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.166289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dcd\" (UniqueName: \"kubernetes.io/projected/4a25f4ea-eaf5-4779-8381-300f585c9d66-kube-api-access-n8dcd\") pod \"payload-processing-7c6c859784-zmlwp\" (UID: \"4a25f4ea-eaf5-4779-8381-300f585c9d66\") " pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:46.262098 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.261998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:46.297563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.297510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:46.370194 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.370164 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:46.440530 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.440476 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-qm9z2"] Jun 09 17:29:46.450579 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.449034 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:29:46.477162 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.477126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-zmlwp"] Jun 09 17:29:46.479523 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:29:46.479489 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a25f4ea_eaf5_4779_8381_300f585c9d66.slice/crio-4d444bd3feb7d79c2867c4982b8e07083c7a0d650c7203de7c9c4960fddb22d2 WatchSource:0}: Error finding container 4d444bd3feb7d79c2867c4982b8e07083c7a0d650c7203de7c9c4960fddb22d2: Status 404 returned error can't find the container with id 4d444bd3feb7d79c2867c4982b8e07083c7a0d650c7203de7c9c4960fddb22d2 Jun 09 17:29:46.555271 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.550398 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-644d88bdf4-hcsls"] Jun 09 17:29:46.556604 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:29:46.556573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051e92bd_6d92_496e_8508_34de07352e4a.slice/crio-e241f0ebcbf23b480035c9a0d5d98f20994da04859f635d7d7dd3049f435cdf2 WatchSource:0}: Error finding container e241f0ebcbf23b480035c9a0d5d98f20994da04859f635d7d7dd3049f435cdf2: Status 404 returned error can't find the container with id e241f0ebcbf23b480035c9a0d5d98f20994da04859f635d7d7dd3049f435cdf2 Jun 09 17:29:46.707316 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.707269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" event={"ID":"dd4e4c5f-79ee-4ca9-bac6-adacd3744d37","Type":"ContainerStarted","Data":"9baddb1f81ad90cdc30d21ccf14c6a32987bbc5c6f7d7a70d24cd9187510fa32"} Jun 09 17:29:46.708582 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.708546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-644d88bdf4-hcsls" event={"ID":"051e92bd-6d92-496e-8508-34de07352e4a","Type":"ContainerStarted","Data":"e241f0ebcbf23b480035c9a0d5d98f20994da04859f635d7d7dd3049f435cdf2"} Jun 09 17:29:46.709661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:46.709633 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerStarted","Data":"4d444bd3feb7d79c2867c4982b8e07083c7a0d650c7203de7c9c4960fddb22d2"} Jun 09 17:29:49.729646 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.729589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" event={"ID":"dd4e4c5f-79ee-4ca9-bac6-adacd3744d37","Type":"ContainerStarted","Data":"668e039d7116d8b4f4c1fb64a5e2c45b00c64552217721ca62c83d566c8c52d9"} Jun 09 17:29:49.730177 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.729692 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:29:49.731155 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.731128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-644d88bdf4-hcsls" event={"ID":"051e92bd-6d92-496e-8508-34de07352e4a","Type":"ContainerStarted","Data":"05c6a2fdf40035b70731e08a2b441068c282306c7edc6bc969a045703c224099"} Jun 09 17:29:49.731274 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.731212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:49.732629 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.732607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerStarted","Data":"073bed4045bad107f2fda205f72d6af8022e099be3bd078adcd5d2c1ba709aac"} Jun 09 17:29:49.732751 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.732733 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:29:49.747026 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.746936 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" podStartSLOduration=2.5648069209999997 podStartE2EDuration="4.746916357s" totalImagesPullingTime="2.182109436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:29:49.744320484 +0000 UTC m=+727.822468719" watchObservedRunningTime="2026-06-09 17:29:49.746916357 +0000 UTC m=+727.825064589" Jun 09 17:29:49.760242 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.760180 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podStartSLOduration=2.6086846919999997 podStartE2EDuration="4.760157818s" totalImagesPullingTime="2.151473126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:29:49.757950678 +0000 UTC m=+727.836098936" watchObservedRunningTime="2026-06-09 17:29:49.760157818 +0000 UTC m=+727.838306061" Jun 09 17:29:49.776018 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:49.775939 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-644d88bdf4-hcsls" podStartSLOduration=2.702387368 podStartE2EDuration="4.77591524s" totalImagesPullingTime="2.073527872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:29:49.774095623 +0000 UTC m=+727.852243865" watchObservedRunningTime="2026-06-09 17:29:49.77591524 +0000 UTC m=+727.854063485" Jun 09 17:29:54.767048 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.766951 2561 generic.go:356] "Generic (PLEG): container finished" podID="701bd334-3b82-4d84-a563-bf093cf8d9e1" containerID="4f084286af2987edbacd93dbf622c81d5a6e8f3cf652fcb784a1cfeac041d097" exitCode=0 Jun 09 17:29:54.767953 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.767241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" event={"ID":"701bd334-3b82-4d84-a563-bf093cf8d9e1","Type":"ContainerDied","Data":"4f084286af2987edbacd93dbf622c81d5a6e8f3cf652fcb784a1cfeac041d097"} Jun 09 17:29:54.767953 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.767847 2561 scope.go:117] "RemoveContainer" containerID="4f084286af2987edbacd93dbf622c81d5a6e8f3cf652fcb784a1cfeac041d097" Jun 09 17:29:54.769045 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.769012 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:29:54.769170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.769102 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:29:54.769170 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:54.769153 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 17:29:55.743856 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:55.743824 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-644d88bdf4-hcsls" Jun 09 17:29:55.785875 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:55.784852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" event={"ID":"701bd334-3b82-4d84-a563-bf093cf8d9e1","Type":"ContainerStarted","Data":"259031440c68dac0538dcde47f8a5f1dc63ee6befec40ebf8cd2bf46b34d288e"} Jun 09 17:29:56.162855 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:56.162787 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:29:56.164212 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:56.164177 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mn86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jun 09 17:29:56.164375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:56.164248 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" podUID="701bd334-3b82-4d84-a563-bf093cf8d9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jun 09 17:29:56.888683 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:56.888635 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:29:57.163367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:57.163276 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mn86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jun 09 17:29:57.163367 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:57.163340 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" podUID="701bd334-3b82-4d84-a563-bf093cf8d9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jun 09 17:29:57.562366 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:57.562261 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:29:57.562538 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:57.562483 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" containerID="cri-o://0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4" gracePeriod=30 Jun 09 17:29:58.163225 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:58.163183 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mn86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jun 09 17:29:58.163730 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:58.163258 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" podUID="701bd334-3b82-4d84-a563-bf093cf8d9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jun 09 17:29:59.163252 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.163215 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mn86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jun 09 17:29:59.163642 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.163278 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" podUID="701bd334-3b82-4d84-a563-bf093cf8d9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jun 09 17:29:59.267596 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.267558 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:29:59.320561 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.320464 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p6kp\" (UniqueName: \"kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp\") pod \"1c9fc6b5-a571-4cb0-a715-63d957603bee\" (UID: \"1c9fc6b5-a571-4cb0-a715-63d957603bee\") " Jun 09 17:29:59.322937 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.322889 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp" (OuterVolumeSpecName: "kube-api-access-7p6kp") pod "1c9fc6b5-a571-4cb0-a715-63d957603bee" (UID: "1c9fc6b5-a571-4cb0-a715-63d957603bee"). InnerVolumeSpecName "kube-api-access-7p6kp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:29:59.421722 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.421678 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p6kp\" (UniqueName: \"kubernetes.io/projected/1c9fc6b5-a571-4cb0-a715-63d957603bee-kube-api-access-7p6kp\") on node \"ip-10-0-142-117.ec2.internal\" DevicePath \"\"" Jun 09 17:29:59.810246 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.810208 2561 generic.go:356] "Generic (PLEG): container finished" podID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerID="0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4" exitCode=143 Jun 09 17:29:59.810414 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.810260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c9fc6b5-a571-4cb0-a715-63d957603bee","Type":"ContainerDied","Data":"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4"} Jun 09 17:29:59.810414 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.810300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c9fc6b5-a571-4cb0-a715-63d957603bee","Type":"ContainerDied","Data":"a2a34b505c34bfba8444b67804458ce32f8f8b8fa2b3f35ab6a12ad39dff60d5"} Jun 09 17:29:59.810414 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.810327 2561 scope.go:117] "RemoveContainer" containerID="0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4" Jun 09 17:29:59.810414 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.810259 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:29:59.821166 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.821144 2561 scope.go:117] "RemoveContainer" containerID="0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4" Jun 09 17:29:59.821526 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:29:59.821498 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4\": container with ID starting with 0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4 not found: ID does not exist" containerID="0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4" Jun 09 17:29:59.821591 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.821545 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4"} err="failed to get container status \"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4\": rpc error: code = NotFound desc = could not find container \"0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4\": container with ID starting with 0f19296b09805c2cc5fec2dc873f54c09cd03d75ffc8c58eddbea0da099f89c4 not found: ID does not exist" Jun 09 17:29:59.831785 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.831748 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:29:59.837415 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.837379 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:29:59.857614 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.857572 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:29:59.858140 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.858116 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" Jun 09 17:29:59.858140 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.858143 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" Jun 09 17:29:59.858349 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.858277 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" containerName="keycloak" Jun 09 17:29:59.863001 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.862973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:29:59.865399 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.865375 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-cnrqk\"" Jun 09 17:29:59.865399 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.865389 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 17:29:59.865672 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.865653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 17:29:59.865744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.865671 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 17:29:59.865744 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.865692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 17:29:59.881971 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.881930 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:29:59.926667 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.926615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5sfd\" (UniqueName: \"kubernetes.io/projected/17a782fc-3cc3-467c-b265-e7ae1a940f0f-kube-api-access-h5sfd\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:29:59.926902 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:29:59.926777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/17a782fc-3cc3-467c-b265-e7ae1a940f0f-test-realms\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.027994 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.027945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5sfd\" (UniqueName: \"kubernetes.io/projected/17a782fc-3cc3-467c-b265-e7ae1a940f0f-kube-api-access-h5sfd\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.028197 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.028141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/17a782fc-3cc3-467c-b265-e7ae1a940f0f-test-realms\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.028908 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.028879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/17a782fc-3cc3-467c-b265-e7ae1a940f0f-test-realms\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.037079 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.037043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5sfd\" (UniqueName: \"kubernetes.io/projected/17a782fc-3cc3-467c-b265-e7ae1a940f0f-kube-api-access-h5sfd\") pod \"maas-keycloak-0\" (UID: \"17a782fc-3cc3-467c-b265-e7ae1a940f0f\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.166859 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.166822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:30:00.168011 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.167991 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mn86" Jun 09 17:30:00.183602 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.183564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:00.331258 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.331218 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c9fc6b5-a571-4cb0-a715-63d957603bee" path="/var/lib/kubelet/pods/1c9fc6b5-a571-4cb0-a715-63d957603bee/volumes" Jun 09 17:30:00.357458 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.357425 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:30:00.359712 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:30:00.359678 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a782fc_3cc3_467c_b265_e7ae1a940f0f.slice/crio-73724eee40cfe55a082124f421075462835aa1e50dcac1a5bce2f2700d8f66d2 WatchSource:0}: Error finding container 73724eee40cfe55a082124f421075462835aa1e50dcac1a5bce2f2700d8f66d2: Status 404 returned error can't find the container with id 73724eee40cfe55a082124f421075462835aa1e50dcac1a5bce2f2700d8f66d2 Jun 09 17:30:00.740025 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.739992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:30:00.740536 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.740511 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-qm9z2" Jun 09 17:30:00.817545 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:00.817499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17a782fc-3cc3-467c-b265-e7ae1a940f0f","Type":"ContainerStarted","Data":"73724eee40cfe55a082124f421075462835aa1e50dcac1a5bce2f2700d8f66d2"} Jun 09 17:30:01.827363 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:01.827319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17a782fc-3cc3-467c-b265-e7ae1a940f0f","Type":"ContainerStarted","Data":"ff3c4422560df1fbb68235819b7a11c7a12c8e4a7c9b2793526cb93f876ee748"} Jun 09 17:30:01.846502 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:01.846432 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.436471805 podStartE2EDuration="2.846412535s" totalImagesPullingTime="409.94073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:30:01.845729041 +0000 UTC m=+739.923877322" watchObservedRunningTime="2026-06-09 17:30:01.846412535 +0000 UTC m=+739.924560815" Jun 09 17:30:02.184299 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:02.184254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:02.186706 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:02.186648 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:03.184829 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:03.184765 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:04.184240 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:04.184184 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:05.184606 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:05.184554 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:06.184783 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:06.184728 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:07.184303 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:07.184246 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:08.184928 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:08.184874 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:09.184886 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:09.184832 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:10.184305 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:10.184260 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:10.184724 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:10.184553 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:11.185009 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:11.184935 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:12.185005 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:12.184949 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:13.185074 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:13.185021 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:14.184537 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:14.184476 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:15.185114 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:15.185065 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 09 17:30:16.321902 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:16.321836 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 17:30:16.346391 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:16.346342 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:30:26.328109 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:26.328050 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="17a782fc-3cc3-467c-b265-e7ae1a940f0f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:30:36.329487 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:30:36.329455 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:31:37.788424 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.788382 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2"] Jun 09 17:31:37.792967 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.792946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.796368 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.796341 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 17:31:37.796368 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.796362 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 17:31:37.796549 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.796428 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b7vkg\"" Jun 09 17:31:37.796549 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.796366 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 17:31:37.808868 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.808840 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2"] Jun 09 17:31:37.862227 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.862431 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.862431 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cz2\" (UniqueName: \"kubernetes.io/projected/8e475562-9d55-4329-9e1c-ae9563978c4d-kube-api-access-48cz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.862551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.862551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e475562-9d55-4329-9e1c-ae9563978c4d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.862551 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.862516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963376 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cz2\" (UniqueName: \"kubernetes.io/projected/8e475562-9d55-4329-9e1c-ae9563978c4d-kube-api-access-48cz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963583 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e475562-9d55-4329-9e1c-ae9563978c4d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963819 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.963889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.964150 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.963904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.966034 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.966006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e475562-9d55-4329-9e1c-ae9563978c4d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.966242 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.966226 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e475562-9d55-4329-9e1c-ae9563978c4d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:37.972055 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:37.972027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cz2\" (UniqueName: \"kubernetes.io/projected/8e475562-9d55-4329-9e1c-ae9563978c4d-kube-api-access-48cz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2\" (UID: \"8e475562-9d55-4329-9e1c-ae9563978c4d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:38.114586 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:38.114487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:38.252046 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:38.252020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2"] Jun 09 17:31:38.254206 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:31:38.254175 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e475562_9d55_4329_9e1c_ae9563978c4d.slice/crio-c725f7a7d64e96c67acf7d7362ee46091732ba53ae54d43fc63a47964a130755 WatchSource:0}: Error finding container c725f7a7d64e96c67acf7d7362ee46091732ba53ae54d43fc63a47964a130755: Status 404 returned error can't find the container with id c725f7a7d64e96c67acf7d7362ee46091732ba53ae54d43fc63a47964a130755 Jun 09 17:31:38.387137 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:38.387101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" event={"ID":"8e475562-9d55-4329-9e1c-ae9563978c4d","Type":"ContainerStarted","Data":"c725f7a7d64e96c67acf7d7362ee46091732ba53ae54d43fc63a47964a130755"} Jun 09 17:31:42.413230 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:42.413189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" event={"ID":"8e475562-9d55-4329-9e1c-ae9563978c4d","Type":"ContainerStarted","Data":"59aa151b2ca6c8c7357362aeaf66ad09a133e51f2edbaa2b7808777069a33f62"} Jun 09 17:31:45.430896 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:45.430858 2561 generic.go:356] "Generic (PLEG): container finished" podID="8e475562-9d55-4329-9e1c-ae9563978c4d" containerID="59aa151b2ca6c8c7357362aeaf66ad09a133e51f2edbaa2b7808777069a33f62" exitCode=0 Jun 09 17:31:45.431301 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:45.430931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" event={"ID":"8e475562-9d55-4329-9e1c-ae9563978c4d","Type":"ContainerDied","Data":"59aa151b2ca6c8c7357362aeaf66ad09a133e51f2edbaa2b7808777069a33f62"} Jun 09 17:31:47.447439 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:47.447404 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" event={"ID":"8e475562-9d55-4329-9e1c-ae9563978c4d","Type":"ContainerStarted","Data":"95d2426834e910ab313c84963aa033e1903c9a82e28628ec6e6f9447e94fe47e"} Jun 09 17:31:47.465094 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:47.465043 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" podStartSLOduration=2.899455693 podStartE2EDuration="10.465025718s" totalImagesPullingTime="5.275780239s" totalInitContainerRuntime="2.289789786s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:31:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:31:47.463794039 +0000 UTC m=+845.541942282" watchObservedRunningTime="2026-06-09 17:31:47.465025718 +0000 UTC m=+845.543173981" Jun 09 17:31:48.115158 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:48.115111 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:48.115442 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:48.115190 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:48.127949 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:48.127908 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:48.464069 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:48.464038 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2" Jun 09 17:31:49.459220 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:49.459187 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a25f4ea-eaf5-4779-8381-300f585c9d66" containerID="073bed4045bad107f2fda205f72d6af8022e099be3bd078adcd5d2c1ba709aac" exitCode=1 Jun 09 17:31:49.459428 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:49.459260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerDied","Data":"073bed4045bad107f2fda205f72d6af8022e099be3bd078adcd5d2c1ba709aac"} Jun 09 17:31:49.459757 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:49.459741 2561 scope.go:117] "RemoveContainer" containerID="073bed4045bad107f2fda205f72d6af8022e099be3bd078adcd5d2c1ba709aac" Jun 09 17:31:50.266302 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.266261 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn"] Jun 09 17:31:50.270708 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.270665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.273139 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.273108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 17:31:50.280985 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.280942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn"] Jun 09 17:31:50.394199 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.394393 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.394393 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6tf\" (UniqueName: \"kubernetes.io/projected/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kube-api-access-zm6tf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.394393 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a0e9f9-cca0-4ef7-b500-38c14c51f036-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.394661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.394661 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.394503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.466995 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.466958 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerStarted","Data":"085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424"} Jun 09 17:31:50.467306 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.467278 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:31:50.495891 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.495848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6tf\" (UniqueName: \"kubernetes.io/projected/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kube-api-access-zm6tf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.495891 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.495895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a0e9f9-cca0-4ef7-b500-38c14c51f036-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.495948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.495972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.496048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.496102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496512 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.496479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496651 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.496527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.496651 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.496578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.498391 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.498358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a0e9f9-cca0-4ef7-b500-38c14c51f036-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.498641 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.498624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a0e9f9-cca0-4ef7-b500-38c14c51f036-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.504520 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.504486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6tf\" (UniqueName: \"kubernetes.io/projected/35a0e9f9-cca0-4ef7-b500-38c14c51f036-kube-api-access-zm6tf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn\" (UID: \"35a0e9f9-cca0-4ef7-b500-38c14c51f036\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.587482 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.587376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:31:50.739545 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:50.739518 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn"] Jun 09 17:31:50.742453 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:31:50.742417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a0e9f9_cca0_4ef7_b500_38c14c51f036.slice/crio-50832f5feff8db7d472a9dbbfc79d2306261c2760dee5d8146eea3fdc4f7e28b WatchSource:0}: Error finding container 50832f5feff8db7d472a9dbbfc79d2306261c2760dee5d8146eea3fdc4f7e28b: Status 404 returned error can't find the container with id 50832f5feff8db7d472a9dbbfc79d2306261c2760dee5d8146eea3fdc4f7e28b Jun 09 17:31:51.475496 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:51.475450 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" event={"ID":"35a0e9f9-cca0-4ef7-b500-38c14c51f036","Type":"ContainerStarted","Data":"daee1f53e94b155d890d1c647d6d848ea08da650033c9da19ae7b038f564ea29"} Jun 09 17:31:51.476007 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:51.475518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" event={"ID":"35a0e9f9-cca0-4ef7-b500-38c14c51f036","Type":"ContainerStarted","Data":"50832f5feff8db7d472a9dbbfc79d2306261c2760dee5d8146eea3fdc4f7e28b"} Jun 09 17:31:52.482311 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:52.482214 2561 generic.go:356] "Generic (PLEG): container finished" podID="35a0e9f9-cca0-4ef7-b500-38c14c51f036" containerID="daee1f53e94b155d890d1c647d6d848ea08da650033c9da19ae7b038f564ea29" exitCode=0 Jun 09 17:31:52.482311 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:52.482289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" event={"ID":"35a0e9f9-cca0-4ef7-b500-38c14c51f036","Type":"ContainerDied","Data":"daee1f53e94b155d890d1c647d6d848ea08da650033c9da19ae7b038f564ea29"} Jun 09 17:31:53.489094 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:53.489052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" event={"ID":"35a0e9f9-cca0-4ef7-b500-38c14c51f036","Type":"ContainerStarted","Data":"7535b48ca1d42f8ec1dbd29481146d34193cd6d463a7dd3bd139388aa68bb813"} Jun 09 17:31:53.506982 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:53.506926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" podStartSLOduration=1.902443469 podStartE2EDuration="3.506908361s" totalImagesPullingTime="217.259965ms" totalInitContainerRuntime="1.387204927s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:31:53.505637207 +0000 UTC m=+851.583785450" watchObservedRunningTime="2026-06-09 17:31:53.506908361 +0000 UTC m=+851.585056622" Jun 09 17:31:58.088903 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.088853 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d"] Jun 09 17:31:58.094910 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.094879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.098862 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.098828 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 17:31:58.100700 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.100655 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d"] Jun 09 17:31:58.277084 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.277300 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.277300 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr55b\" (UniqueName: \"kubernetes.io/projected/fc628595-f0ae-455b-93c7-23bbd7d00249-kube-api-access-wr55b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.277300 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.277300 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.277475 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.277331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc628595-f0ae-455b-93c7-23bbd7d00249-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378193 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc628595-f0ae-455b-93c7-23bbd7d00249-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378398 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr55b\" (UniqueName: \"kubernetes.io/projected/fc628595-f0ae-455b-93c7-23bbd7d00249-kube-api-access-wr55b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378768 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.378909 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.378833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.380851 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.380817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc628595-f0ae-455b-93c7-23bbd7d00249-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.381318 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.381292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc628595-f0ae-455b-93c7-23bbd7d00249-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.386227 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.386193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr55b\" (UniqueName: \"kubernetes.io/projected/fc628595-f0ae-455b-93c7-23bbd7d00249-kube-api-access-wr55b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fph2d\" (UID: \"fc628595-f0ae-455b-93c7-23bbd7d00249\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.408173 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.408127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" Jun 09 17:31:58.567261 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:58.567226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d"] Jun 09 17:31:58.569262 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:31:58.569235 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc628595_f0ae_455b_93c7_23bbd7d00249.slice/crio-832e64b682fcf16e42f019ecb55c715da4d18bbf5ef24c46364e5377d9e6e644 WatchSource:0}: Error finding container 832e64b682fcf16e42f019ecb55c715da4d18bbf5ef24c46364e5377d9e6e644: Status 404 returned error can't find the container with id 832e64b682fcf16e42f019ecb55c715da4d18bbf5ef24c46364e5377d9e6e644 Jun 09 17:31:59.525542 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:59.525492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" event={"ID":"fc628595-f0ae-455b-93c7-23bbd7d00249","Type":"ContainerStarted","Data":"52c2c35f4e580300d73bfc10aef0196679fb2e42ec345ab937187edcbe731426"} Jun 09 17:31:59.525542 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:31:59.525554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fph2d" event={"ID":"fc628595-f0ae-455b-93c7-23bbd7d00249","Type":"ContainerStarted","Data":"832e64b682fcf16e42f019ecb55c715da4d18bbf5ef24c46364e5377d9e6e644"} Jun 09 17:32:00.588520 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:00.588475 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:32:00.589086 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:00.588561 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:32:00.601717 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:00.601683 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:32:01.477870 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:01.477833 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:32:01.553717 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:01.553684 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn" Jun 09 17:32:43.416667 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:43.416639 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:32:43.417297 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:43.417277 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:32:43.424655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:43.424627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:32:43.425499 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:32:43.425476 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:33:50.146878 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:50.146842 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a25f4ea-eaf5-4779-8381-300f585c9d66" containerID="085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424" exitCode=1 Jun 09 17:33:50.147430 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:50.146917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerDied","Data":"085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424"} Jun 09 17:33:50.147430 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:50.146978 2561 scope.go:117] "RemoveContainer" containerID="073bed4045bad107f2fda205f72d6af8022e099be3bd078adcd5d2c1ba709aac" Jun 09 17:33:50.147430 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:50.147295 2561 scope.go:117] "RemoveContainer" containerID="085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424" Jun 09 17:33:50.147571 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:33:50.147531 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:33:51.476577 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:51.476535 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:33:51.477025 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:33:51.476957 2561 scope.go:117] "RemoveContainer" containerID="085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424" Jun 09 17:33:51.477181 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:33:51.477161 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:34:05.323715 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:34:05.323674 2561 scope.go:117] "RemoveContainer" containerID="085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424" Jun 09 17:34:06.238386 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:34:06.238345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerStarted","Data":"4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4"} Jun 09 17:34:06.238601 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:34:06.238562 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:34:17.246496 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:34:17.246459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:36:05.916062 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:05.916027 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a25f4ea-eaf5-4779-8381-300f585c9d66" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" exitCode=1 Jun 09 17:36:05.916597 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:05.916110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerDied","Data":"4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4"} Jun 09 17:36:05.916597 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:05.916195 2561 scope.go:117] "RemoveContainer" containerID="085d354bfa30df6f67600375088d37b038ae0bb78d5c4587c662425c13b13424" Jun 09 17:36:05.916681 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:05.916644 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:36:05.916967 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:36:05.916945 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:36:06.298086 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:06.297976 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:36:06.924007 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:06.923975 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:36:06.924419 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:36:06.924201 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:36:07.244382 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:07.244285 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:36:07.929013 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:07.928985 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:36:07.929440 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:36:07.929238 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:36:19.323953 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:19.323912 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:36:19.324451 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:36:19.324206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:36:30.323784 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:30.323748 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:36:31.065505 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:31.065466 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerStarted","Data":"5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6"} Jun 09 17:36:31.065721 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:31.065702 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:36:42.073958 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:36:42.073914 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:37:43.451387 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:37:43.451354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:37:43.459639 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:37:43.459608 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:37:43.460649 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:37:43.460625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:37:43.477149 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:37:43.477117 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k4bl6_cd528e43-bc45-40c0-ad47-4ec9638b7774/ovn-acl-logging/0.log" Jun 09 17:38:04.548022 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:04.547985 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fph2d_fc628595-f0ae-455b-93c7-23bbd7d00249/storage-initializer/0.log" Jun 09 17:38:10.216671 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:10.216635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86d495cbff-lh6pt_d695228c-02b0-4593-a3f0-df074699564a/nginx/0.log" Jun 09 17:38:10.570403 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:10.570309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-644d88bdf4-hcsls_051e92bd-6d92-496e-8508-34de07352e4a/maas-api/0.log" Jun 09 17:38:10.801447 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:10.801403 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66d4c94557-kvjc9_5cfed52b-d085-4adf-95d6-5d1b85401eaf/manager/0.log" Jun 09 17:38:11.434468 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:11.434434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7456486947-v6gq4_3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476/copy-manifests/0.log" Jun 09 17:38:11.443272 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:11.443236 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7456486947-v6gq4_3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476/manager/0.log" Jun 09 17:38:12.940147 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:12.940107 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nqksn_e55f7550-760f-4539-ba6f-5e84ae285428/manager/0.log" Jun 09 17:38:13.277101 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:13.277021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ft6fk_a5b19c44-2dbe-433d-821b-edbe9118606b/registry-server/0.log" Jun 09 17:38:13.628370 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:13.628332 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x5glc_22a9e47e-8a56-4cd9-8a5b-df59cfa802f0/manager/0.log" Jun 09 17:38:13.983252 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:13.983163 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xgqbx_daa6b463-a570-42a3-b3bf-59b3ccacbff5/istio-proxy/0.log" Jun 09 17:38:14.435777 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:14.435743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/1.log" Jun 09 17:38:14.545740 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:14.545708 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-qm9z2_dd4e4c5f-79ee-4ca9-bac6-adacd3744d37/payload-pre-processing/0.log" Jun 09 17:38:14.660628 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:14.660589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:15.469749 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:15.469701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2_8e475562-9d55-4329-9e1c-ae9563978c4d/storage-initializer/0.log" Jun 09 17:38:15.477727 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:15.477681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpzlm2_8e475562-9d55-4329-9e1c-ae9563978c4d/main/0.log" Jun 09 17:38:15.587562 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:15.587532 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn_35a0e9f9-cca0-4ef7-b500-38c14c51f036/storage-initializer/0.log" Jun 09 17:38:15.595479 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:15.595441 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xgdpn_35a0e9f9-cca0-4ef7-b500-38c14c51f036/main/0.log" Jun 09 17:38:15.704642 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:15.704609 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fph2d_fc628595-f0ae-455b-93c7-23bbd7d00249/storage-initializer/0.log" Jun 09 17:38:22.938307 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:22.938271 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cf7tq_7073a4f0-8b38-482f-a977-2f1ceeba037a/global-pull-secret-syncer/0.log" Jun 09 17:38:23.101246 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:23.101206 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sjz89_6cc24f10-4aad-4b65-90ba-9526b46ec235/konnectivity-agent/0.log" Jun 09 17:38:23.171455 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:23.171421 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-117.ec2.internal_3f6ad2919053178a56c098c140bfb06e/haproxy/0.log" Jun 09 17:38:27.944834 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:27.944719 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nqksn_e55f7550-760f-4539-ba6f-5e84ae285428/manager/0.log" Jun 09 17:38:28.028131 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:28.028095 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ft6fk_a5b19c44-2dbe-433d-821b-edbe9118606b/registry-server/0.log" Jun 09 17:38:28.123451 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:28.123415 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x5glc_22a9e47e-8a56-4cd9-8a5b-df59cfa802f0/manager/0.log" Jun 09 17:38:29.981082 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:29.981039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-89t8h_7a5bc36e-9c21-4947-b782-e815047a8e6d/cluster-monitoring-operator/0.log" Jun 09 17:38:30.013718 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.013628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-state-metrics/0.log" Jun 09 17:38:30.036313 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.036278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-rbac-proxy-main/0.log" Jun 09 17:38:30.064074 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.064038 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8l4d8_1bcce16e-263e-4b5b-ac6b-a97eb0cdf736/kube-rbac-proxy-self/0.log" Jun 09 17:38:30.200916 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.200887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/node-exporter/0.log" Jun 09 17:38:30.226116 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.226091 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/kube-rbac-proxy/0.log" Jun 09 17:38:30.253895 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.253867 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5xnb_995ce29b-6058-4158-b87a-51a971ea173d/init-textfile/0.log" Jun 09 17:38:30.461005 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.460974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/kube-rbac-proxy-main/0.log" Jun 09 17:38:30.485708 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.485681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/kube-rbac-proxy-self/0.log" Jun 09 17:38:30.508749 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.508721 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xs84x_9104b9f4-5964-4356-8daf-dd8ac5d37546/openshift-state-metrics/0.log" Jun 09 17:38:30.549261 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.549179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/prometheus/0.log" Jun 09 17:38:30.571068 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.571036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/config-reloader/0.log" Jun 09 17:38:30.608340 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.608313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/thanos-sidecar/0.log" Jun 09 17:38:30.633963 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.633930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy-web/0.log" Jun 09 17:38:30.658227 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.658192 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy/0.log" Jun 09 17:38:30.682918 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.682883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/kube-rbac-proxy-thanos/0.log" Jun 09 17:38:30.706766 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.706740 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2904826-7a74-4a46-9b73-286a18703aeb/init-config-reloader/0.log" Jun 09 17:38:30.748356 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.748323 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a25f4ea-eaf5-4779-8381-300f585c9d66" containerID="5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6" exitCode=1 Jun 09 17:38:30.748563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.748396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" event={"ID":"4a25f4ea-eaf5-4779-8381-300f585c9d66","Type":"ContainerDied","Data":"5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6"} Jun 09 17:38:30.748563 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.748459 2561 scope.go:117] "RemoveContainer" containerID="4f80558fee57d0d40ab8451720f65401513adc0cb643f81fef62ac3be1045eb4" Jun 09 17:38:30.748892 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.748868 2561 scope.go:117] "RemoveContainer" containerID="5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6" Jun 09 17:38:30.749197 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:38:30.749168 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:38:30.839673 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:30.839585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-2zkz4_1728e357-fd0d-4a3c-87d9-74b41f6939fe/prometheus-operator-admission-webhook/0.log" Jun 09 17:38:32.071979 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:32.071918 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:38:32.072423 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:32.072327 2561 scope.go:117] "RemoveContainer" containerID="5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6" Jun 09 17:38:32.072533 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:38:32.072513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:38:32.338006 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:32.337921 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-92ltz_45cd3753-5f35-47da-b4a3-651f2ebdf097/networking-console-plugin/0.log" Jun 09 17:38:32.933477 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:32.933421 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/1.log" Jun 09 17:38:32.940484 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:32.940457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-s4q5n_02bb28ee-1fb5-4b9e-ae61-168fae629ec9/console-operator/2.log" Jun 09 17:38:33.339514 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.339431 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc"] Jun 09 17:38:33.343081 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.343053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.345540 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.345509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sd42r\"/\"kube-root-ca.crt\"" Jun 09 17:38:33.345725 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.345509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sd42r\"/\"openshift-service-ca.crt\"" Jun 09 17:38:33.346369 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.346346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sd42r\"/\"default-dockercfg-wd68q\"" Jun 09 17:38:33.353765 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.353723 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc"] Jun 09 17:38:33.446709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.446672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-lib-modules\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.446709 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.446727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-sys\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.446968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.446834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-proc\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.446968 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.446863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-podres\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.447040 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.446969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9gr\" (UniqueName: \"kubernetes.io/projected/bdde93a0-3531-4672-9016-de7fba651197-kube-api-access-4f9gr\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.521394 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.521367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55dbd95cf5-jv7bd_3d1dc0c9-25a7-4bf1-8aec-8c3c36ffc814/console/0.log" Jun 09 17:38:33.547648 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-proc\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547648 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-podres\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9gr\" (UniqueName: \"kubernetes.io/projected/bdde93a0-3531-4672-9016-de7fba651197-kube-api-access-4f9gr\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-proc\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-lib-modules\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-sys\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-lib-modules\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.547906 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-podres\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.548138 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.547946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdde93a0-3531-4672-9016-de7fba651197-sys\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.557465 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.557432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9gr\" (UniqueName: \"kubernetes.io/projected/bdde93a0-3531-4672-9016-de7fba651197-kube-api-access-4f9gr\") pod \"perf-node-gather-daemonset-95ljc\" (UID: \"bdde93a0-3531-4672-9016-de7fba651197\") " pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.656286 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.656247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:33.816137 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:33.816100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc"] Jun 09 17:38:33.818432 ip-10-0-142-117 kubenswrapper[2561]: W0609 17:38:33.818398 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdde93a0_3531_4672_9016_de7fba651197.slice/crio-9796b76d31caa3184ba16cef782a4d5539c292fe85a030509ac00a324da50cbd WatchSource:0}: Error finding container 9796b76d31caa3184ba16cef782a4d5539c292fe85a030509ac00a324da50cbd: Status 404 returned error can't find the container with id 9796b76d31caa3184ba16cef782a4d5539c292fe85a030509ac00a324da50cbd Jun 09 17:38:34.249943 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:34.249913 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-cxb8g_5070ce3a-0ffa-4cd1-b243-4ec6f54df564/volume-data-source-validator/0.log" Jun 09 17:38:34.775450 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:34.775396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" event={"ID":"bdde93a0-3531-4672-9016-de7fba651197","Type":"ContainerStarted","Data":"5a264154768c2cc02c34147047b0d47543319ff8d520d57844b96ff863a9573a"} Jun 09 17:38:34.775958 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:34.775507 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:34.775958 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:34.775532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" event={"ID":"bdde93a0-3531-4672-9016-de7fba651197","Type":"ContainerStarted","Data":"9796b76d31caa3184ba16cef782a4d5539c292fe85a030509ac00a324da50cbd"} Jun 09 17:38:34.790966 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:34.790905 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" podStartSLOduration=1.790889636 podStartE2EDuration="1.790889636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:38:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:38:34.790032571 +0000 UTC m=+1252.868180835" watchObservedRunningTime="2026-06-09 17:38:34.790889636 +0000 UTC m=+1252.869037876" Jun 09 17:38:35.437940 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:35.437907 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9f6sv_32e20b2e-1a4e-4ef3-97ae-9933d40b8048/dns/0.log" Jun 09 17:38:35.463020 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:35.462986 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9f6sv_32e20b2e-1a4e-4ef3-97ae-9933d40b8048/kube-rbac-proxy/0.log" Jun 09 17:38:35.558229 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:35.558193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57772_1425bdc3-ca38-44d4-b1ac-c4a39a889451/dns-node-resolver/0.log" Jun 09 17:38:36.098937 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:36.098907 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6998555b4-gcj8w_99ea0b3f-6e41-4e08-99ce-9b8543ba43d2/registry/0.log" Jun 09 17:38:36.102988 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:36.102958 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6998555b4-gcj8w_99ea0b3f-6e41-4e08-99ce-9b8543ba43d2/registry/1.log" Jun 09 17:38:36.152948 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:36.152919 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwlhx_9f99dde7-d0a9-4841-bd41-36e6318af67c/node-ca/0.log" Jun 09 17:38:37.102562 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.102524 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xgqbx_daa6b463-a570-42a3-b3bf-59b3ccacbff5/istio-proxy/0.log" Jun 09 17:38:37.227078 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.227034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/1.log" Jun 09 17:38:37.227614 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.227594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/0.log" Jun 09 17:38:37.247148 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.247118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-qm9z2_dd4e4c5f-79ee-4ca9-bac6-adacd3744d37/payload-pre-processing/0.log" Jun 09 17:38:37.273121 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.273082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:37.273121 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.273109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:37.907277 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:37.907209 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-67c5n_70c0d637-d3dc-4e28-beab-1aeef4d36c05/serve-healthcheck-canary/0.log" Jun 09 17:38:38.444889 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:38.444846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7ttfv_17cae500-d885-4537-93f7-8dc2bf6c966d/insights-operator/0.log" Jun 09 17:38:38.446932 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:38.446904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7ttfv_17cae500-d885-4537-93f7-8dc2bf6c966d/insights-operator/1.log" Jun 09 17:38:38.540693 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:38.540665 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjs7b_19f0eac2-78a6-4245-8c5e-8353c8b1894d/kube-rbac-proxy/0.log" Jun 09 17:38:38.563518 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:38.563486 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjs7b_19f0eac2-78a6-4245-8c5e-8353c8b1894d/exporter/0.log" Jun 09 17:38:38.588067 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:38.588036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjs7b_19f0eac2-78a6-4245-8c5e-8353c8b1894d/extractor/0.log" Jun 09 17:38:40.792624 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:40.792593 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sd42r/perf-node-gather-daemonset-95ljc" Jun 09 17:38:40.870628 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:40.870598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86d495cbff-lh6pt_d695228c-02b0-4593-a3f0-df074699564a/nginx/0.log" Jun 09 17:38:41.020397 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:41.020364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-644d88bdf4-hcsls_051e92bd-6d92-496e-8508-34de07352e4a/maas-api/0.log" Jun 09 17:38:41.108706 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:41.108592 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66d4c94557-kvjc9_5cfed52b-d085-4adf-95d6-5d1b85401eaf/manager/0.log" Jun 09 17:38:41.451713 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:41.451670 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7456486947-v6gq4_3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476/manager/0.log" Jun 09 17:38:41.474597 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:41.474567 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7456486947-v6gq4_3dbc8663-29c7-4d1d-a0eb-4d4ab8b89476/copy-manifests/0.log" Jun 09 17:38:43.316048 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:43.316013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59b6c4b7cf-kz2hz_9d6a7cee-7a2a-4d01-8e6b-18f4b49967bb/manager/0.log" Jun 09 17:38:46.298214 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:46.298173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" Jun 09 17:38:46.298655 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:46.298623 2561 scope.go:117] "RemoveContainer" containerID="5322ad8561a0ea152a71ff573e5360944c1e757f40b2eff682d228158c65dbf6" Jun 09 17:38:46.298921 ip-10-0-142-117 kubenswrapper[2561]: E0609 17:38:46.298892 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-zmlwp_openshift-ingress(4a25f4ea-eaf5-4779-8381-300f585c9d66)\"" pod="openshift-ingress/payload-processing-7c6c859784-zmlwp" podUID="4a25f4ea-eaf5-4779-8381-300f585c9d66" Jun 09 17:38:47.617935 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.617905 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xgqbx_daa6b463-a570-42a3-b3bf-59b3ccacbff5/istio-proxy/0.log" Jun 09 17:38:47.765307 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.765271 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/1.log" Jun 09 17:38:47.765572 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.765553 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/0.log" Jun 09 17:38:47.778629 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.778602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-qm9z2_dd4e4c5f-79ee-4ca9-bac6-adacd3744d37/payload-pre-processing/0.log" Jun 09 17:38:47.798853 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.798822 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:47.799047 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:47.798941 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:48.847410 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:48.847372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-ksbln_f2d2e1d9-1846-4797-8202-a789070a4c7f/kube-storage-version-migrator-operator/1.log" Jun 09 17:38:48.848366 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:48.848339 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-ksbln_f2d2e1d9-1846-4797-8202-a789070a4c7f/kube-storage-version-migrator-operator/0.log" Jun 09 17:38:48.911877 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:48.911844 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xgqbx_daa6b463-a570-42a3-b3bf-59b3ccacbff5/istio-proxy/0.log" Jun 09 17:38:49.002375 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:49.002316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/1.log" Jun 09 17:38:49.002679 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:49.002657 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mn86_701bd334-3b82-4d84-a563-bf093cf8d9e1/istio-proxy/0.log" Jun 09 17:38:49.012720 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:49.012660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-qm9z2_dd4e4c5f-79ee-4ca9-bac6-adacd3744d37/payload-pre-processing/0.log" Jun 09 17:38:49.029018 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:49.028972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:49.029018 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:49.029018 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-zmlwp_4a25f4ea-eaf5-4779-8381-300f585c9d66/payload-processing/3.log" Jun 09 17:38:50.136233 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.136197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/kube-multus-additional-cni-plugins/0.log" Jun 09 17:38:50.158382 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.158350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/egress-router-binary-copy/0.log" Jun 09 17:38:50.180351 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.180325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/cni-plugins/0.log" Jun 09 17:38:50.204405 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.204379 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/bond-cni-plugin/0.log" Jun 09 17:38:50.233593 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.233563 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/routeoverride-cni/0.log" Jun 09 17:38:50.256156 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.256130 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/whereabouts-cni-bincopy/0.log" Jun 09 17:38:50.277379 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.277346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdf7p_bf847c2e-14a7-4d96-b898-bd618ae46f0a/whereabouts-cni/0.log" Jun 09 17:38:50.482668 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.482546 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fcchx_ac03a354-9088-42a7-affe-c92e3569fd41/kube-multus/0.log" Jun 09 17:38:50.618959 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.618924 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f4772_1e79cb33-2aae-49de-afef-e45c39fe247d/network-metrics-daemon/0.log" Jun 09 17:38:50.642513 ip-10-0-142-117 kubenswrapper[2561]: I0609 17:38:50.642460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f4772_1e79cb33-2aae-49de-afef-e45c39fe247d/kube-rbac-proxy/0.log"